Skip to content

Show HN: I made a tool to download all of Wikipedia on a weekly basis

github.com/ternera
2 pointsterneradiscuss
On HN

Hi everyone. This tool exists as a way to quickly and easily download all of Wikipedia (as a .bz2 archive) from the Wikimedia data dumps, but it also prompts users to automate the process by downloading an updated version and replacing the old download every week. I plan to throw this on a Linux server and thought it may come in useful for others!

Inspiration came from the following comment on Reddit, which asked about automating the process:

https://www.reddit.com/r/YouShouldKnow/comments/whxmhc/comme...

Comments

No comments yet.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.