I created this site because I think it ought to exist. The shifting homepages of major media sites should be saved so they can be studied. Done right, I believe PastPages could serve as a resource for scholars seeking to study coverage of news events, like the upcoming U.S. presidential election.
Collecting this data cost money. So I've set up a Kickstarter drive to raise funds. If you'd like to help keep PastPages alive, please considering giving.
I'm using Selenium's Firefox driver from inside a Django app. There is Python binding that's slick once you figure out a couple timeout related workarounds that are necessary. Their forums helped me over that hurdle.
Comments
I created this site because I think it ought to exist. The shifting homepages of major media sites should be saved so they can be studied. Done right, I believe PastPages could serve as a resource for scholars seeking to study coverage of news events, like the upcoming U.S. presidential election.
Collecting this data cost money. So I've set up a Kickstarter drive to raise funds. If you'd like to help keep PastPages alive, please considering giving.
http://www.kickstarter.com/projects/651552740/keep-pastpages...
What stack are you using for the web page capture? It's a perfect crisp capture. I've tried before and never got such good programatic results.
I'm using Selenium's Firefox driver from inside a Django app. There is Python binding that's slick once you figure out a couple timeout related workarounds that are necessary. Their forums helped me over that hurdle.