Skip to content

Comment on Archiving URLs

Comments

A couple of "snapshot" services which weren't mentioned:

http://www.peeep.us/

http://archive.is/

Those look interesting and I'll mention them, but I'm not sure whether I can support them in my archive-bot code. Neither site seems to offer an easily scripted way to archive URLs; for example, the archive.is blog seems to reject adding such functionality: http://blog.archive.is/post/60948358744/given-that-youre-not...

Yes, it seems batch downloading won't be implemented, but batch archiving is possible:

http://blog.archive.is/post/45031162768/can-you-recommend-th...

Sweet. I've added archive.is to my archive bot.

I've been pretty happy with Pinboard's archiving option, $25/year. It does a better job of saving pages so they render correctly later on than other services I've tried, no complaints yet :) Plus it does in-page searching, which is incomparably superior to just archiving.

I don't think peeep is a viable option

How long will Peeep keep my data? Virtually forever. Nevertheless, we retain a right to remove content which has not been accessed for a month.

Yes, I think archive.is is a better one of the two. From the developer's blog:

"- How long my snapshot will be stored? I have in mind the case when it has not been accessed for a long time.

- Forever.

Although the snapshot may be deleted if it violates the rules of the hosting provider (for example, if the page contains pornography or used as the landing page for spam campaigns)."

" - For how long will this website and the archives be available, how many people maintain this project?Thank you.

- Forever. Actually, I think, in 3-5-10 years all the content of the archive (it is only ~20Tb) could fit in a mobile phone memory, so anyone will be able to have a synchronized copy of the full archive. So my “forever” is not a joke.

Two persons, currently."

http://blog.archive.is/

However, peeep.us exists since 2009, and a couple of my snapshots from 2010 are still alive (I definitely didn't access them once a month, maybe once a year at most).

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.