Last I played with it, the latency on webrecorder was uncomfortably high for always-on recording of personal web usage (the pages only display once fully rendered). I wish webpages would render as normal and get asynchronously archived once loading is complete.
That would allow constant archival of every webpage a user ever visits -- an immutable record over the user's years of crawling the web.
Can this be combined with webrecorder? Does anyone know someone who's done this? I only use about 30GB of traffic a month so a 2TB $70 hard drive would last me almost six years.
Comments
Last I played with it, the latency on webrecorder was uncomfortably high for always-on recording of personal web usage (the pages only display once fully rendered). I wish webpages would render as normal and get asynchronously archived once loading is complete.
That would allow constant archival of every webpage a user ever visits -- an immutable record over the user's years of crawling the web.
This is usually solved by using a proxy: http://netpreserve.org/projects/live-archiving-http-proxy/
Can this be combined with webrecorder? Does anyone know someone who's done this? I only use about 30GB of traffic a month so a 2TB $70 hard drive would last me almost six years.