Comment on Make Your Own Internet Archive with Archive BoxparentComments−nikisweeting5yYeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;)https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.−mycall5yHow does ArchiveBox function compared to https://archivarix.com? I recently used Archivarix to backup a large website (93k pages), but it messed up the js/css.
Comments
Yeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;)
https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv...
I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.
How does ArchiveBox function compared to https://archivarix.com? I recently used Archivarix to backup a large website (93k pages), but it messed up the js/css.