"... who crawl the web using the Firefox extension and command line script"

https://addons.mozilla.org/en-GB/firefox/addon/mwmbl-web-cra...

https://github.com/mwmbl/crawler-script