Ask HN: How can you recursively grep a website? 1 pointwolfparade14 years ago3 commentsSaveHideCopy link On HNI want to use a regular expression on a whole domain. What is the easiest way to do that?Comments−kevinburke14yGoogle's site: operator... or write a crawler to parse all within-site text links, download the site source into files on your machine and then grep.−saiko-chriskun14yyep either just use google, or download the site as mentioned and use:grep myTerm path/to/mysite/−saiko-chriskun14yhm looks like ycombi parsed out my asterisks. at the end of the path should've been two.
Comments
Google's site: operator... or write a crawler to parse all within-site text links, download the site source into files on your machine and then grep.
yep either just use google, or download the site as mentioned and use:
grep myTerm path/to/mysite/
hm looks like ycombi parsed out my asterisks. at the end of the path should've been two.