It regularly blocks me too. I've begun search Google for: what does [url] say about [search query]

It'll make a Gemini summary of the page, and can be prompted for more details. It's really the only use for Gemini I've found reliable. I'd still rather directly view the output of the scraper bot, though.

If anyone knows a good scraping bot that lets you view the output directly, without running it through an LLM, please let me know.