Comment on Deep dive into finding RSS feedsComments−renegat0x01yI fought this problem, since I wrote my own RSS reader in python. Might not be perfect.The problem with the approach presented here is speed. Most of the web pages, especially smaller are really slow.Crawling most of the web pages is pain, especially if you use selenium and small SBC.Therefore either the page presents a clean nice RSS link, or get lost.Most of the good, modern pages give you nice RSS. Even GitHub gives you RSS for commits.For other pages I try openRSS.For YouTube I use yt-dlp to obtain channel id, to establish RSS.Algorithm is crude, but gets the job done.https://github.com/rumca-js/Django-link-archive/blob/main/rs...
Comments
I fought this problem, since I wrote my own RSS reader in python. Might not be perfect.
The problem with the approach presented here is speed. Most of the web pages, especially smaller are really slow.
Crawling most of the web pages is pain, especially if you use selenium and small SBC.
Therefore either the page presents a clean nice RSS link, or get lost.
Most of the good, modern pages give you nice RSS. Even GitHub gives you RSS for commits.
For other pages I try openRSS.
For YouTube I use yt-dlp to obtain channel id, to establish RSS.
Algorithm is crude, but gets the job done.
https://github.com/rumca-js/Django-link-archive/blob/main/rs...