mlscraper VS HungryHippo

See if something like autoscraper or mlscraper suits your needs.

Why GPT-based then? There are libraries that do this: You give examples, they generate the rules for you and give you a scraper object that takes any html and returns the scraped data.

Mine: https://github.com/lorey/mlscraper

GitHub - lorey/mlscraper: 🤖 Scrape data from HTML websites automatically by just providing examples

Check it out here: https://github.com/lorey/mlscraper Example: https://github.com/lorey/mlscraper/blob/master/examples/quotes\_to\_scrape.py

In case anyone wants to detect the selectors automatically, here's a small python library I wrote that does it for you: https://github.com/lorey/mlscraper

It seems that RSS feed generators are a bit like static site generators: it's often thought to be easier to make your own than to learn to use someone else's.

Anyway, here's another self-hosted open source RSS feed generator for arbitrary websites: https://github.com/hueyy/HungryHippo

HungryHippo generates RSS feeds for websites that don't have one. If the website you're trying to monitor is public it might be supported already. If not, you can always send in a pull request or open an issue. It can be hosted with a single docker image, so it's quite straightforward.