mlscraper VS subscriptions-digest

See if something like autoscraper or mlscraper suits your needs.

Why GPT-based then? There are libraries that do this: You give examples, they generate the rules for you and give you a scraper object that takes any html and returns the scraped data.

Mine: https://github.com/lorey/mlscraper

GitHub - lorey/mlscraper: 🤖 Scrape data from HTML websites automatically by just providing examples

Check it out here: https://github.com/lorey/mlscraper Example: https://github.com/lorey/mlscraper/blob/master/examples/quotes\_to\_scrape.py

In case anyone wants to detect the selectors automatically, here's a small python library I wrote that does it for you: https://github.com/lorey/mlscraper

This could nicely supplement my GitHub automation that emails feed digests https://github.com/mhitza/subscriptions-digest

Similarly to my repository, I think I would suggest the option to fetch the configuration file from an external resource defined via an action secret. For my automation I'm using a Gist (not sure if Gitlab has same thing; also private but publicly accessible snippets).

At least that way you can keep your own feed configuration while allowing those that fork the repository to not have to manually fix conflicts within the feeds.toml config.

Being displeased with feed reader experience I wrote up a quick script and GitHub automation that generates a daily digest email for my subscriptions.

I have been using this setup for a week at this point, and I found it pleasant enough that I thought others might find a use for it as well.

https://github.com/mhitza/subscriptions-digest