scrapeghost VS newsboat

Not my project but an ex-colleague has been having some success in this direction: https://jamesturk.github.io/scrapeghost/

Yes, there is something like that available - ScrapeGhost.

With AI scraping, tools can be far more resilient than soon enough to minor dom changes. See - https://jamesturk.github.io/scrapeghost/.

Their ToS mentions scraping but it pertains to scraping their frontend instead of using their API, which they don't want you to do.

Also - this library requests the HTML by itself [0] and ships it as a prompt but with preset system messages as the instruction [1].

[0] - https://github.com/jamesturk/scrapeghost/blob/main/src/scrap...

[1] - https://github.com/jamesturk/scrapeghost/blob/main/src/scrap...

If you're using https://newsboat.org, you can add a filter (killfile) to remedy this:

  ignore-article "*" "title =~ \"#shorts\""

I use newsboat.

> Have you used any modern RSS reader recently like inoreader, they load the content of the page without visiting the publishing website.

I'm happy with newsboat[1]; but I'm not surprised that people have integrated scraping into RSS readers.

Fundamentally, that's not a problem with RSS, that's a war between scrapers and content providers. If the email newsletter model persists long enough, I'd expect that people will come out with "newsletter readers" that scrape websites too.

I'm not sure there's a good long-term solution to the problem. Aside from constant vigilance (obfuscation).

---

1. https://newsboat.org/

So, I installed a terminal RSS reader called Newsboat and added the feed to it. I have it always running in a terminal, and the scores refresh every minute. I can open the Cricinfo link in a browser by selecting a match and typing o.

Not at the moment. There is an open Github issue asking for that feature, however, no idea if/when that will be implemented: https://github.com/newsboat/newsboat/issues/904

Here's part of my newsboat config (works great for subscriptions):

Newsboat RSS / Feed reader

Che rss feader usate? Io per il momento uso Newsboat su Desktop e Feeder su Mobile