newsit VS thredd

On Firefox there is Newsit & Reddit Checker.

Newsit

Something I've always wanted to work on was a browser extension that allowed things like this to happen collaboratively. There's stuff like PeerLibrary[0] that lets you annotate things as a group, but it's limited to publications and things you upload. Nyxt seems to meet what I want but lacks the collaborative aspect I'm looking for.

There's a couple of Browser extensions that have sorta tried to accomplish this before. Epiverse[1] seems to be the most polished one so far. It originally intended to allow any user to comment on any webpage. But it found that without existing content, few found it useful. So eventually the creator just parsed to see if the webpage was posted on Reddit or Hackernews. The original purpose of it ended up being too expensive to host so it ended up just becoming a HN/Reddit parser. Which, tbh, is basically what I want to build at this point. I'd love to contribute to the project, but I don't have much time and it's closed source

The other similar extensions also just parse HN/Reddit like Newsit[2] (which is open-source) and Thredd[3] (which only parses Reddit). My only real addition to this is that I'd like to include the ability to parse more than just Reddit and HN. I wanna create a discussion aggregator. There's similar sites like Lobste.rs and Lemmy.ml that could also be parsed, but obviously that's not the full extent of where discussions happen around a webpage.

I don't think I have it figured out, and I don't know if anyone ever will, but I think there's a lot to gain if someone is able to someday harness that feeling that you get when you read something really good or find something really cool and wanna see how others responded

[0] https://peerlibrary.org/

[1] https://epiverse.co/

[2] https://newsit.benwinding.com/

[3] https://thredd.io/

I often use Newsit to tell whether something has been posted.

Nice, so it periodically retrieves a list of HN posts and queries that list locally, so you're not telling algolia any specific site details.

There are millions of posts on HN, how many submissions does it retrieve? Surely if you find an obscure site, it might not be in the local list.

Maybe you could just always query many urls together, with only 1 of them being the real url you want. That would make it hard to track too.

Also I made a similar extension, but it queries sources on every page load.

(extension) https://newsit.benwinding.com/

(source) https://github.com/benwinding/newsit

Yeah that's true, I mean I use gulp for browser extension builds, as there's a few random tasks (img compression, copying files, babel) that need to be done in order to build cross platform. Would be a pain in webpack.

My example: https://github.com/benwinding/newsit/blob/master/gulpfile.js

Extensions like Thredd (still works but is abandoned now just like Reddit Check extension of mid 2010s it shared inspiration from). Even Reddit's first extension (late 2000s, early 2010s) seemed to have basic similar functionality but Thredd is possibly the best version of it since it can find Website links that are shared in Reddit Thread's Comments section, not just only Reddit Post Links.