bulk-downloader-for-reddit VS apollo-backend

Until now, I ran a script every day using bulk-downloader-for-reddit to archive about ten subreddits. It usually took less than an hour each time, even when he had to download video files of a few hundred MB.

Look into bdfr, it's a cli reddit downloader.

I'm with you! I've already mass edited all my comments on both and removed all my submissions on this account, and my other/older one. Just waiting on bdfr to finish pulling all of my saved things for me, then I'll delete both. I may just be a tiny drop in the user ocean, but some of my posts definitely helped others and contributed useful things.

FWIW I just backed up my sub with bulk-downloader-for-reddit : https://www.reddit.com/r/DataHoarder/comments/1479c7b/historic_reddit_archives_ongoing_archival_effort/ -> https://github.com/aliparlakci/bulk-downloader-for-reddit

A GDPR export should have all the data, but they’re taking their time processing. An alternative is to use an archiving tool like BDFR. Unfortunately, it’s limited to 1000 posts due to API limitations.

r/DataHoarder was the big reason I started using Reddit regularly. While I don't speak for all of them, many will suggest bdfr or HTTrack for all your scraping needs.

https://github.com/aliparlakci/bulk-downloader-for-reddit or MONOLITH which has an extension for chrome

I’m going to delete my Reddit account soon to further the protest, since by this point I don’t use it much anymore. I already backed up my entire post history using this tool since there are some important memories there for me, so I basically have nothing to lose now.

I believe this endpoint is the only way to retrieve json with posts from Reddit, so every single app would use it. Even Apollo used it, although it did it with OAuth. See this line:

https://github.com/christianselig/apollo-backend/blob/ab04b2...

Disclaimer: it's been quite a while since I've last looked into Reddit API, so I could easily be wrong.

I'd consider platform and infra tools the kind of projects that require DSA. As for product, this is the typical kind of projects I've worked on: https://github.com/christianselig/apollo-backend which doesn't have any LC stuff. But I get that things are very different in big tech / FAANGS.

Since Apollo’s backend server is now open sourced, it'd be great if we could install the server on a Raspberry Pi or something so one can get notifications and other features that rely on it.

5. Apollo Backend: - Set up an Apollo backend server using a community-driven platform like https://github.com/christianselig/apollo-backend. - Design and implement the backend infrastructure for SecurIoT, including data storage, authentication, and API endpoints. - Integrate the backend with the frontend components of SecurIoT. - Thoroughly test the backend functionality, ensuring it supports the required operations and scalability.

The Backend was open sourced to counter U/spez Bullshit arguments about inefficient code creating too many API requests

See here https://github.com/christianselig/apollo-backend

On this same call, Huffman claimed that Apollo employed "scraping", a technique of programmatically fetching a webpage to process its contents.[d] Scraping is largely considered bad practice in web resource development, as it is not using resources as they were intended, and can be costly to the party being scraped. This is especially true when the same data is available via an API (Application Programming Interface), which is the intended method of programmatically fetching website content. Christian refutes Huffman's accusation, and has open-sourced Apollo's server code to prove it does not scrape reddit. I have seen no credible claims or evidence that Huffman is correct.

You could totally do everything you want to, except it's not as simple as making Reddit API requests because there's this: https://github.com/christianselig/apollo-backend

Apollos is here https://github.com/christianselig/apollo-backend