reddit-html-archiver VS bulk-downloader-for-reddit

Other options, like https://github.com/libertysoft3/reddit-html-archiver are not working anymore (I tried it to create a self-hosted /r/planetside backup).

Well done, now you should make it sane. No need to reinvent the wheel here. Just rewrite reddit-html-archiver to use the raw json from redarcs rather than the pushshift api.

I've seen several banned subs archived using https://github.com/libertysoft3/reddit-html-archiver

https://github.com/libertysoft3/reddit-html-archiver can accomplish step 1 out of the box Parse for every line including soundgasm and/or other domains you are targeting, and maybe run a dedupe on the list before download to lighten the load on yt-dl since it wasnt optimized for that last I checked that deep (which is YEEEEARS ago fwiw)

You could try using https://github.com/libertysoft3/reddit-html-archiver which is the software we use to power our reddit archiving efforts over at https://the-eye.eu/r/

Until now, I ran a script every day using bulk-downloader-for-reddit to archive about ten subreddits. It usually took less than an hour each time, even when he had to download video files of a few hundred MB.

Look into bdfr, it's a cli reddit downloader.

I'm with you! I've already mass edited all my comments on both and removed all my submissions on this account, and my other/older one. Just waiting on bdfr to finish pulling all of my saved things for me, then I'll delete both. I may just be a tiny drop in the user ocean, but some of my posts definitely helped others and contributed useful things.

FWIW I just backed up my sub with bulk-downloader-for-reddit : https://www.reddit.com/r/DataHoarder/comments/1479c7b/historic_reddit_archives_ongoing_archival_effort/ -> https://github.com/aliparlakci/bulk-downloader-for-reddit

A GDPR export should have all the data, but they’re taking their time processing. An alternative is to use an archiving tool like BDFR. Unfortunately, it’s limited to 1000 posts due to API limitations.

r/DataHoarder was the big reason I started using Reddit regularly. While I don't speak for all of them, many will suggest bdfr or HTTrack for all your scraping needs.

https://github.com/aliparlakci/bulk-downloader-for-reddit or MONOLITH which has an extension for chrome

I’m going to delete my Reddit account soon to further the protest, since by this point I don’t use it much anymore. I already backed up my entire post history using this tool since there are some important memories there for me, so I basically have nothing to lose now.