reddit-html-archiver
RedditScrape
| reddit-html-archiver | RedditScrape | |
|---|---|---|
| 12 | 2 | |
| 165 | 79 | |
| - | - | |
| 1.8 | 6.6 | |
| almost 4 years ago | 11 months ago | |
| Python | Python | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
reddit-html-archiver
-
/r/planetside will be going private on June 12th, and will not be coming back until Reddit reverses course on API pricing
Other options, like https://github.com/libertysoft3/reddit-html-archiver are not working anymore (I tried it to create a self-hosted /r/planetside backup).
-
This Reddit Community Has Been Archived
Well done, now you should make it sane. No need to reinvent the wheel here. Just rewrite reddit-html-archiver to use the raw json from redarcs rather than the pushshift api.
-
r/okbuddyretard will be "completely wiped from existence" according to one of the mods
I've seen several banned subs archived using https://github.com/libertysoft3/reddit-html-archiver
- What are Your favorite tools to backup reddit data? (Text Posts, Media Content, Comments..)
-
Archiving as much of Soundgasm as possible
https://github.com/libertysoft3/reddit-html-archiver can accomplish step 1 out of the box Parse for every line including soundgasm and/or other domains you are targeting, and maybe run a dedupe on the list before download to lighten the load on yt-dl since it wasnt optimized for that last I checked that deep (which is YEEEEARS ago fwiw)
- I’m leaving Reddit. If there’s a mass movement to do something about what’s happening, let me know.
- /r/NoNewNormal has been banned by Reddit. A good reminder that Reddit is run by fascists, and that all the subreddits that petitioned for this are book-burners. Are you a developer? Help us program the alternative. See comments for details.
- Welcome my r/NoNewNormal bretheren
- r/NoNewNormal has been banned!
-
Is there a way I can archieve the r/lounge subreddit?
You could try using https://github.com/libertysoft3/reddit-html-archiver which is the software we use to power our reddit archiving efforts over at https://the-eye.eu/r/
RedditScrape
-
This Reddit Community Has Been Archived
If you only want to back up stuff from specific subs, you could use RedditScrape. It queries the official PushShift API to get posts and then downloads them via gallery-dl. I have been running it for almost 14 h now and downloaded 187k media (227 GiB) from a few subs that interest me. Might be getting rate limited by now, though I've been using a vpn so I could just switch location if really necessary.
-
Improved version of RedditScrape for backing up your favorite subreddits (Now with Push Shift)
Thanks to the help of a fellow anonymous Redditor I've released a new version of RedditScrape. This new version now uses the push shift API to gather gigantic levels of data for you to download. This means we no longer need to provide any form of reddit credentials.
What are some alternatives?
redscarepod-archive
redarcs-reader
saidit - The reddit open source fork powering SaidIt
PushshiftDumps - Example scripts for the pushshift dump files
redditPostArchiver - Easily archive important Reddit post threads onto your computer
eternity - bypass Reddit's 1000-item listing limits by externally storing your Reddit items (saved, created, upvoted, downvoted, hidden) in your own database
ripme - Downloads albums in bulk
gwaripper - Tool for conveniently downloading audios from r/gonewildaudio and similar subreddits
reddit_export_userdata - Export userdata from your reddit accounts. Submissions, comments, saved, upvoted contents are supported.
redditDataExtractor - The reddit Data Extractor is a cross-platform GUI tool for downloading almost any content posted to reddit. Downloads from specific users, specific subreddits, users by subreddit, and with filters on the content is supported. Some intelligence is built in to attempt to avoid downloading duplicate external content.
reddit - A collection of reddit bots and utilities
redditPostArchiver - Easily archive important Reddit post threads onto your computer