bulk-downloader-for-reddit
gallery-dl
Our great sponsors
bulk-downloader-for-reddit | gallery-dl | |
---|---|---|
80 | 187 | |
2,197 | - | |
- | - | |
0.0 | - | |
2 months ago | - | |
Python | ||
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bulk-downloader-for-reddit
- BDFR skipping Reddit hosted videos
-
Limited Reddit access?
Until now, I ran a script every day using bulk-downloader-for-reddit to archive about ten subreddits. It usually took less than an hour each time, even when he had to download video files of a few hundred MB.
-
Any methods with Unraid to Automatically download all saved items from Reddit
Look into bdfr, it's a cli reddit downloader.
-
Goodbye everyone
I'm with you! I've already mass edited all my comments on both and removed all my submissions on this account, and my other/older one. Just waiting on bdfr to finish pulling all of my saved things for me, then I'll delete both. I may just be a tiny drop in the user ocean, but some of my posts definitely helped others and contributed useful things.
-
POLL RESULTS - Reddit API changes and the future of /r/ErgoMechKeyboards
FWIW I just backed up my sub with bulk-downloader-for-reddit : https://www.reddit.com/r/DataHoarder/comments/1479c7b/historic_reddit_archives_ongoing_archival_effort/ -> https://github.com/aliparlakci/bulk-downloader-for-reddit
-
How to keep my saved
A GDPR export should have all the data, but they’re taking their time processing. An alternative is to use an archiving tool like BDFR. Unfortunately, it’s limited to 1000 posts due to API limitations.
-
The future of r/ObscureMedia and Reddit
r/DataHoarder was the big reason I started using Reddit regularly. While I don't speak for all of them, many will suggest bdfr or HTTrack for all your scraping needs.
- Reddit limits the use of API to 1000,Let's work together to save the content of StableDiffusion Subreddit as a team
-
Information is currently available.
https://github.com/aliparlakci/bulk-downloader-for-reddit or MONOLITH which has an extension for chrome
-
So, how is everyone?
I’m going to delete my Reddit account soon to further the protest, since by this point I don’t use it much anymore. I already backed up my entire post history using this tool since there are some important memories there for me, so I basically have nothing to lose now.
gallery-dl
- Open Source Instagram Scraper?
-
How to download all tweets of other accounts?
If you want to grab all the images and videos take a look at gallery-dl, found here https://github.com/mikf/gallery-dl
-
Can someone help me with gallery-dl (i am halfway there)
My question is about the docs. Here is the link to gallery-dl on github. from what i see it's kept up-to-date. I'm trying to download a post from ig through any method. Also thinking of creating a configuration-file if necessary. My OS: windows 10, i have worked with a cli before but on linux and my knowledge is very superficial. I have managed to use this tool on other websites like pinterest but can't think of any solutions for instagram as of now. The errors i get are about using the authentication method and when trying to set the cookies-from-browser option.
-
Gothub: Alternative front-end for GitHub written with Go
I could set up a redirect to the '/raw/' pages but then the syntax highlighting is gone.
The same page is perfectly viewable over plain html on gothub[2] though.
Github also seems to be hiding their "Assets" (binaries et al) on the "/releases" page for some projects behind javascript(especially older versions).[3] Something else that wasn't the case about ~1.5 years ago.
Would be great if gothub could unshackle the links to those as well[4], but that appears to not be working at the moment[5] .
This project appears to be a more performant(measurably so), more privacy friendly(as Microsoft won't have a record of your interest in certain projects) alternative front-end for "non logged in" github users.
I like it, but it still needs work.
[1] https://github.com/mackyle/sqlite/blob/18cf47156abe94255ae14...
[2] https://gh.bloatcat.tk/mackyle/sqlite/blob/18cf47156abe94255...
[3] https://github.com/mikf/gallery-dl/releases
-
I don't publish to Instagram but I want to follow the posts of people that are only on that network. What are my options?
since it's primarily a picture/video platform, you can use gallery-dl to scrape the feeds you want to follow if you provide authentication, and you should be able to write the captions and stuff to metadata files, but not sure how you'd display it in a useful way.
-
How to download TikTok slideshow pics?
you could use gallery-dl to do this as well.
-
If I have a subscription to a paid adult site that allows subscribers to download all galleries and videos at full resolution, etc, what's the best way to rip the entire site? Any thoughts appreciated. Thanks.
gallery-dl (CLI based) focuses on images.
-
Gallery-dl (custom folder configs, reddit "galleries" and archive-format)
Maybe there is a way to set specific configs only for reddit gallery images, but I'm not sure how it works. Gallery-dl's documentation did not help me, and I also tried to find information from the source code.
-
Thumbnail
I use https://github.com/mikf/gallery-dl
-
What is the best way to get images for a dataset
You can try image scraping with something like gallery-dl or grabber. I use grabber for stuff off of booru style sites (anime weeb shit), and grabber for everything else. The challenge with these tools is:
What are some alternatives?
UltimaScraper - Scrape content from OnlyFans and Fansly
instaloader - Download pictures (or videos) along with their captions and other metadata from Instagram.
youtube-dl - Command-line program to download videos from YouTube.com and other video sites
RedditDownloader - Scrapes Reddit to download media of your choice.
bdfr-html - Converts the output of the bulk downloader for reddit to a set of HTML pages.
imgbrd-grabber - Very customizable imageboard/booru downloader with powerful filenaming features.
redditDataExtractor - The reddit Data Extractor is a cross-platform GUI tool for downloading almost any content posted to reddit. Downloads from specific users, specific subreddits, users by subreddit, and with filters on the content is supported. Some intelligence is built in to attempt to avoid downloading duplicate external content.
twitter_scraping - Grab all a user's tweets (and get past 3200 limit)
reddit-save - A Python tool for backing up your saved and upvoted posts on reddit to your computer.
hakuneko - Manga & Anime Downloader for Linux, Windows & MacOS
SCrawler - 🏳️🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.
ripme - Downloads albums in bulk