gallery-dl
PixivUtil2
Our great sponsors
gallery-dl | PixivUtil2 | |
---|---|---|
187 | 10 | |
- | 2,271 | |
- | - | |
- | 5.9 | |
- | about 1 month ago | |
Python | ||
GNU General Public License v3.0 only | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gallery-dl
- Open Source Instagram Scraper?
-
How to download all tweets of other accounts?
If you want to grab all the images and videos take a look at gallery-dl, found here https://github.com/mikf/gallery-dl
-
Can someone help me with gallery-dl (i am halfway there)
My question is about the docs. Here is the link to gallery-dl on github. from what i see it's kept up-to-date. I'm trying to download a post from ig through any method. Also thinking of creating a configuration-file if necessary. My OS: windows 10, i have worked with a cli before but on linux and my knowledge is very superficial. I have managed to use this tool on other websites like pinterest but can't think of any solutions for instagram as of now. The errors i get are about using the authentication method and when trying to set the cookies-from-browser option.
-
Gothub: Alternative front-end for GitHub written with Go
I could set up a redirect to the '/raw/' pages but then the syntax highlighting is gone.
The same page is perfectly viewable over plain html on gothub[2] though.
Github also seems to be hiding their "Assets" (binaries et al) on the "/releases" page for some projects behind javascript(especially older versions).[3] Something else that wasn't the case about ~1.5 years ago.
Would be great if gothub could unshackle the links to those as well[4], but that appears to not be working at the moment[5] .
This project appears to be a more performant(measurably so), more privacy friendly(as Microsoft won't have a record of your interest in certain projects) alternative front-end for "non logged in" github users.
I like it, but it still needs work.
[1] https://github.com/mackyle/sqlite/blob/18cf47156abe94255ae14...
[2] https://gh.bloatcat.tk/mackyle/sqlite/blob/18cf47156abe94255...
[3] https://github.com/mikf/gallery-dl/releases
[4] https://gh.bloatcat.tk/mikf/gallery-dl/releases
[5] https://codeberg.org/gothub/gothub/issues/74
-
I don't publish to Instagram but I want to follow the posts of people that are only on that network. What are my options?
since it's primarily a picture/video platform, you can use gallery-dl to scrape the feeds you want to follow if you provide authentication, and you should be able to write the captions and stuff to metadata files, but not sure how you'd display it in a useful way.
-
How to download TikTok slideshow pics?
you could use gallery-dl to do this as well.
-
If I have a subscription to a paid adult site that allows subscribers to download all galleries and videos at full resolution, etc, what's the best way to rip the entire site? Any thoughts appreciated. Thanks.
gallery-dl (CLI based) focuses on images.
-
Gallery-dl (custom folder configs, reddit "galleries" and archive-format)
Maybe there is a way to set specific configs only for reddit gallery images, but I'm not sure how it works. Gallery-dl's documentation did not help me, and I also tried to find information from the source code.
-
Thumbnail
I use https://github.com/mikf/gallery-dl
-
What is the best way to get images for a dataset
You can try image scraping with something like gallery-dl or grabber. I use grabber for stuff off of booru style sites (anime weeb shit), and grabber for everything else. The challenge with these tools is:
PixivUtil2
-
Any pixiv scraper that can target my follow list or list of users?
I had the same problem, worked using cookies to log in https://github.com/Nandaka/PixivUtil2/wiki
-
Pixiv looks to be wiping a lot of content soon, what's the best way to go about creating a site rip or backup?
Pixiv-Util2
-
VERY slow loading :/
you can use this useful software
-
Is it wrong or illegal or whatever I call it to make A LOT of requests to a specific website?
That said, it's worth noting that there's already some tools available that can download Pixiv images in bulk. I personally use PixivUtil2 to do it, and I know gallery-dl supports it as well. Both take Pixiv's rate limits into account when downloading images so you should have no problems with them at all.
-
Pixiv / Danbooru tag downloader?
This post points to Nandaka, which I've used in the past. https://www.reddit.com/r/DataHoarder/comments/kmn7vj/good_downloader_for_pixiv_accounts. https://github.com/Nandaka/PixivUtil2
-
Help.
https://github.com/Nandaka/PixivUtil2 I think most of you know this link and have probably seen this question multiple times. But the replies on the posts are not available currently when I checked. So, please can anyone tell me how to set this up. Thanks in advance.
-
Booru/Pixiv gallery hoarding
I downloaded all of them via this program. Nandaka (the pixiv guy) also has nijie downloader if you want it but I've never gotten it to work.
-
I need a bit of help
just use PixivUtil2 instead. The configuration might be a pain in the arse (especially to a n00bie) but if you persevere you'll save a lot of time. I'm a heavy user so usually, I'll just run a few instances of it over the night and when it's done it's done. I do not see a need to struggle with the web app.
- Good downloader for Pixiv accounts?
What are some alternatives?
instaloader - Download pictures (or videos) along with their captions and other metadata from Instagram.
imgbrd-grabber - Very customizable imageboard/booru downloader with powerful filenaming features.
bulk-downloader-for-reddit - Downloads and archives content from reddit
hydrus - A personal booru-style media tagger that can import files and tags from your hard drive and popular websites. Content can be shared with other users via user-run servers.
RedditDownloader - Scrapes Reddit to download media of your choice.
ripme - Downloads albums in bulk
pixiv-omina - Pixiv Omina is a software for downloading artworks and comics from Pixiv and Pixiv Comic
twitter_scraping - Grab all a user's tweets (and get past 3200 limit)
hakuneko - Manga & Anime Downloader for Linux, Windows & MacOS
yt-dlp - A feature-rich command-line audio/video downloader