twitter_scraping
gallery-dl
| twitter_scraping | gallery-dl | |
|---|---|---|
| 1 | 187 | |
| 583 | - | |
| - | - | |
| 10.0 | - | |
| almost 4 years ago | - | |
| Python | ||
| - | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
twitter_scraping
gallery-dl
- Open Source Instagram Scraper?
-
How to download all tweets of other accounts?
If you want to grab all the images and videos take a look at gallery-dl, found here https://github.com/mikf/gallery-dl
-
Can someone help me with gallery-dl (i am halfway there)
My question is about the docs. Here is the link to gallery-dl on github. from what i see it's kept up-to-date. I'm trying to download a post from ig through any method. Also thinking of creating a configuration-file if necessary. My OS: windows 10, i have worked with a cli before but on linux and my knowledge is very superficial. I have managed to use this tool on other websites like pinterest but can't think of any solutions for instagram as of now. The errors i get are about using the authentication method and when trying to set the cookies-from-browser option.
-
Gothub: Alternative front-end for GitHub written with Go
I could set up a redirect to the '/raw/' pages but then the syntax highlighting is gone.
The same page is perfectly viewable over plain html on gothub[2] though.
Github also seems to be hiding their "Assets" (binaries et al) on the "/releases" page for some projects behind javascript(especially older versions).[3] Something else that wasn't the case about ~1.5 years ago.
Would be great if gothub could unshackle the links to those as well[4], but that appears to not be working at the moment[5] .
This project appears to be a more performant(measurably so), more privacy friendly(as Microsoft won't have a record of your interest in certain projects) alternative front-end for "non logged in" github users.
I like it, but it still needs work.
[1] https://github.com/mackyle/sqlite/blob/18cf47156abe94255ae14...
[2] https://gh.bloatcat.tk/mackyle/sqlite/blob/18cf47156abe94255...
[3] https://github.com/mikf/gallery-dl/releases
[4] https://gh.bloatcat.tk/mikf/gallery-dl/releases
[5] https://codeberg.org/gothub/gothub/issues/74
-
I don't publish to Instagram but I want to follow the posts of people that are only on that network. What are my options?
since it's primarily a picture/video platform, you can use gallery-dl to scrape the feeds you want to follow if you provide authentication, and you should be able to write the captions and stuff to metadata files, but not sure how you'd display it in a useful way.
-
How to download TikTok slideshow pics?
you could use gallery-dl to do this as well.
-
If I have a subscription to a paid adult site that allows subscribers to download all galleries and videos at full resolution, etc, what's the best way to rip the entire site? Any thoughts appreciated. Thanks.
gallery-dl (CLI based) focuses on images.
-
Gallery-dl (custom folder configs, reddit "galleries" and archive-format)
Maybe there is a way to set specific configs only for reddit gallery images, but I'm not sure how it works. Gallery-dl's documentation did not help me, and I also tried to find information from the source code.
-
Thumbnail
I use https://github.com/mikf/gallery-dl
-
What is the best way to get images for a dataset
You can try image scraping with something like gallery-dl or grabber. I use grabber for stuff off of booru style sites (anime weeb shit), and grabber for everything else. The challenge with these tools is:
What are some alternatives?
twMediaDownloader - Download images of user's media-timeline on Twitter.
instaloader - Download pictures (or videos) along with their captions and other metadata from Instagram.
ripme - Downloads albums in bulk
bulk-downloader-for-reddit - Downloads and archives content from reddit
Scweet - A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
RedditDownloader - Scrapes Reddit to download media of your choice.
TWINT - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
imgbrd-grabber - Very customizable imageboard/booru downloader with powerful filenaming features.
hakuneko - Manga & Anime Downloader for Linux, Windows & MacOS
yt-dlp - A feature-rich command-line audio/video downloader
media-downloader - Media Downloader is a Qt/C++ front end to yt-dlp, youtube-dl, gallery-dl, lux, you-get, svtplay-dl, aria2c, wget and safari books..