snscrape
Socialhome
Our great sponsors
snscrape | Socialhome | |
---|---|---|
29 | 3 | |
4,185 | 352 | |
- | - | |
7.3 | 8.1 | |
4 months ago | about 1 month ago | |
Python | Python | |
GNU General Public License v3.0 only | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
snscrape
- API to scrape tweets
-
Twitter scraping for complete profiles (very large data sets)?
Try Snscrape.
- snscrape getting blocked from twitter
- [Project]Topic modelling of tweets from the same user
- Show HN: Twitter API Reverse Engineered
-
Recommend tool other than Maltego ?
If you're looking for small, standalone tools, you can have a look at tools like snscrape (https://github.com/JustAnotherArchivist/snscrape) and WhatsMyName (https://github.com/WebBreacher/WhatsMyName).
- Anyone familiar with the open-source Twitter API alternative Twint?
-
import requests
snscrape is a great program for scraping social media
-
“Starting February 9, we will no longer support free access to the Twitter API”
I've been using this https://github.com/JustAnotherArchivist/snscrape and with 5 threads and no vpn just my laptop and getting about 1 million tweets a day (vs 1000 before being rate limited on the api).
-
Twitter archiver: Make your own simple, public, searchable Twitter archive
I hope you’ll get a better answer, but a minimal solution is to use snscrape (https://github.com/JustAnotherArchivist/snscrape) to download a raw JSON dump of a user timeline. Some caveats: 1. This doesn’t work for all users (e.g. some accounts seem to remain deindexed after unsuspensions). 2. While you can get rid of 90% of the file size by removing fluff columns (e.g. related to processing media and emojis), keep a backup. When importing such JSON, I unwittingly did a lossy data type conversion, and it can be irreparable once the tweets are deleted.
$ snscrape --progress --jsonl twitter-user jack > jack.json
Socialhome
-
Mastodon – A Federated Twitter Alternative
That's what it is tho. You create a time-line filter that shows only posts containing those hashtags - is that not a subscription?
There are also more literal implementations for this like SocialHome [1] where you can click + on hashtags you like and public post with them appear in your home timeline
-
Facebook Censored Me for Mentioning Open-Source Social Network Mastodon
* in case of a mute, it could also be not wanting their federated timeline to be flooded with primarily mastodon.social posts
Lack of federation between these instances and mastodon.social could be a reason not to pick mastodon.social. (Similar situation applies to mastodon.online btw, which is a spin-off server of m.s.)
Another reason to pick a different instance could be not wanting to use mainline Mastodon software. For example because you want to run your own instance on limited hardware (Mastodon can get a bit resource intensive), don't like Ruby, miss certain features, don't like the front-end (though alternative external front-ends to Mastodon do exist), or some other reason.
Personally I am on an instance that runs [Mastodon Glitch Edition, also known as Glitch-Soc](https://glitch-soc.github.io/docs/), which is a compatible fork of Mastodon which implements a bunch of nice features such as increased post character count (Mastodon defaults to 500 characters per post, Glitch-Soc supports increasing this in the server settings), Markdown support (though only instances that also support HTML-formatted posts will see your formatting; mainline Mastodon servers will serve a stripped down version of your post instead), and improved support for filters / content warnings / toot collapsing, optional warnings when posting uncaptioned media, and other additional features.
Another alternative Mastodon fork is [Hometown](https://github.com/hometown-fork/hometown) which focuses more on the local timeline (showing posts only from your own instance) with the addition of local-only posts, to nurture a tighter knit community.
Aside from Mastodon there are other implementations of ActivityPub which can still federate with Mastodon instances, such as [Misskey](https://github.com/misskey-dev/misskey), [diaspora*](https://diasporafoundation.org/) (which AFAIK inspired Google Plus back in the day), [Hubzilla](https://hubzilla.org//page/hubzilla/hubzilla-project), [Peertube](https://joinpeertube.org/) (focused on peer-to-peer video distribution), [Friendica](https://friendi.ca/), [Pleroma](https://pleroma.social/), [Socialhome](https://socialhome.network/), [GoToSocial](https://github.com/superseriousbusiness/gotosocial), [Pixelfed](https://pixelfed.org/) (which started as a sort of federated Instagram alternative) and more. [Fediverse.party](https://fediverse.party/) is a nice way to discover various protocols that make up the bigger Fediverse.
What are some alternatives?
facebook_page_scraper - Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
TWINT - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
instagram_hunter - Instagram-Hunter is a simple tool that helps you find instagram accounts.
reddit-detective - Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more
Friendica - Friendica Communications Platform
FluxBB - FluxBB is a fast, light, user-friendly forum application for your website.
Mastodon - Your self-hosted, globally interconnected microblogging community
Symphony
Isso - a Disqus alternative
webtoondl - Python webcomics scraper
diaspora* - A privacy-aware, distributed, open source social network.
privalise - Social Media Network Focuses On Data Security And Being Community Driven Web App