twitterscraper VS TweetScraper

As for self-contained tools, https://github.com/taspinar/twitterscraper is a great little python tool that can help with tweet downloading. It's not quite as powerful and I haven't used it in some time so I'm not sure if it still works with the twitter changes, but definitely worth a shot.

Twitter data tends to get gigantic, and coupled with the one-week-limit of their API it is tricky to acquire suitable historic data. The API actually allows searches further in the past, e.g. https://twitter.com/search?lang=en&q=(%23metoo)%20until%3A2020-01-01%20since%3A2019-01-01&src=typed_query%20until%3A2020-01-01%20since%3A2019-01-01&src=typed_query) But that will not give you the tweets in a form suitable for processing. Tools like TwitterScraper attempt to do this automatically, but Twitter has gotten more strict in its rate limits, and in my experience it basically does not work any more.

try https://github.com/jonbakerfish/TweetScraper or https://github.com/mahrtayyab/tweety for python

I'm personally I huge fan of https://github.com/jonbakerfish/TweetScraper on GitHub. It's a Go library that allows you to easily scrape tweets. It unfortunately does require programming knowledge of Go. I've used it for a small "download to json + media" folder program and it worked great for that. Planning on implementing it more on my bigger social media self hosting project I'm working on, but it's a fantastic library if you know programming.

https://github.com/evanc577/tweet-scraper The technique is largely adapted from TweetScraper but instead of saving to a directory, results are outputted to stdout as json.