Reddit and Twitter downloader

This page summarizes the projects mentioned and recommended in the original post on /r/DataHoarder

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • SCrawler

    🏳️‍🌈 Media downloader from any sites, including Twitter, Reddit, Instagram, Threads, Facebook, OnlyFans, YouTube, Pinterest, PornHub, XHamster, XVIDEOS, ThisVid etc.

  • ripme

    Downloads albums in bulk

  • Any of these: ripme, wfdownloader, gallery-dl would also work on twitter.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Any of these: ripme, wfdownloader, gallery-dl would also work on twitter.

  • timesearch

    The subreddit archiver

  • Here you go. I have used this to archive hundreds of subreddits in their entity, even bypassing the 1000 limit.

  • murder

    Large scale server deploys using BitTorrent and the BitTornado library (by ervinb)

  • URL = u'https://twitter.com/{username}'.format(username=username) request = requests.get(URL) page_source = request.text soup = BeautifulSoup(page_source, 'lxml') code_tweets_content = soup('p', {'class': 'js-tweet-text'}) code_tweets_time = soup('span', {'class': '_timestamp'}) code_tweets_ID = soup('a', {'tweet-timestamp'})

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts