Twitter Analytics and data storage via API - some help needed

This page summarizes the projects mentioned and recommended in the original post on /r/datasets

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • twarc

    A command line tool (and Python library) for archiving Twitter JSON

    Depending on the rigor you need out of this, a simple process like running twarc against your list of Twitter handles or IDs on a set interval may be sufficient. Then just process the output into whichever database you want it in. For my own process I run a custom scraper based on tweepy, but I'm ingesting around 80M tweets per month. This is all well within the API limits set out by Twitter, using just 1 account.

  • Tweepy

    Twitter for Python!

    Depending on the rigor you need out of this, a simple process like running twarc against your list of Twitter handles or IDs on a set interval may be sufficient. Then just process the output into whichever database you want it in. For my own process I run a custom scraper based on tweepy, but I'm ingesting around 80M tweets per month. This is all well within the API limits set out by Twitter, using just 1 account.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts