Script to find overlapping users between subreddits from dump files

This page summarizes the projects mentioned and recommended in the original post on /r/pushshift

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • Sketchpad

  • A while back I wrote a fairly popular script that used the pushshift api to find overlapping users between subreddits. This doesn't work anymore since the api is down, so I threw together an updated script that does the same thing using the subreddit dump files.

  • PushshiftDumps

    Example scripts for the pushshift dump files

  • You can go through the process outlined in that thread to download the subreddit's you're interested in, then add them at the top of the new script, run it and it will output the list of overlapping users. It will actually likely be faster than the old script even counting download times for the dumps since the api was so slow. Though you are limited to the available 20k subreddits.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • A Convenient Ensembled Perplexity API

    1 project | news.ycombinator.com | 2 May 2024
  • My first code as a beginner!!

    1 project | dev.to | 2 May 2024
  • NPi – An Open Source project for enhancing AI Agents in taking action

    4 projects | news.ycombinator.com | 2 May 2024
  • Recapping the AI, Machine Learning and Data Science Meetup — May 2, 2024

    2 projects | dev.to | 2 May 2024
  • THOR: Tracklet-Less Heliocentric Orbit Recovery

    1 project | news.ycombinator.com | 2 May 2024