Tips for building popular open source data engineering projects

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • chispa

    PySpark test helper methods with beautiful error messages

  • Blogging has been the main way I've been able to attract users. Someone searches "testing PySpark", they see this blog, and then they're motivated to try chispa.

  • itachi

    A library that brings useful functions from various modern database management systems to Apache Spark

  • Feel free to ping me if you'd like me to help vet your ideas or market them. I'm happy to write blog posts and try to help you get users (some ppl hate blogging). itachi is an example of a genius project that I'm helping Kent market (he's a Spark PMC). The project is genius and it just needs exposure to get users.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts