Looking for open source projects that use data pipelines and big data flows

1. meltano

   1 10 - -

   I know really sure if this is what are you looking for, but take a look at Meltano

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. pipelinewise

   2 5 648 6.7 Python

   Data Pipeline Framework using the singer.io spec

   

4. nifi

   3 37 5,326 9.8 Java

   Apache NiFi

   

   apache nifi is a good match for what you are trying to find I think. It's also opensource so you can contribute as well.

5. Logstash

   4 5 14,489 9.7 Java

   Logstash - transport and process your logs, events, or other data

   

   Is logstash the kind of project you are looking for? https://github.com/elastic/logstash

6. jet-train

   5 4 14 0.0 Kotlin

   

7. electricitymaps-contrib

   6 66 3,826 9.9 Python

   The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption

   

8. grouparoo

   7 27 607 9.9 JavaScript

   Discontinued 🦘 The Grouparoo Monorepo - open source customer data sync framework

   

   The product I'm working on called Grouparoo might be a good fit: https://github.com/grouparoo/grouparoo

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

Suggest a related project