Tools that allow you to use scripts to build/maintain data pipeline

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
database-connector pipe-data data-engineering

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • Meerschaum

    Create and manage data pipes with Meerschaum.

    • You can prototype some scripts with a tool called Meerschaum that I built for this kind of purpose. Once you're ready to deploy your prototype, you could refactor it for something more suited for enterprise like Airflow.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Found a great new open source ELT Library - any pointers?

    2 projects | /r/dataengineering | 11 Jun 2023

  • I’m struggling with how to ask for help with my task.

    1 project | /r/dataengineering | 26 Mar 2023

  • For those of you who were self taught, what was your path into data engineering

    1 project | /r/dataengineering | 19 Mar 2023

  • Wanted to share my open source incremental ETL framework: Meerschaum

    1 project | /r/dataengineering | 2 Sep 2022

  • Python ETL - Jupyter/Pandas/Postgresql(DW) - Project Structure and Scripting

    1 project | /r/ETL | 23 Jun 2022