Airflow for Data Ingestion

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
data-cleaning data-preparation Machine Learning Artificial intelligence Data

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • Mage

    🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai

    • You can have Airflow orchestrate this or use an open-source tool like Mage to run Singer taps and targets for you.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Need Suggestion for transformation tool

    1 project | /r/dataengineering | 21 Dec 2022

  • Updating dbt Cloud pricing to support long-term community growth 50$->100$

    1 project | /r/dataengineering | 16 Dec 2022

  • Show HN: Mage, Fivetran alternative for ELT and data integrations

    2 projects | news.ycombinator.com | 22 Nov 2022

  • El tool for a growing startup Dec 22 edition!

    1 project | /r/dataengineering | 20 Nov 2022

  • How to deploy my pipelines…

    1 project | /r/dataengineering | 16 Nov 2022