Data Pipelines explained with Airflow

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • data-engineering-nd

    Projects of the Udacity Data Engineering Nanodegree Program.

  • In the following lines I am doing a write-up about everything I learned about data pipelines at the Udacity online class. It gives a general overview about data pipelines and provides also the core concepts of Airflow and some links to code examples on github.

  • Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  • Like for operators we also can create custom hooks. Before creating a new plugin you might want to check Airflow contrib to see if there was already a plugin created by community members for your needs. If not you can build one and contribute it to the community.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Building in Public: Leveraging Tublian's AI Copilot for My Open Source Contributions

    1 project | dev.to | 12 Feb 2024
  • Navigating Week Two: Insights and Experiences from My Tublian Internship Journey

    1 project | dev.to | 31 Dec 2023
  • Airflow VS quix-streams - a user suggested alternative

    2 projects | 7 Dec 2023
  • Best ETL Tools And Why To Choose

    1 project | /r/tactionsoftware | 11 Nov 2023
  • Simplifying Data Transformation in Redshift: An Approach with DBT and Airflow

    2 projects | dev.to | 7 Nov 2023