Python dags

Open-source Python projects categorized as dags
Edit details
Topics: Python Airflow apache-airflow Data Analysis ETL
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 3 Python dag Projects

  • burr

    Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.

    • Project mention: Building an Email Assistant Application with Burr | dev.to | 2024-04-26

    Burr is a lightweight python library you use to build applications as state machines. You construct your application out of a series of actions (these can be either decorated functions or objects), which declare inputs from state, as well as inputs from the user. These specify custom logic (delegating to any framework), as well as instructions on how to update state. State is immutable, which allows you to inspect it at any given point. Burr handles orchestration, monitoring and persistence.

  • astro-sdk

    Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

    • Project mention: Orchestration: Thoughts on Dagster, Airflow and Prefect? | /r/dataengineering | 2023-06-01

    Have you tried the Astro SDK? https://github.com/astronomer/astro-sdk

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • airflowctl

    A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects

    • Project mention: A look at airflowctl, a tool to help developers manage Apache Airflow projects | dev.to | 2023-08-14

    NOTE! I found a small issue in that when you run in background mode, it creates a file (.airflowctl/.background_process_ids) which contains the parent PID. The PID was always off, so I needed to manually edit this. I have created an issue here so if this happens to you, follow that.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python dags related posts

  • Show HN: Burr: An OS Framework for Building and Debugging GenAI Apps Faster

    2 projects | news.ycombinator.com | 3 Apr 2024

Index

What are some of the best open-source dag projects in Python? This list will help you:

Project Stars
1 burr 436
2 astro-sdk 317
3 airflowctl 169

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com