Python Dag

Open-source Python projects categorized as Dag

Top 9 Python Dag Projects

  • Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  • Project mention: 10 Open Source Tools for Building MLOps Pipelines | dev.to | 2024-06-06

    An integral part of an ML project is data acquisition and data transformation into the required format. This involves creating ETL (extract, transform, load) pipelines and running them periodically. Airflow is an open source platform that helps engineers create and manage complex data pipelines. Furthermore, the support for Python programming language makes it easy for ML teams to adopt Airflow.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • pgmpy

    Python Library for learning (Structure and Parameter), inference (Probabilistic and Causal), and simulations in Bayesian Networks.

  • airflow-maintenance-dags

    A series of DAGs/Workflows to help maintain the operation of Airflow

  • Data Flow Facilitator for Machine Learning (dffml)

    The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.

  • hathor-core

    Hathor core is the official and reference client for operating a full node in Hathor Network.

  • Project mention: Cryptocurrency News: Hathor Releases v0.57.0 · HathorNetwork/hathor-core | /r/WallstreetVR | 2023-11-07
  • breaking_cycles_in_noisy_hierarchies

    breaking cycles in noisy hierarchies

  • Project mention: Elo for VCS – Founder's Choice | news.ycombinator.com | 2023-07-12

    I think that's a pretty good idea. Have you checked out the paper "Breaking Cycles in Noisy Hierarchies"? It looks pretty similar to what you're looking for and the code is open source: https://github.com/zhenv5/breaking_cycles_in_noisy_hierarchi...

  • tawazi

    A DAG Scheduler library written in pure python

  • Project mention: Ask HN: Who wants to be hired? (June 2024) | news.ycombinator.com | 2024-06-03

    Email: [email protected]

    I’m currently working as a Software Engineer, with a focus on performance and speed for deep learning models in production. I'm one of the maintainers of https://github.com/mindee/tawazi, and I'm heavily interested in low level, reverse engineering as well as open source. Two of my current projects are a cython header generator written in python based on Lex/Yacc (https://github.com/MattCrmx/cyheadgen/) and a file descriptor leak monitoring (https://github.com/MattCrmx/fd-watcher/)

    If your company matches one or more of these interests, I'll be happy to hear about it !

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • pyDag

    Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag

  • magnus-core

    Core package of magnus

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Dag discussion

Log in or Post with

Python Dag related posts

  • FLaNK AI Weekly 25 March 2025

    30 projects | dev.to | 25 Mar 2024
  • Cryptocurrency News: Hathor Releases v0.57.0 · HathorNetwork/hathor-core

    1 project | /r/WallstreetVR | 7 Nov 2023
  • Cryptocurrency News: Hathor Releases v0.57.0 · HathorNetwork/hathor-core

    1 project | /r/HathorNetwork | 6 Nov 2023
  • Show HN: On Garbage Collection and Memory Optimization in Hamilton

    1 project | news.ycombinator.com | 24 Oct 2023
  • GitHub - Qiskit/rustworkx: A high performance Python graph library implemented in Rust.

    1 project | /r/Python | 26 Sep 2023
  • Show HN: Declarative Spark Transformations with Hamilton

    1 project | news.ycombinator.com | 24 Aug 2023
  • rustworkx: A High-Performance Graph Library for Python

    1 project | news.ycombinator.com | 22 Aug 2023
  • A note from our sponsor - Scout Monitoring
    www.scoutapm.com | 17 Jun 2024
    Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today. Learn more →

Index

What are some of the best open-source Dag projects in Python? This list will help you:

Project Stars
1 Airflow 35,036
2 pgmpy 2,636
3 airflow-maintenance-dags 1,616
4 Data Flow Facilitator for Machine Learning (dffml) 244
5 hathor-core 82
6 breaking_cycles_in_noisy_hierarchies 71
7 tawazi 66
8 pyDag 24
9 magnus-core 13

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com