Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work. Learn more →
Top 8 Python apache-airflow Projects
-
Project mention: Unable to login into airflow webserver account | reddit.com/r/apache_airflow | 2023-05-18
It turns out the credentials work when I run 'airflow webserver -d -p 8080' in the terminal. It took a google search on how to terminate the existing airflow webpage.
-
-
ONLYOFFICE
ONLYOFFICE Docs — document collaboration in your environment. Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises
-
Use these maintenance DAGs from the project https://github.com/teamclairvoyant/airflow-maintenance-dags
-
ethereum-etl-airflow
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
Project mention: ethereum-etl-airflow: NEW Data - star count:299.0 | reddit.com/r/algoprojects | 2022-10-22 -
astro-sdk
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
I think you should take a look at the Astro SDK It’s an open source python package that removes the complexity of writing DAGs , particularly in the context of Extract, Load, Transform (ELT) use cases. Look at the doc here, especially aql.transform, aql.run_raw_sql, etc. That will definitely help you
-
-
astronomer-cosmos
Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code
Project mention: Run dbt projects as Apache Airflow DAGs and Task Groups with a few lines of code | news.ycombinator.com | 2023-05-01 -
CodiumAI
TestGPT | Generating meaningful tests for busy devs. Get non-trivial tests (and trivial, too!) suggested right inside your IDE, so you can code smart, create more value, and stay confident when you push.
-
covid-19-data-engineering-pipeline
A Covid-19 data pipeline on AWS featuring PySpark/Glue, Docker, Great Expectations, Airflow, and Redshift, templated in CloudFormation and CDK, deployable via Github Actions.
Project mention: COVID-19 data pipeline on AWS feat. Glue/PySpark, Docker, Great Expectations, Airflow, and Redshift, templated in CF/CDK, deployable via Github Actions | reddit.com/r/dataengineering | 2023-04-03I've seen amazing projects here already, which honestly were a great inspiration, and today I would like to show you my project. Some time ago, I had the idea to apply every tool I wanted to learn or try out to the same topic and since then this idea has grown into an entire pipeline: https://github.com/moritzkoerber/covid-19-data-engineering-pipeline
Python apache-airflow related posts
- Unable to login into airflow webserver account
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
- Run dbt projects as Apache Airflow DAGs and Task Groups with a few lines of code
- We all have tough days at the office... so why can't data logos? :)
- My experience with optimizing machine learning workflow
- Running dbt core on airflow
- Working with Managed Workflows for Apache Airflow (MWAA) and Amazon Redshift
-
A note from our sponsor - Sonar
www.sonarsource.com | 27 May 2023
Index
What are some of the best open-source apache-airflow projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | Airflow | 30,323 |
2 | elyra | 1,599 |
3 | airflow-maintenance-dags | 1,450 |
4 | ethereum-etl-airflow | 348 |
5 | astro-sdk | 260 |
6 | airflow-chart | 249 |
7 | astronomer-cosmos | 127 |
8 | covid-19-data-engineering-pipeline | 16 |