-
airflow-docker
Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j) (by coder2j)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
You can watch my Apache Airflow for Beginner Tutorial Series playlist on YouTube. If you think it is helpful, consider subscribing to my youtube channel and star my GitHub repository. Comment what topics you want to see or discuss about Airflow in the next episode.
I recommend using Ploomber which can help you build once and automate a lot of the work, and it works with python natively. It's open source so you can start with one of the examples, like the ML-basic example or the ETL one. It'll allow you to define the pipeline and then easily explain the flow with the DAG plot. Feel free to ask questions, I'm happy to help (I've built 100s of data pipelines over the years).
I recommend using Ploomber which can help you build once and automate a lot of the work, and it works with python natively. It's open source so you can start with one of the examples, like the ML-basic example or the ETL one. It'll allow you to define the pipeline and then easily explain the flow with the DAG plot. Feel free to ask questions, I'm happy to help (I've built 100s of data pipelines over the years).
Related posts
-
The Unbundling of Airflow
-
Show HN: JupySQL – a SQL client for Jupyter (ipython-SQL successor)
-
New to large SW projects in Python, best practices to organize code
-
A three-part series on deploying a Data Science Platform on AWS
-
Ploomber Cloud - Parametrizing and running notebooks in the cloud in parallel