Our great sponsors
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
If Airflow is the way to go then try DockerOperators (https://github.com/apache/airflow/blob/main/airflow/providers/docker/example_dags/example_docker.py). It's not the easiest set up but will do what you from what I get from your question.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Building in Public: Leveraging Tublian's AI Copilot for My Open Source Contributions
- Navigating Week Two: Insights and Experiences from My Tublian Internship Journey
- Best ETL Tools And Why To Choose
- Simplifying Data Transformation in Redshift: An Approach with DBT and Airflow
- Share Your favorite python related software!