An orchestration platform for the development, production, and observation of data assets.
If you want to schedule your ETL, you can do something basic using Windows Task Scheduler or use something fancy like a Python orchestration library like dagster. Dagster works on Windows OS which is probably your best bet as most/all other orchestration libraries wiith a scheduler dont work on Windows.
Download talent.io’s Tech Salary Report. Median salaries, most in-demand technologies, state of the remote work... all you need to know your worth on the market by tech recruitment platform talent.io
Thinking of making a switch from actuarial science to data engineering
1 project | reddit.com/r/dataengineering | 15 Apr 2022
Developing in Dagster
2 projects | dev.to | 25 Mar 2022
Am I learning DE in a too roundabout way?
1 project | reddit.com/r/dataengineering | 24 Jan 2022
What is this kind of texture called?
1 project | reddit.com/r/Design | 19 Dec 2021
Airflow 2.0 vs Prefect
1 project | reddit.com/r/dataengineering | 20 Oct 2021