Our great sponsors
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
This is probably a bit early in your journey but I recommend Dagster . Its much like airflow but better in my opinion and doesnt require Docker setups to install and run which is very handy. But like I said its probably a bit early if you're not yet comfortable with Python. In the interim regarding automation i'd say go to basics and build from there, so say you've got a working script that downloads data and updates a table, just set up a Task scheduler job if you're on windows , cron if otherwise. Thats already step 1 in automation.