-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I have a few e2e projects, if that might help. While they can be deployed to AWS via the included terraform file (costs money) you can run them locally with docker. I list the projects from simplest to more complicated 1. I’d recommend starting at https://www.startdataengineering.com/post/data-engineering-project-to-impress-hiring-managers/ this is the simplest. 2. Once you have it running, and get an overview of the components( docker, ec2, Postgres), then I’d recommend looking at this article https://www.startdataengineering.com/post/data-engineering-projects-with-free-template/ to understand how the components work together. 3. Try out the pipeline with a data source if your choosing. I use https://github.com/public-api-lists/public-api-lists to get some data API. 4. Once you get a good understanding of how data is pulled and loaded along with how it’s scheduled, then I’d recommend looking at this airflow project https://www.startdataengineering.com/post/data-engineering-project-for-beginners-batch-edition/ I posted about this a while back https://www.reddit.com/r/dataengineering/comments/ygieh8/data\_engineering\_projects\_with\_template\_airflow/ Hope this helps. LMK if you have any questions.