Why is it so hard to think of a DE side project idea ?

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering
Python Docker data-engineering

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • ziply-dsl-monitor

    My DSL was severely broken...so I graphed it.

    • - Data to dashboards. I was recently having a problem with my DSL connection, so I built a dashboard that scraped data from my DSL modem, combined it with weather data and built a Grafana dashboard. https://github.com/dacort/ziply-dsl-monitor Will anybody find that useful? Probably not, but it's a pretty neat project and taught me a lot about Grafana.

  • cargo-crates

    An easy way to build data extractors in Docker.

    • - Extract data from system. I wear an Oura ring for sleep tracking. I wanted to do my own analysis of the data, so I built a system that could easily allow me to extract the data into S3 so I could query it. https://github.com/dacort/cargo-crates Will anybody find that useful? Maybe...but it's been a heck of a lot of fun and really pushed my Docker skills.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • damons-data-lake

    All the code related to building my own data lake

    • Glad you found it helpful! And yes! I love quantified self type data. I did something similar a few years back where I gathered my inbox unread count, open Chrome and iTerm tab count, and even how many times I copy/pasted in a day and uploaded it all to S3 via Kinesis for a demo. It was a ton of fun - feel free to peek at it! https://github.com/dacort/damons-data-lake

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts