Am I learning DE in a too roundabout way?

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/dataengineering

Our great sponsors
  • Scout APM - Truly a developer’s best friend
  • SonarQube - Static code analysis for 29 languages.
  • talent.io - Download talent.io’s Tech Salary Report
  • InfluxDB - Build time-series-based applications quickly and at scale.
  • dagster

    An orchestration platform for the development, production, and observation of data assets.

    This is probably a bit early in your journey but I recommend Dagster . Its much like airflow but better in my opinion and doesnt require Docker setups to install and run which is very handy. But like I said its probably a bit early if you're not yet comfortable with Python. In the interim regarding automation i'd say go to basics and build from there, so say you've got a working script that downloads data and updates a table, just set up a Task scheduler job if you're on windows , cron if otherwise. Thats already step 1 in automation.

  • Scout APM

    Truly a developer’s best friend. Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts