data-engineer-roadmap VS awesome-opensource-data-engineering

Compare data-engineer-roadmap vs awesome-opensource-data-engineering and see what are their differences.

data-engineer-roadmap

Roadmap to becoming a data engineer in 2021 (by datastacktv)

awesome-opensource-data-engineering

An Awesome List of Open-Source Data Engineering Projects (by gunnarmorling)
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
data-engineer-roadmap awesome-opensource-data-engineering
68 3
11,789 1,448
0.0% -
0.0 4.7
about 2 years ago about 1 month ago
- GNU General Public License v3.0 or later
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

data-engineer-roadmap

Posts with mentions or reviews of data-engineer-roadmap. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-30.
  • Pitanje za data engineering?
    4 projects | /r/programiranje | 30 Jun 2023
  • How should I start learning/implementing DevOps in data engineering projects?
    2 projects | /r/dataengineering | 22 May 2023
    In DevOps tools I've worked with GitHub + Jenkins, GitLab + k8s, and I'm now primarily working in the Argo Stack. Depending on where you're at technically, you might use something different. IaC is a ust as well, maybe some config management. Generally I've found that as a Data Engineer with a lot of infra/CICD knowledge, I generally get pigeonholed into those positions on a team, so be prepared for that. I really like this roadmap for DevOps , so you can see where your tech skills are at currently, and what you may need to learn. On top of that, you'll need to learn some data tools. Airflow + dbt is hot right now, Argo is sometimes used in MLOps, Azure Data Stack (I'm not familiar with it) seems common, and probably Spark in almost all cases. You can also checkout in visualization tools probably further down the line, I generally stick to something free when learning on my own, Superset or Google Data Studio (Might be Looker Studio now? Not sure, it's been a while). Here's a roadmap for DE too. I love these roadmaps for getting started, but don't let them distract you from exploring a path more appropriate to what you want to achieve. Generally I've found that as a Data Enigneer with a lot of infra/CICD knowledge, I generally get pigeonholed into those positions on a team
  • Woman interested in data engineering with Python background
    2 projects | /r/dataengineering | 2 Feb 2023
    Anyways, sorry bit of a rant - I land somewhere in the middle. I would say take formal classes and resources when you can. If you have access to a free course a semester, that's incredible in my opinion. If I were in your shoes, I would follow a roadmap and see if there are courses that check off a box in that roadmap. So for example, you know you need to learn CS fundamentals - see if you can take a DSA class or something. Or take a class on databases. Or an OOP or databases class. I would take those classes if I had the opportunity just because I didn't when I was in college. No one course will check every box for sure.
  • How to utilise SQL/Data engineering skills
    2 projects | /r/SQL | 13 Dec 2022
    This GitHub repo has good steps for you to learn about DE skills https://github.com/datastacktv/data-engineer-roadmap
    2 projects | /r/SQL | 13 Dec 2022
  • Career Roadmaps
    2 projects | /r/CareerRoadmaps | 20 Aug 2022
    Data Engineer: https://github.com/datastacktv/data-engineer-roadmap
  • Learning DE
    3 projects | /r/dataengineering | 30 Apr 2022
    Then follow the DE road map to fill in knowledge gap: https://github.com/datastacktv/data-engineer-roadmap
    3 projects | /r/dataengineering | 30 Apr 2022
  • Търся съвет от хората в IT сферата
    2 projects | /r/bulgaria | 8 Dec 2021
  • I am looking for a roadmap on getting into Data Engineering. I can't hope to follow the popular roadmap shared on this sub.
    2 projects | /r/dataengineering | 28 Nov 2021

awesome-opensource-data-engineering

Posts with mentions or reviews of awesome-opensource-data-engineering. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-09-29.
  • Data Engineering projects
    2 projects | /r/dataengineering | 29 Sep 2022
    Do these help? https://github.com/igorbarinov/awesome-data-engineering and https://github.com/gunnarmorling/awesome-opensource-data-engineering
  • Data Engineering podcasts
    2 projects | /r/dataengineering | 24 Dec 2020
    You can find here an awesome list of resources, including podcasts: https://github.com/gunnarmorling/awesome-opensource-data-engineering/blob/master/README.adoc

What are some alternatives?

When comparing data-engineer-roadmap and awesome-opensource-data-engineering you can also consider the following projects:

golang-developer-roadmap - Roadmap to becoming a Go developer in 2020

developer-roadmap - Interactive roadmaps, guides and other educational content to help developers grow in their careers.

Data-Science-Roadmap - Data Science Roadmap from A to Z

adventofcode - :christmas_tree: Advent of Code (2015-2023) in C#

materialize - The data warehouse for operational workloads.

Apache HBase - Apache HBase

Apache Hadoop - Apache Hadoop

Apache Hive - Apache Hive

Cookbook - The Data Engineering Cookbook

awesome-etl - A curated list of awesome ETL frameworks, libraries, and software.

data-engineering-book - Accumulated knowledge and experience in the field of Data Engineering

cookbook - VueJS + NodeJS Evergreen Cookbook