data-engineering-book
quilt
| data-engineering-book | quilt | |
|---|---|---|
| 7 | 2 | |
| 809 | 1,314 | |
| - | 0.3% | |
| 0.0 | 9.5 | |
| over 1 year ago | 5 days ago | |
| Jupyter Notebook | ||
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data-engineering-book
-
✨ 5 Free Resources to Learn Data Engineering 🚀
🔗 https://github.com/oleg-agapov/data-engineering-book
-
Are there any jobs available for someone with python and SQL(as well as certifications in other disciplines)???
#1: Microsoft has a ton of free courses for data engineering. Here is one with 10 hours of content for DataBricks | 18 comments #2: We don't need data scientists, we need data engineers | 37 comments #3: Introduction to Databases for Data Engineers | 31 comments
-
1 year of must-read articles
Introduction to Databases
- SQL for beginners (easy)
- Introduction to Databases
- Introduction to Databases for Data Engineers
quilt
-
Unstructured Data Governance for ML
Quilt: https://quiltdata.com/
-
Lessons From Building a Highly Reproducible Data Warehouse
We do a lot of SQL queries over (CSVs, Parquet, JSON) in S3 using AWS Athena. I work on an OSS project called Quilt that snapshots immutable datasets in S3 and supports reproducibility, idempotency, and functional data engineering.
What are some alternatives?
Cookbook - The Data Engineering Cookbook
dvc - 🦉 ML Experiments and Data Management with Git
cookbook - VueJS + NodeJS Evergreen Cookbook
lakeFS - lakeFS - Data version control for your data lake | Git for data
data-engineer-roadmap - Roadmap to becoming a data engineer in 2021
data - Data and code behind the articles and graphics at FiveThirtyEight
data-engineering-zoomcamp - Free Data Engineering course!
data-engineering-nd - Projects of the Udacity Data Engineering Nanodegree Program.
OPNL - The Open Innovation Open Source License proposal
demo-code - Bits of code I use during live demos
applied-ml - 📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
datasets - 🎁 5,400,000+ Unsplash images made available for research and machine learning