quilt
data-engineering-book
| quilt | data-engineering-book | |
|---|---|---|
| 2 | 7 | |
| 1,313 | 809 | |
| 0.2% | - | |
| 9.5 | 0.0 | |
| 7 days ago | over 1 year ago | |
| Jupyter Notebook | ||
| Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
quilt
-
Unstructured Data Governance for ML
Quilt: https://quiltdata.com/
-
Lessons From Building a Highly Reproducible Data Warehouse
We do a lot of SQL queries over (CSVs, Parquet, JSON) in S3 using AWS Athena. I work on an OSS project called Quilt that snapshots immutable datasets in S3 and supports reproducibility, idempotency, and functional data engineering.
data-engineering-book
-
✨ 5 Free Resources to Learn Data Engineering 🚀
🔗 https://github.com/oleg-agapov/data-engineering-book
-
Are there any jobs available for someone with python and SQL(as well as certifications in other disciplines)???
#1: Microsoft has a ton of free courses for data engineering. Here is one with 10 hours of content for DataBricks | 18 comments #2: We don't need data scientists, we need data engineers | 37 comments #3: Introduction to Databases for Data Engineers | 31 comments
-
1 year of must-read articles
Introduction to Databases
- SQL for beginners (easy)
- Introduction to Databases
- Introduction to Databases for Data Engineers
What are some alternatives?
dvc - 🦉 ML Experiments and Data Management with Git
Cookbook - The Data Engineering Cookbook
lakeFS - lakeFS - Data version control for your data lake | Git for data
cookbook - VueJS + NodeJS Evergreen Cookbook
data - Data and code behind the articles and graphics at FiveThirtyEight
data-engineer-roadmap - Roadmap to becoming a data engineer in 2021
data-engineering-nd - Projects of the Udacity Data Engineering Nanodegree Program.
data-engineering-zoomcamp - Free Data Engineering course!
demo-code - Bits of code I use during live demos
OPNL - The Open Innovation Open Source License proposal
datasets - 🎁 5,400,000+ Unsplash images made available for research and machine learning
applied-ml - 📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.