quilt
rihal-challenges
| quilt | rihal-challenges | |
|---|---|---|
| 2 | 1 | |
| 1,314 | 11 | |
| 0.3% | - | |
| 9.5 | 0.0 | |
| 6 days ago | 5 months ago | |
| Jupyter Notebook | Jupyter Notebook | |
| Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
quilt
-
Unstructured Data Governance for ML
Quilt: https://quiltdata.com/
-
Lessons From Building a Highly Reproducible Data Warehouse
We do a lot of SQL queries over (CSVs, Parquet, JSON) in S3 using AWS Athena. I work on an OSS project called Quilt that snapshots immutable datasets in S3 and supports reproducibility, idempotency, and functional data engineering.
rihal-challenges
What are some alternatives?
dvc - 🦉 ML Experiments and Data Management with Git
100LinesOfCode - Let's build something productive in less than 100 Lines of Code.
lakeFS - lakeFS - Data version control for your data lake | Git for data
datasets - 🎁 5,400,000+ Unsplash images made available for research and machine learning
data - Data and code behind the articles and graphics at FiveThirtyEight
spyql - Query data on the command line with SQL-like SELECTs powered by Python expressions
data-engineering-nd - Projects of the Udacity Data Engineering Nanodegree Program.
CodeSearchNet - Datasets, tools, and benchmarks for representation learning of code.
demo-code - Bits of code I use during live demos
WSDMCup2023 - Toloka Visual Question Answering Challenge at WSDM Cup 2023
data-engineering-book - Accumulated knowledge and experience in the field of Data Engineering