Jupyter Notebook Orchestration Projects
-
hamilton
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Note that this uses simple OpenAI calls — you can replace this with Langchain, LlamaIndex, Hamilton (or something else) if you prefer more abstraction, and delegate to whatever LLM you like to use. And, you should probably use something a little more concrete (E.G. instructor) to guarantee output shape.
Project mention: Analyzing MotoGP Racing Data Using a Data Pipeline | /r/dataengineering | 2023-05-04In this project, we will scrape data from the MotoGP website and perform data engineering tasks to clean and prepare the data for analysis. The data will include race results over the years. Once the data is cleaned and prepared, we will perform exploratory data analysis and visualization to gain insights into the data. GitHub-repo
Index
| Project | Stars | |
|---|---|---|
| 1 | hamilton | 1,312 |
| 2 | DE-ZOOMCAMP-PROJECT | 4 |
Sponsored