Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 7 Python experiment-tracking Projects
-
Kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
-
optscale
FinOps and MLOps platform to run ML/AI and regular cloud workloads with optimal performance and cost.
-
mandala
A powerful and easy to use Python framework for experiment tracking and incremental computing
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Interesting, thanks for sharing. I'll definitely take a look, although at this point I am so comfortable with Snakemake, it is a bit hard to imagine what would convince me to move to another tool. But I like the idea of composable pipelines: I am building a tool (too early to share) that would allow to lay Snakemake pipelines on top of each other using semi-automatic data annotations similar to how it is done in kedro (https://github.com/kedro-org/kedro).
Project mention: Profile and instrument ML experiments and optimize their performance expenses | news.ycombinator.com | 2023-09-27
Project mention: Mandala: A little plaground for testing pixel logic patterns | news.ycombinator.com | 2024-03-07I was so confused, expecting this to be some trickery related to the computational-graph-memoization-and-exploration tool "mandala" https://github.com/amakelov/mandala
Project mention: Show HN: Demo of using DVC and MLFlow for ML experiments | news.ycombinator.com | 2024-01-29
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python experiment-tracking related posts
-
Mandala: A little plaground for testing pixel logic patterns
-
Mandala: Notebook memoization on steroids, used by Anthropic
-
End-to-end observability for LlamaIndex environment
-
ML Experiments Management with Git
-
Data Registry suggestions for ML projects
-
Building and debugging LLMs with Aim: self-hosted and open-source AI metadata tracking tool
-
Snakemake – A framework for reproducible data analysis
-
A note from our sponsor - InfluxDB
www.influxdata.com | 10 May 2024
Index
What are some of the best open-source experiment-tracking projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Kedro | 9,374 |
| 2 | aim | 4,816 |
| 3 | mlrun | 1,308 |
| 4 | optscale | 992 |
| 5 | mandala | 230 |
| 6 | bunny-party | 10 |
| 7 | CML_AMP_MLFlow_Tracking | 4 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com