Sacred
Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA. (by IDSIA)
aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker. (by aimhubio)
Our great sponsors
| Sacred | aim | |
|---|---|---|
| 6 | 70 | |
| 4,155 | 4,762 | |
| 0.4% | 2.7% | |
| 3.5 | 7.9 | |
| 2 months ago | 2 days ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Sacred
Posts with mentions or reviews of Sacred.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-05.
-
Sacred VS cascade - a user suggested alternative
2 projects | 5 Dec 2023
-
✨ 7 Best Machine Learning Experiment Logging Tools in 2022 🚀
🔗 https://github.com/IDSIA/sacred
-
https://np.reddit.com/r/MachineLearning/comments/pvs8r5/d_facebook_visdom_vs_google_tensorboard_for/hefg131/
I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it.
-
[D] Facebook Visdom vs Google Tensorboard for Pytorch
I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it. ex = Experiment() ex.observers.append(FileStorageObserver(EXPERIMENTS_ROOT)) ex.observers.append(MongoObserver(url=MONGODB_URL, db_name='sacred'))
-
Can someone tell me good libraries you use on a day to day basis that increases your research productivity in ML/AI?
sacred helped me log my experiments. I did setup my environment only once 4 years ago, and since then I have a list of all my training runs with the hyperparameters and results.
-
[D] How to be more productive while doing Deep Learning experiments?
For 1, setup an experiment tracking framework. I found Sacred to be helpful https://github.com/IDSIA/sacred.
aim
Posts with mentions or reviews of aim.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-05.
-
aim VS cascade - a user suggested alternative
2 projects | 5 Dec 2023
-
End-to-end observability for LlamaIndex environment
LlamaIndex Observer is one of the logging apps built in AimOS (aimstack.io).
-
Data Registry suggestions for ML projects
I've been working with Aim for a while, and it's been solid. What stands out for me is its open-source nature. https://aimstack.io/
-
Building and debugging LLMs with Aim: self-hosted and open-source AI metadata tracking tool
If you haven't yet, drop a star to support open-source project! ⭐️ https://github.com/aimhubio/aim
-
Any tools that offer In-depth tracking of model runtime performance?
Here is the GitHub repository: https://github.com/aimhubio/aim
-
Using MLflow(Machine Learning experimentation tracking tool) in Kaggle notebooks with the help of DagsHub
You can also check out Aim, which has an integration with MLflow, called aimlflow.
-
Visualize metadata with Aim on Hugging Face Spaces and seamlessly share training results with anyone
Hope you enjoyed reading and thanks for your time! Feel free to share your thoughts, would love to read them. Support Aim by dropping a star on GitHub: https://github.com/aimhubio/aim
-
Effortless image tracking and analysis for 3D segmentation task with Aim
Aim: An easy-to-use & supercharged open-source AI metadata tracker aimstack.io
-
Evaluate Different Vector Databases
Seems useful: https://github.com/aimhubio/aim
- Metadata visualization via Aim Explorers
What are some alternatives?
When comparing Sacred and aim you can also consider the following projects:
MLflow - Open source platform for the machine learning lifecycle
tensorboard - TensorFlow's Visualization Toolkit
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
dvc - 🦉 ML Experiments and Data Management with Git
tensorflow - An Open Source Machine Learning Framework for Everyone
guildai - Experiment tracking, ML developer tools
Keras - Deep Learning for humans
wandb - 🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
Clairvoyant - Software designed to identify and monitor social/historical cues for short term stock movement
scikit-learn - scikit-learn: machine learning in Python
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!