-
Sacred
Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it.
I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it.
Related posts
-
Can someone tell me good libraries you use on a day to day basis that increases your research productivity in ML/AI?
-
Sacred VS cascade - a user suggested alternative
2 projects | 5 Dec 2023 -
✨ 7 Best Machine Learning Experiment Logging Tools in 2022 🚀
-
VS Code extension to track ML experiments
-
HPC Rocket - A tool to run Slurm jobs from CI pipelines