[D] Facebook Visdom vs Google Tensorboard for Pytorch

• visdom

  1 9,894 5.0 Python

  A flexible tool for creating, organizing, and sharing visualizations of live, rich data. Supports Torch and Numpy. (by fossasia)

  

It seems that some people are still working on it https://github.com/fossasia/visdom

• clearml

  20 5,243 8.1 Python

  ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

  

I'm talking about ClearML😅 trying not to shill for open-source but ~5000 teams have already chosen 💪 https://github.com/allegroai/clearml

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• omniboard

  2 540 0.0 JavaScript

  Web-based dashboard for Sacred

I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it. ex = Experiment() ex.observers.append(FileStorageObserver(EXPERIMENTS_ROOT)) ex.observers.append(MongoObserver(url=MONGODB_URL, db_name='sacred'))

• Sacred

  6 4,157 3.5 Python

  Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

  

I'm using Omniboard (https://github.com/vivekratnavel/omniboard) with Sacred (https://github.com/IDSIA/sacred) for tracking experiments. You can specify custom Observers in Sacred so the model metrics and logs will be saved to a local directory or to a remote DB (e.g., MongoDB). I use a MongoDB database hosted on Atlas. Unlike other suggested options, Sacred and Omniboard are free. Atlas free tier comes with 512MB of free storage which is a huge amount if you're uploading only log files to it. ex = Experiment() ex.observers.append(FileStorageObserver(EXPERIMENTS_ROOT)) ex.observers.append(MongoObserver(url=MONGODB_URL, db_name='sacred'))

• MLflow

  56 17,234 9.9 Python

  Open source platform for the machine learning lifecycle

  

Oh I think most of the paid tracking solutions have auto refresh. As for the free ones? At clear.ml we have them for quite a while, for MLflow there is an open feature request. https://github.com/mlflow/mlflow/issues/2099

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project