[D] Why aren't workflow management tools used to ensure reproducibility in the ML world?

This page summarizes the projects mentioned and recommended in the original post on /r/MachineLearning
Workflow Machine Learning Kubernetes Argo Data Science

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • argo

    Workflow Engine for Kubernetes

    • I'm not aware of CWL or Research Objects but maybe relevant is the fact that Argo Workflows is used in ML, especially via Kubeflow Pipelines. Not sure how similar these are to what you're talking about though.

  • ploomber

    The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

    • The open-source project I'm working on aims to close this gap, allowing practitioners to use Jupyter for interactive data exploration but still produce reproducible workflows.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts