What are some good examples of well-engineered pipelines

This page summarizes the projects mentioned and recommended in the original post on /r/ScientificComputing

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • IPSuite

    Machine Learned Interatomic Potential Tools

  • I expaned a bit on them with my own package https://zntrack.readthedocs.io/ - a general framework for building DVC pipelines through python scripts (and more). This finally brings me to the project I'm actually working on https://github.com/zincware/IPSuite which brings all of this together for the specific use case of machine learned interatomic potentials.

  • ZnTrack

    Create, visualize, run & benchmark DVC pipelines in Python & Jupyter notebooks.

  • I expaned a bit on them with my own package https://zntrack.readthedocs.io/ - a general framework for building DVC pipelines through python scripts (and more). This finally brings me to the project I'm actually working on https://github.com/zincware/IPSuite which brings all of this together for the specific use case of machine learned interatomic potentials.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • messages

    xcompute sub-module (CAE schema layer) including serialization utilities and bindings (by XplicitComputing)

  • The foundation layer is the schema, called XC-Messages (libxcmessages), defines the file-and-wire specification. These messages (and their serialization and deserialization functions) are generated for numerous languages. Internally, we mostly use the C++ bindings. This free and open acts as a Rosetta Stone for CAE applications. https://github.com/XplicitComputing/messages

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • The open-source tool to simplify your ML model deployments

    1 project | news.ycombinator.com | 28 Jun 2023
  • Anyone else just holding out hope that Apollo will find a way to live on (even tho it’s probably like .01% chance)?

    1 project | /r/apolloapp | 27 Jun 2023
  • Template repository for Python projects

    2 projects | /r/Python | 8 Jun 2023
  • How to log model artifacts with MLFLOW and DVC?

    1 project | /r/mlops | 21 May 2023
  • The open-source tool to simplify your ML model deployments

    1 project | news.ycombinator.com | 6 Apr 2023