ZnTrack
messages
| ZnTrack | messages | |
|---|---|---|
| 2 | 1 | |
| 41 | 5 | |
| - | - | |
| 7.7 | 7.0 | |
| 6 days ago | about 2 months ago | |
| Python | CMake | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ZnTrack
-
What are some good examples of well-engineered pipelines
I expaned a bit on them with my own package https://zntrack.readthedocs.io/ - a general framework for building DVC pipelines through python scripts (and more). This finally brings me to the project I'm actually working on https://github.com/zincware/IPSuite which brings all of this together for the specific use case of machine learned interatomic potentials.
-
HPC Rocket - A tool to run Slurm jobs from CI pipelines
This looks really interesting! I have a similar scenario but haven't looked into it yet. Have you looked at dvc.org - I'm planning on using it together with slurm and what they call CML for my projects. On that context I also wrote a tool that makes DVC more pythonic https://github.com/zincware/ZnTrack altough I'm currently restructuring it a bit but having backwards compatibility in mind.
messages
-
What are some good examples of well-engineered pipelines
The foundation layer is the schema, called XC-Messages (libxcmessages), defines the file-and-wire specification. These messages (and their serialization and deserialization functions) are generated for numerous languages. Internally, we mostly use the C++ bindings. This free and open acts as a Rosetta Stone for CAE applications. https://github.com/XplicitComputing/messages
What are some alternatives?
fiftyone - The open-source tool for building high-quality datasets and computer vision models
Protobuf - Protocol Buffers - Google's data interchange format
mlem - 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞
IPSuite - Machine Learned Interatomic Potential Tools
Activeloop Hub - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai [Moved to: https://github.com/activeloopai/deeplake]
goprotobuf - Go support for Google's protocol buffers
jacamar-ci
protobuf - Protocol Buffers for JavaScript (& TypeScript).
dvc - 🦉 ML Experiments and Data Management with Git
example-get-started - Get started DVC project
hpc-rocket