messages
ZnTrack
messages | ZnTrack | |
---|---|---|
1 | 2 | |
5 | 42 | |
- | - | |
7.0 | 7.7 | |
2 months ago | 4 days ago | |
CMake | Python | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
messages
-
What are some good examples of well-engineered pipelines
The foundation layer is the schema, called XC-Messages (libxcmessages), defines the file-and-wire specification. These messages (and their serialization and deserialization functions) are generated for numerous languages. Internally, we mostly use the C++ bindings. This free and open acts as a Rosetta Stone for CAE applications. https://github.com/XplicitComputing/messages
ZnTrack
-
What are some good examples of well-engineered pipelines
I expaned a bit on them with my own package https://zntrack.readthedocs.io/ - a general framework for building DVC pipelines through python scripts (and more). This finally brings me to the project I'm actually working on https://github.com/zincware/IPSuite which brings all of this together for the specific use case of machine learned interatomic potentials.
-
HPC Rocket - A tool to run Slurm jobs from CI pipelines
This looks really interesting! I have a similar scenario but haven't looked into it yet. Have you looked at dvc.org - I'm planning on using it together with slurm and what they call CML for my projects. On that context I also wrote a tool that makes DVC more pythonic https://github.com/zincware/ZnTrack altough I'm currently restructuring it a bit but having backwards compatibility in mind.
What are some alternatives?
Protobuf - Protocol Buffers - Google's data interchange format
fiftyone - The open-source tool for building high-quality datasets and computer vision models
IPSuite - Machine Learned Interatomic Potential Tools
mlem - 🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞
goprotobuf - Go support for Google's protocol buffers
Activeloop Hub - Data Lake for Deep Learning. Build, manage, query, version, & visualize datasets. Stream data real-time to PyTorch/TensorFlow. https://activeloop.ai [Moved to: https://github.com/activeloopai/deeplake]
protobuf - Protocol Buffers for JavaScript (& TypeScript).
jacamar-ci
dvc - 🦉 ML Experiments and Data Management with Git
example-get-started - Get started DVC project (NLP, random forest)
hpc-rocket