hpc-rocket
By SvenMarcus
jacamar-ci
By ecp-ci
| hpc-rocket | jacamar-ci | |
|---|---|---|
| 1 | 2 | |
| 24 | - | |
| - | - | |
| 4.8 | - | |
| 3 months ago | - | |
| Python | ||
| MIT License | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
hpc-rocket
Posts with mentions or reviews of hpc-rocket.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-01-03.
-
HPC Rocket - A tool to run Slurm jobs from CI pipelines
And finally, a link to the GitHub repo: https://github.com/SvenMarcus/hpc-rocket
jacamar-ci
Posts with mentions or reviews of jacamar-ci.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-01-03.
-
HPC Rocket - A tool to run Slurm jobs from CI pipelines
If you get the chance take a look at Jacamar CI, it is a Gitlab custom executor for Slurm developed by the Exascale Computing Project. While this doesn't address your specific problem set, needs installation on a login node, maybe you can get some inspiration.
-
HPC vs DataOps
We use Jacamar CI to integrate Slurm into our GitLab CI/CD pipelines. As GitLab allows for webhooks to trigger pipeline job you could use this to integrate something like Apache Airflow. There is probably a better or more direct way such as using the new Slurm Rest API (which I believe can be used to submit jobs).
What are some alternatives?
When comparing hpc-rocket and jacamar-ci you can also consider the following projects:
ZnTrack - Create, visualize, run & benchmark DVC pipelines in Python & Jupyter notebooks.
dvc - 🦉 ML Experiments and Data Management with Git
Buildbot - Python-based continuous integration testing framework; your pull requests are more than welcome!
pypyr automation task runner - pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.