JDR
Job Dependency Runner (by Chen-Alfred)
covalent
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments. (by AgnostiqHQ)
JDR | covalent | |
---|---|---|
2 | 4 | |
3 | 692 | |
- | 2.5% | |
2.4 | 8.6 | |
about 1 year ago | 8 days ago | |
Python | Python | |
GNU General Public License v3.0 only | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
JDR
Posts with mentions or reviews of JDR.
We have used some of these posts to build our list of alternatives
and similar projects.
-
JDR Tool Introduction (Job Dependency Runner)
Documentation: https://hackmd.io/xsLDRVAMTF2gO0YHo3lxYw
-
Personal Project - JDR Tool Introduction
Source code: https://github.com/Chen-Alfred/JDR
covalent
Posts with mentions or reviews of covalent.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-05.
-
Remote execution of code
Pretty interesting request, if SSH is not used, i would try using something like dask which uses tcp to connect and execute assuming your workers are in another machine.I also think something like covalent can be used to extend your own custom plugin in their ecosystem to connect how you want. We have a very custom private plugin written on top of covalent's to have a custom protocol to connect our central on-prem GPU machines to our local laptops that is rpc based, mostly for high performance as well as some mandate security from where the GPU machines are. Once done it is pretty much something like
-
Prefect alternatives meant for Slurm (HPC)
Does anyone here have any suggestions of alternatives tailored for Slurm on HPC? I know Covalent is one option, but I'm curious about others as well. Ideally the platform should be Pythonic, have a GUI, and be reasonably active/well-maintained.
- Show HN: Covalent – distributed computing for ML, HPC and Quantum (open source)
-
Your strategies for offloading computation
Came across this new tool exactly for this - https://github.com/AgnostiqHQ/covalent
What are some alternatives?
When comparing JDR and covalent you can also consider the following projects:
Dataplane - Dataplane is a data platform that makes it easy to construct a data mesh with automated data pipelines and workflows.
SmartSim - SmartSim Infrastructure Library.