rust-in-hpc
By westernmagic
hyperqueue
Scheduler for sub-node tasks for HPC systems with batch scheduling (by It4innovations)
| rust-in-hpc | hyperqueue | |
|---|---|---|
| 1 | 2 | |
| 39 | 407 | |
| - | 5.7% | |
| 0.0 | 9.6 | |
| almost 3 years ago | 1 day ago | |
| TeX | Rust | |
| - | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rust-in-hpc
Posts with mentions or reviews of rust-in-hpc.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-02-06.
hyperqueue
Posts with mentions or reviews of hyperqueue.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-12.
-
HyperQueue: ergonomic HPC task executor written in Rust
Hi! Me and my colleagues are working on an HPC (High Performance Computing)-focused tool for executing workflows/pipelines/task graphs in an ergonomic and efficient manner. It is called HyperQueue, it is open-source (https://github.com/It4innovations/hyperqueue) and it is of course written in Rust :) (previous incarnations of the tool were written in C++, which was a nightmare to maintain). It leverages async Rust heavily, not just for I/O (we use Tokio), but also for communicating between a number of independent "processes" (actors) running on a single thread.
-
Rust and Scientific/High-Performance Computing
The HPC group that I am part of has switched from C++ to Rust for writing HPC software and I can't really imagine going back :-) You can check out for example https://github.com/it4innovations/rsds or https://github.com/it4innovations/hyperqueue, which are Rust HPC tools used "in the wild".
What are some alternatives?
When comparing rust-in-hpc and hyperqueue you can also consider the following projects:
node_crunch - Allows to distribute computations across several nodes
rsds - Dask scheduler written in Rust
coarray-tutorial - A short tutorial to get people started with Fortran's coolest feature, coarrays.
ppl - Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.
aiida-hyperqueue - AiiDA plugin for the HyperQueue metascheduler.