flux-operator
Deploy a Flux MiniCluster to Kubernetes with the operator (by flux-framework)
armada
A multi-cluster batch queuing system for high-throughput workloads on Kubernetes. (by armadaproject)
| flux-operator | armada | |
|---|---|---|
| 1 | 8 | |
| 24 | 419 | |
| - | 4.5% | |
| 8.5 | 9.7 | |
| about 1 month ago | 7 days ago | |
| Python | Go | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flux-operator
Posts with mentions or reviews of flux-operator.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-13.
-
job scheduling for scientific computing on k8s?
Lawrence Livermore National lab is working on a project called Flux that has a kubernetes operator - https://github.com/flux-framework/flux-operator
armada
Posts with mentions or reviews of armada.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-13.
-
job scheduling for scientific computing on k8s?
Armada could be an alternative: https://armadaproject.io/
-
OpenAI, Scaling Kubernetes to 7,500 nodes
To overcome the limitations on cluster size in Kubernetes, folks may want to look at the Armada Project ( https://armadaproject.io/ ). Armada is a
- Kubernetes was never designed for batch jobs
-
Kubernetes Was Never Designed for Batch Jobs
Another aspect of batch jobs is that we’ll often want to run distributed computations where we split our data into chunks and run a function on each chunk. One popular option is to run Spark, which is built for exactly this use case, on top of Kubernetes. And there are other options for additional software to make running distributed computations on Kubernetes easier.
- Armada
-
Karmada: Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
The naming sounds very similar to this project: https://github.com/G-Research/armada
- Queue batch job that would exceed namespace quota.
What are some alternatives?
When comparing flux-operator and armada you can also consider the following projects:
slurm - Slurm: A Highly Scalable Workload Manager
karmada - Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
k8s-home-ops
kube-batch - A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
kopf - A Python framework to write Kubernetes operators in just a few lines of code
madaidans-insecurities.github.io
ohpc - OpenHPC Integration, Packaging, and Test Repo
argo - Workflow Engine for Kubernetes
kueue - Kubernetes-native Job Queueing
magic-wormhole - get things from one computer to another, safely [Moved to: https://github.com/magic-wormhole/magic-wormhole]
thanos-remote-read - Adapter to query Thanos StoreAPI with Prometheus remote read support.