volcano
warewulf
Our great sponsors
| volcano | warewulf | |
|---|---|---|
| 2 | 2 | |
| 3,744 | 200 | |
| 3.3% | 5.5% | |
| 9.1 | 9.5 | |
| 4 days ago | 4 days ago | |
| Go | Go | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
volcano
-
Can we specify nodeSelector inline for a kubectl command
Also, if you are creating bare pods, this sounds like batch scheduling and you should consider using Jobs instead, to have a pod controller. And then you could also consider the https://volcano.sh/ scheduler if it has a fitting scheduling plugin for your use case.
-
My Journey With Spark On Kubernetes... In Python (1/3)
For our experiments, we will use Volcano which is a batch scheduler for Kubernetes, well-suited for scheduling Spark applications pods with a better efficiency than the default kube-scheduler. The main reason is that Volcano allows "group scheduling" or "gang scheduling": while the default scheduler of Kubernetes schedules containers one by one, Volcano ensures that a gang of related containers (here, the Spark driver and its executors) can be scheduled at the same time. If for any reason it is not possible to deploy all the containers in a gang, Volcano will not schedule that gang. This article explains in more detail the reasons for using Volcano.
warewulf
-
A stateless and diskless container OS provisioning system for large clusters
Took the title from the github repo, since there wasn't much on the homepage that was as descriptive. https://github.com/warewulf/warewulf Posting because I'm looking into HPC systems for work, and this looks cool.
- going to replace our old cluster, which way xCat or Warewulf?
What are some alternatives?
kube-batch - A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
singularity - Singularity has been renamed to Apptainer as part of us moving the project to the Linux Foundation. This repo has been persisted as a snapshot right before the changes.
spark-operator - Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
gokey - A simple vaultless password manager in Go
argo - Workflow Engine for Kubernetes
singularity-cri - The Singularity implementation of the Kubernetes Container Runtime Interface
liqo - Enable dynamic and seamless Kubernetes multi-cluster topologies
charts - ⚠️(OBSOLETE) Curated applications for Kubernetes
singularity - SingularityCE is the Community Edition of Singularity, an open source container platform designed to be simple, fast, and secure.
kubernetes-operator-roiergasias - 'Roiergasias' kubernetes operator is meant to address a fundamental requirement of any data science / machine learning project running their pipelines on Kubernetes - which is to quickly provision a declarative data pipeline (on demand) for their various project needs using simple kubectl commands. Basically, implementing the concept of No Ops. The fundamental principle is to utilise best of docker, kubernetes and programming language features to run a workflow with minimal workflow definition syntax. It is a Go based workflow running on command line or Kubernetes with the help of a custom operator for a quick and automated data pipeline for your machine learning projects (a flavor of MLOps).
kraken - Kraken is a distributed state engine framework for scalable automation and orchestration tools.