shell-operator
spark-operator
Our great sponsors
shell-operator | spark-operator | |
---|---|---|
10 | 8 | |
2,255 | 2,609 | |
2.4% | 2.4% | |
8.3 | 8.2 | |
10 days ago | 2 days ago | |
Go | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
shell-operator
-
How to create a watch over namespaces?
Maybe, the Shell operator is a good tool for that?
-
Is there a way to execute script after a crash?
Shell-operator to parse logs and make action after the pod crash.
-
Cert Manager - Get it to do something on renewal, such as call webhook or fire up a container
Argo workflow can trigger from k8s objects but may be a bit more than you need, shell-operator may be good enough https://github.com/flant/shell-operator for a quick win
-
Automatically create subdomains for services similar to Vercel Preview
I used https://github.com/flant/shell-operator to write a simple Kubernetes operator that automatically creates subdomains for your services by patching an existing ingress.
- Run a pod in a namespace without having access to it's secrets?
-
Best option to write a CRD today?
If you are more into lightweight and common use cases, look at metacontroller or the shell-operator.
-
How long does it take to learn go and program a K8s operator?
Believe it or not, you can write a Kubernetes operator using simple shell scripts: https://github.com/flant/shell-operator
-
LoadBalancer type service on bare-metal
You could use something like shell operator, metacontroller, or operator-sdk to run a command against your load balancer's API whenever a LoadBalancer service is created.
-
looking for a Kubernetes controller watching logs and run commands / restarting pods
https://github.com/flant/shell-operator should get you quite far but this sounds like the process should just shut itself down when that case is hit...
-
shell-operator reaches its v1.0.0 release: hooks without kubectl
shell-operator is already used in KubeSphere's ks-installer, Confluent's Kafka DevOps solution, Deckhouse Kubernetes platform, and more. All documentation is available in the project's GitHub repo — if you feel it might be interesting for your needs, give it a try! Any feedback is warmly welcome.
spark-operator
-
Dependency issue with Pyspark running on Kubernetes using spark-on-k8s-operator
I have spent days now trying to figure out a dependency issue I'm experiencing with (Py)Spark running on Kubernetes. I'm using the spark-on-k8s-operator and Spark's Google Cloud connector.
-
Experience setting up Spark and Hudi on Kubernetes
We're using https://github.com/bitnami/charts/tree/main/bitnami/spark, but I have heard good things about https://github.com/GoogleCloudPlatform/spark-on-k8s-operator as well. Hudi should not need any long running deployments as per the docs https://hudi.apache.org/docs/0.5.1/deployment/#deploying
-
[Spark-k8s] — Getting started # Part 1
The SparkOperator must be installed before we can use Spark on Kubernetes. Google created this operator, which is available on Github. In a nutshell, the operator is in charge of monitoring the cluster for specific events related to the spark job, as known as kind: SparkApplication
-
So many sparks on K8s... Could anyone give me a few explanations please ?
Spark-Operator (as I understand, Spark-Operator integrates well with K8s while vanilla Spark integration with K8s seems extremely complex to maintain)
-
"Running Apache Spark on EKS Fargate"
Spark on K8s Operator is a project from Google that allows submitting spark applications on Kubernetes cluster using CustomResource Definition SparkApplication. It uses mutating admission webhook to modify the pod spec and add the features not officially supported by spark-submit.
-
My Journey With Spark On Kubernetes... In Python (1/3)
In this section, you use Helm to deploy the Kubernetes Operator for Apache Spark from the incubator Chart repository. Helm is a package manager you can use to configure and deploy Kubernetes apps.
-
My Journey With Spark On Kubernetes... In Python (2/3)
Additional details of how SparkApplications are run can be found in the design documentation.
-
Gopher Gold #14 - Wed Oct 07 2020
GoogleCloudPlatform/spark-on-k8s-operator (Go): Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
What are some alternatives?
metacontroller - Writing kubernetes controllers can be simple
volcano - A Cloud Native Batch System (Project under CNCF)
github-actions-runner-operator - K8S operator for scheduling github actions runner pods
trojan-go - Go实现的Trojan代理,支持多路复用/路由功能/CDN中转/Shadowsocks混淆插件,多平台,无依赖。A Trojan proxy written in Go. An unidentifiable mechanism that helps you bypass GFW. https://p4gefau1t.github.io/trojan-go/
mysql-operator - Asynchronous MySQL Replication on Kubernetes using Percona Server and Openark's Orchestrator.
helm-operator - Successor: https://github.com/fluxcd/helm-controller — The Flux Helm Operator, once upon a time a solution for declarative Helming.
k8s-bigip-ctlr - Repository for F5 Container Ingress Services for Kubernetes & OpenShift.
enhancements - Enhancements tracking repo for Kubernetes
percona-xtradb-cluster-operator - Percona Operator for MySQL based on Percona XtraDB Cluster
kubebuilder - Kubebuilder - SDK for building Kubernetes APIs using CRDs
keepalived-operator - An operator to manage VIPs backed by keepalived
helm - The Kubernetes Package Manager [Moved to: https://github.com/helm/helm]