My Journey With Spark On Kubernetes... In Python (1/3)

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • volcano

    A Cloud Native Batch System (Project under CNCF)

    For our experiments, we will use Volcano which is a batch scheduler for Kubernetes, well-suited for scheduling Spark applications pods with a better efficiency than the default kube-scheduler. The main reason is that Volcano allows "group scheduling" or "gang scheduling": while the default scheduler of Kubernetes schedules containers one by one, Volcano ensures that a gang of related containers (here, the Spark driver and its executors) can be scheduled at the same time. If for any reason it is not possible to deploy all the containers in a gang, Volcano will not schedule that gang. This article explains in more detail the reasons for using Volcano.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • helm

    Discontinued The Kubernetes Package Manager [Moved to: https://github.com/helm/helm] (by kubernetes)

    In this section, you use Helm to deploy the Kubernetes Operator for Apache Spark from the incubator Chart repository. Helm is a package manager you can use to configure and deploy Kubernetes apps.

  • spark-operator

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

    In this section, you use Helm to deploy the Kubernetes Operator for Apache Spark from the incubator Chart repository. Helm is a package manager you can use to configure and deploy Kubernetes apps.

  • charts

    Discontinued ⚠️(OBSOLETE) Curated applications for Kubernetes (by helm)

    In this section, you use Helm to deploy the Kubernetes Operator for Apache Spark from the incubator Chart repository. Helm is a package manager you can use to configure and deploy Kubernetes apps.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How to take down production with a single Helm command

    1 project | news.ycombinator.com | 4 Apr 2024
  • Deploy Kubernetes in Minutes: Effortless Infrastructure Creation and Application Deployment with Cluster.dev and Helm Charts

    3 projects | dev.to | 17 Feb 2024
  • Kubernets Helm Chart

    1 project | dev.to | 13 Feb 2024
  • Let's Celebrate Relicensing from an Open Source to a Proprietary License

    1 project | news.ycombinator.com | 12 Oct 2023
  • Simplified Deployment: A Deep Dive into Containerization and Helm

    6 projects | dev.to | 9 Oct 2023