My Journey With Spark On Kubernetes... In Python (2/3)

This page summarizes the projects mentioned and recommended in the original post on

Our great sponsors
  • Scout APM - Less time debugging, more time building
  • OPS - Build and Run Open Source Unikernels
  • SonarQube - Static code analysis for 29 languages.
  • spark-on-k8s-operator

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

    Additional details of how SparkApplications are run can be found in the design documentation.

  • ingress-nginx

    NGINX Ingress Controller for Kubernetes

    With this service alone, the UI is only accessible from inside the cluster. We must then create an Ingress to expose the UI outside the cluster. In order for the Ingress resource to work, the cluster must have an ingress controller running. You can choose the ingress controller implementation that best fits your cluster. Traefik and Nginx are very popular choices. The ingress below is configured for Nginx:

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts