My Journey With Spark On Kubernetes... In Python (2/3)

This page summarizes the projects mentioned and recommended in the original post on dev.to

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • spark-operator

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

  • Additional details of how SparkApplications are run can be found in the design documentation.

  • ingress-nginx

    Ingress-NGINX Controller for Kubernetes

  • With this service alone, the UI is only accessible from inside the cluster. We must then create an Ingress to expose the UI outside the cluster. In order for the Ingress resource to work, the cluster must have an ingress controller running. You can choose the ingress controller implementation that best fits your cluster. Traefik and Nginx are very popular choices. The ingress below is configured for Nginx:

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts