Running Kafka on Kubernetes for local development with Storage class

• local-path-provisioner

  30 2,003 6.1 Go

  Dynamically provisioning persistent local storage with Kubernetes

  

In a recent post I showed a setup to run Kafka on Kubernetes locally using Persistent Volumes(PV) and Persistent Volume Claims(PVC), this post covers the setup using Kubernetes Storage Class(SC) and leveraging the default one provisioned automatically by Kind which is the Rancher local-path-provisioner.

• kind

  183 12,818 8.9 Go

  Kubernetes IN Docker - local clusters for testing Kubernetes

  

This setup is simpler and uses less code than the previous one with the trade off of having a bit less control over the path of data externalized to the host machine while requiring some internal knowledge of Kind to set it up. In general I favor this approach for local development over the one from my previous post.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• kafka-local-kubernetes

  3 19 0.0

  Local single kafka instance + schema registry + zookeeper to be used as local development.

The main thing to notice in this setup below compared to the previous one is that you don't have any PV or PVC configuration files this time because we're leveraging the default Rancher local-path-provisioner provided by Kind automatically through it's default Storage class.

Suggest a related project