A local maximum on bare metal k8s storage? OpenEBS ZFS LocalPV + Rancher Longhorn

This page summarizes the projects mentioned and recommended in the original post on /r/kubernetes

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • lvm-localpv

    Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend LVM2 data storage stack.

  • OpenEBS actually has a LVM provisioner... A possible 3x increase in perf might be worth it if I go for simple RAID1... And it looks like lvm has dm-integrity for some basic checksumming?

  • maddy

    ✉️ Composable all-in-one mail server.

  • I may in the future go back and try Ceph again, but for now I'm just putting really low storage requirement workloads on Longhorn and seeing how that goes -- for example I run maddy (which is an excellent piece of software) and I don't get that many emails on the various accounts I have set up (and SMTP loves to retry) so longhorn is good enough. Another thing I could try is LINSTOR (which is drbd/drbd9 deep down) -- what I loved about OpenEBS ZFS LocalPV is that it makes all of these options available (with a little bit of a performance hit) as it has support for raw block volumes, separately formatted disks etc.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • dynamic-localpv-provisioner

    Dynamically deploy Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is provisioned from simple Local-Hostpath /root storage.

  • Ahhhh So your'e using openebs localpv (openebs/dynamic-localpv-provisioner?). Yeah I couldn't go with that since it didn't properly limit space, but if you're running the DBs then you have controls of that stuff at a higher level (and it's probably good to not be too strict to not hurt user workloads). XFS supposedly does the limiting if you set up the underlying storage properly now but I couldn't get it to work.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts