Want advice on planned evolution: k3os/Longhorn --> Talos/Ceph, plus Consul and Vault

This page summarizes the projects mentioned and recommended in the original post on /r/homelab

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • sops

    Simple and flexible tool for managing secrets

  • The addition of Consul and Vault gives me a few things. For one, right now I'm handling secrets with a mixture of SOPS and Sealed Secrets. I use Vault in my professional life, and have used both Vault and Consul at my last job. Vault is a beast, so I may as well get better at it; plus its options for secret injection are better.

  • talos

    Talos Linux is a modern Linux distribution built for Kubernetes.

  • I've used Talos before and liked it. What was keeping me away was that it doesn't support Longhorn for distributed storage, and my previous experience with Ceph via Rook wasn't good. However, I think this time around I'm ready. I plan on using my existing Proxmox cluster to run Ceph, and expose it to K8s via a CSI.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • sealed-secrets

    A Kubernetes controller and tool for one-way encrypted Secrets

  • The addition of Consul and Vault gives me a few things. For one, right now I'm handling secrets with a mixture of SOPS and Sealed Secrets. I use Vault in my professional life, and have used both Vault and Consul at my last job. Vault is a beast, so I may as well get better at it; plus its options for secret injection are better.

  • microceph

    Ceph for a one-rack cluster and appliances

  • Ceph can be technically challenging to support yourself. I'm all for learning new things, but I don't want to be left with some monster I have to constantly administratively feed either. Have you seen https://github.com/canonical/microceph ?

  • rook

    Storage Orchestration for Kubernetes

  • I've briefly run ceph in an external mode, you can actually use a rook deployment to manage it (sort of). Here is the documentation for doing that. For me it didn't pass my testing phase because I need better networking equipment before I can try that.

  • bloopySphere

    My home cluster.

  • For vault, I run vault in my cluster, and use a tf-controller to control its state. My Terraform files are automated to deploy as an oci which is used to feed the tf-controller. My main home cluster hasn't been upgraded that much yet but you can find it here for reference. My test "cluster" repo is private, mainly because some of my mistakes are more embarrassing than the mistakes I make with the main one. I don't have experience with consul so I cannot offer any recommendations on that front.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts