terraform-hcloud-kube-hetzner VS microk8s

Hetzner starting with https://github.com/kube-hetzner/terraform-hcloud-kube-hetzne..., plus registry using DigitalOcean.

However in the end my goto solution is k3s on hetzner cloud since it's got support for load balancers, ingress controllers with public IPS, persistent storage etc. It's cheaper than all the other cloud providers, although you need to run some code it doesn't have a 1 click solution. so I sold my hardware and used this https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner. I run it when I need a kube cluster and kill it by deleting the project.

You can look at this: https://github.com/kube-hetzner/terraform-hcloud-kube-hetzner

This whole setup is around 70euros per month, and I can enjoy usenet and torrent downloads of Linux ISOs to constantly peak at 1Gbps speed. All of this is HA with Kubernetes using this.

OpenSUSE MicroOS, we use it here. Another good option would be Fedora CoreOS

It's not even close to major public cloud providers, but this is my setup:

* https://github.com/kube-hetzner/terraform-hcloud-kube-hetzne... (Terraform, Kubernetes bootstrap)

* Flux for CI

* nginx-ingress + Hetzner Loadbalancer (thanks to https://github.com/hetznercloud/hcloud-cloud-controller-mana...)

* Hetzner storage volumes (thanks to https://github.com/hetznercloud/csi-driver)

Kube-Hetzner supports Hetzner Cloud loadbalancers and volumes out of the box, though it also supports other components.

With Hetzner VMs and k3s one could run a k8 cluster with amazingly low cost. There are even ready-made repos that make it lighting fast to deploy and easy to maintain...

https://github.com/kube-hetzner/terraform-hcloud-kube-hetzne...

Even Hetzner maintains a few repos for that:

https://github.com/orgs/hetznercloud/repositories?q=kubernet...

If you want hands-on practice you should have a running Kubernetes cluster (I used MicroK8s for this tutorial) and Helm (see how to install on Installing Helm tutorial). It is important that you understand the basics of these tools to fully understand.

And install microk8s:

MicroK8s is a lightweight, batteries included Kubernetes distribution by Canonical designed for running edge workloads which also happens to be developer-friendly and a great choice for building your own homelab. The following lab covers how to install and run MicroK8s on your own edge node running Ubuntu 22.04 LTS, deploy the NGINX web service and exposing your NGINX website to the Internet with SSL/TLS enabled using AWS resources included within the Free Tier.

One quick and easy win I can recommend, is microk8s.

I had the same problem (and there's a github issue about this: https://github.com/canonical/microk8s/issues/2186). I swapped to k3s and the usage was half of what microk8s used.

microk8s currently has a showstopping issue that makes it guaranteed to have an irrecoverable failure in HA mode. see https://github.com/canonical/microk8s/issues/3227

k0s is better but also has a lot of bugs. it's the closest to vanilla kubernetes among all the distributions.

> like the simplest GPU support

linux users should be ready to install the nvidia device plugin. if they can't do that, they're never going to succeed in running a gpu accelerated application on their cluster anyway.

> like bootstrapping

in my experience, writing all the bootstrap scripts is painful. but now that there's chatgpt, so much of the drudgery as gone away.

MicroK8S to spin up a Kubernetes cluster

They now power my microk8s/x86 cluster (in addition to my 8-node Raspberry Pi4 ARM64 microk8s cluster), microceph cluster and my LXD cluster, and all are configured with WOL, so I can bring up the cluster from any machine in the homelab, on demand.