nfs-subdir-external-provisioner VS raspberry-pi-dramble

Using nfs-subdir-external-provisioner instead of csi-driver-nfs

I am trying to run sonarr inside my k3s cluster. Since I have multiple nodes, in order to keep data persistant I have been using a NAS and the Kubernetes NFS external provisioner as my Storage Class.

There's this, if you want your nfs storage available to pods as PVCs, with some limitations: https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner

NFS Provisioner

Depends on how much resiliency you need . Something like https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner works well for a lab or non-prod cluster. You could even use something like this in prod if you have access to highly reliably NFS mounts.

I first installed a NFS Server via this helm chart: https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner Eventually I deployed Longhorn cause I needed expandable volumes, which the first repo doesn't support. I guess for best performance you should go for a ceph cluster, but I'm not an expert.

I used the NFS provisioner for persistent volumes until I got the Ceph side up and running. I created a share on my NAS specifically for k8s. It worked very well and had the bonus of being just a regular file system that you could browse/edit easily (just place files in or edit config). I would agree with not moving plex into k8s. I right now just have a barebones 1 control 2 worker setup using k3s.

However, is it too difficult to create new pods/deployments etc on your own? I find it super easy to just create a PVC (via https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner ) and create a MySQL pod in a new namespace for every micro service I create.

This is what you need https://github.com/kubernetes-sigs/nfs-subdir-external-provisioner Point it to a folder and it will create subfolders for each PVC.

https://www.pidramble.com - but you do need to power the router. 5th port is an uplink

Don't bother. Just put them on an open stack and blow a quiet Noctua fan sideways through the stack. I used to have a four-pi4 cluster ala https://www.pidramble.com and one fan blowing back to front was easily good enough. I also removed the fans from the official PoE HATs since they sounded like rocket engines no matter what I did.

There's no rack, it's simply on the corner of my desk. I haven't made photos of it but it looks pretty much like Jeff Geerling's Dramble: https://www.pidramble.com/

Had a pi 'dramble' just like this one and it worked fine. I ran k3s at the time on it. Since it was a lab experimentation thing, I didn't throw more hardware at it, but I could have likely gotten similar results with a bunch of Vagrant/VirtualBox VMs on one NUC.

Automate the Pi Dramble website I run in my basement with Drupal Pi.

How is latency and stuff? Any slowness that you wouldn't expect from the software that may come from running it on a rpi4? I've been thinking of setting up a few services, but I kinda want to do something like the Pi Dramble, wasn't even aware that a single pi would have the power to run all of these services. Though I'm not actually surprised it does.

A couple years ago when I thought I'd have to get into kubernetes for a living, I built a 4x4GB pi4 cluster with the exact parts list from Jeff Geerling's "dramble" setup (link) and did a bunch of experimentation with k3s as a lightweight cluster solution. Worked pretty amazingly for things like "spin me up 10 more of those things" and for moving things around to upgrade the SD card on the 3rd pi while keeping the services running on the other pi. But I don't need to do kubernetes for a living so the cluster is just sitting here collecting dust powered-down basically.

I see this kind of question asked a lot when people are posting their Kubernetes Pi clusters. The rpi 4 quad core with 4-8GB RAM gives a lot of potential for the price in a kuberenetes setup I feel. I found the pi dramble project interesting, and even more the turing pi using rpi compute modules. Are NUCs really a cheaper alternative for a kubernetes cluster, every time I start try to come up with something I end up with a far more expensive setup and fewer cores. Any hints on viable setups, e.g. replacing 4x POE powered RPI 4's.?

My setup is exactly the same as the top photo on https://www.pidramble.com just with the stack'o'pi zip-tied to the switch so I can move it around without the things sliding around.