zfs-localpv
homelab
Our great sponsors
zfs-localpv | homelab | |
---|---|---|
12 | 53 | |
366 | 7,717 | |
5.2% | - | |
7.1 | 8.9 | |
7 days ago | 6 days ago | |
Go | Python | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zfs-localpv
-
ZFS 2.2.0 (RC): Block Cloning merged
I use it in Kubernetes via https://github.com/openebs/zfs-localpv
The PersistentVolume API is a nice way to divvy up a shared resource across different teams, and using ZFS for that gives us the snapshotting, deduplication, and compression for free. For our workloads, it benchmarked faster than XFS so it was a no-brainer.
- openebs/zfs-localpv: CSI Driver for dynamic provisioning of Persistent Local Volumes for Kubernetes using ZFS.
-
OpenEBS on MicroK8S on Hetzner
Last few months I experimented more and more with all OpenEBS solutions that fit small Kubernetes cluster, using MicroK8S and Hetzner Cloud for a real experience.
- Openebs ?? Or equivalent
-
Network Storage on On-Prem Barebones Machine
I would investigate https://openebs.io/ https://portworx.com/ https://longhorn.io/ if you are forced to you can mount ISCSI on the kublet and feed it to one of those solutions. Keep in mind most of the big guys buy some sort of managed solution that you can point a CSI like trident https://netapp-trident.readthedocs.io
-
Ask HN: What are some fun projects to run on a home K8s cluster?
What are some cool projects to self hosted on a home Raspberry Pi (64 bit) Kubernetes cluster (Helm charts). arm64 support is a must. A lot of projects only build amd64 Docker containers which don't run on my cluster.
I currently run:
- obenebs (provides abstraction for using local k8s worker disks as PVC mounts when running on-prem) -- https://openebs.io/
-
Finally got around to doing that Ceph on ZFS experiment
I didn't set anything actually -- I need to look into whether OpenEBS ZFS LocalPV can facilitate passing ZVOL options (I don't think it can just yet). The only tuning I did on the storage class was the usual ZFS-level options.
-
My self-hosting infrastructure, fully automated
What do you use to provision Kubernetes persistent volumes on bare metal? I’m looking at open-ebs (https://openebs.io/).
Also, when you bump the image tag in a git commit for a given helm chart, how does that get deployed? Is it automatic, or do you manually run helm upgrade commands?
-
Jinja2 not formatting my text correctly. Any advice?
ListItem( 'Kubernetes', 'https://kubernetes.io/', 'Container Engines and Orchestration', """Kubernetes is an open-source container-orchestration system for automating computer application deployment, scaling, and management.""" ), ListItem( 'Podman', 'https://podman.io/', 'Container Engines and Orchestration', """Podman is a daemonless, open source, Linux native tool designed to make it easy to find, run, build, share and deploy applications using Open Containers Initiative (OCI) Containers and Container Images.""" ), # Data Storage :: Block Storage ListItem( 'Amazon EBS', 'https://aws.amazon.com/ebs/', 'Data Storage :: Block Storage', """Amazon Elastic Block Store (Amazon EBS) is an easy-to-use, scalable, high-performance block-storage service designed for Amazon Elastic Compute Cloud (Amazon EC2).""" ), ListItem( 'OpenEBS', 'https://openebs.io/', 'Data Storage :: Block Storage', """OpenESB is a Java-based open-source enterprise service bus. It allows you to integrate legacy systems, external and internal partners and new development in your Business Process.""" ), # Data Storage :: Cluster Storage ListItem( 'Ceph', 'https://ceph.io/en/', 'Data Storage :: Cluster Storage', """Ceph is an open-source software storage platform, implements object storage on a single distributed computer cluster, and provides 3-in-1 interfaces for object-, block- and file-level storage.""" ), ListItem( 'Hadoop Distributed File System', 'https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html', 'Data Storage :: Cluster Storage', """The Hadoop Distributed File System ( HDFS ) is a distributed file system designed to run on commodity hardware.""" ), # Data Storage :: Object Storage ListItem( 'Amazon S3', 'https://aws.amazon.com/s3/', 'Data Storage :: Object Storage', """Amazon S3 or Amazon Simple Storage Service is a service offered by Amazon Web Services that provides scalable object storage through a web service interface.""" )
-
Building a "complete" cluster locally
Ideas from my kubernetes experience: * Cert-Manager is very popular and almost a must-have if you terminate SSL inside the cluster * Backups using velero * A dashboard/UI is actually very helpful to quickly browse resources, client tools like k9s are fine too * Secret: Management: Bitnami Sealed Secrets is the second big project in that space * I would add Loki to aggregate Logs * Never heard of ory. Usually I see (dex)[https://dexidp.io/] or keycloak used for Authentication * I like to run OpenEBS as in-cluster storage. * Istio isn't compatible with the upcomming ServiceMeshInterface (i think), so the trend seem to go toward Linkerd * Some Operator to deploy your favorite Database, is also a nice learning exercise.
homelab
-
Fastest way to set up an k8s environment ?
K3s is great, I use it on all of my personal clusters (here and here). It's lightweight and very easy to manage.
-
Years unemployed. Managed to get a job and barely hanging on, feeling like treading water. Able to get back on meds soon. Hope things get better.
https://github.com/khuedoan/homelab if you haven't come across it yet. To add to your bookmarks.
-
Kubernetes home lab hardware and learning resources
I have my Kubernetes homelab public on GitHub, everything is automated and defined as code. Hope it will help you get started and see what's possible.
-
Kubernetes dev homelab & NAS
So I 've got inspired by https://github.com/khuedoan/homelab and initially after lurking this sub for a while I came up with a plan to consider some of these solutions: - openmediavault as a VM to use 2x4TB /w ext4 & mergerFS or TrueNAS in RAID1 - I think mergerFS gives more options to increase storage with extra drives later, but I don't plan to hoard lots of data. Also rather opted for tiered cache via SSD to save some power but if such lot of VMs would write this would work? - nextcloud VM to easiely manage files via browser and have mobile app sync for photos with some kind of gallery plugins etc - I think this may be optional if there's other solution as nextcloud seems to not be light. Or something like Seafile would be enough? - kubernetes - k3s/microk8s single VM node or 2 VM nodes - would I need more? and so - can then openmediavault be used as a storage for it like TrueNAS? - Rancher - if used k3s - I quite liked the UI of rancher desktop, more than portainer when I tried with microk8s, but I don't pass on using something else, eg. Lens - Gitea - for hosting code - tekton / teamcity - for running tests and commit build hooks - fluxCD / argoCD - for deploying builds to kubernetes
-
Managed to get these for free!
khuedoan/homelab
-
Homelab Kubernetes demo
Here's my project (running on 4 mini PC) that I'm using for learning and self-hosting https://github.com/khuedoan/homelab, it's fully automated from empty disk to operating services.
-
How Often Do You Fully Reconfigure Your Server, Down to the Operating System?
You can checkout my repo If you'd like to do the same for your homelab (it's also modular so you can just use the OS installation part)
-
What's the Best Wiki for a Self Hosted Home Lab?
Here're the links to the Markdown source and the web view.
-
Most enterprise like homelab options for learning
You can checkout my Kubernetes homelab, it's fully automated from empty disk, very customizable and extensible.
-
Automatically install Linux on all of your servers in parallel without touching them (one command)
You can view the code here: https://github.com/khuedoan/homelab (the ./metal folder)
What are some alternatives?
longhorn - Cloud-Native distributed storage built on and for Kubernetes
harvester - Open source hyperconverged infrastructure (HCI) software
democratic-csi - csi storage for container orchestration systems
netboot.xyz - Your favorite operating systems in one place. A network-based bootable operating system installer based on iPXE.
lvm-localpv - Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend LVM2 data storage stack.
devops-exercises - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
k3s - Lightweight Kubernetes
Netmaker - Netmaker makes networks with WireGuard. Netmaker automates fast, secure, and distributed virtual networks.
Mayastor - Dynamically provision Stateful Persistent Replicated Cluster-wide Fabric Volumes & Filesystems for Kubernetes that is provisioned from an optimized NVME SPDK backend data storage stack.
yunohost - YunoHost is an operating system aiming to simplify as much as possible the administration of a server. This repository corresponds to the core code, written mostly in Python and Bash.
rook - Storage Orchestration for Kubernetes
kubevirt - Kubernetes Virtualization API and runtime in order to define and manage virtual machines.