Top 23 K8 Open-Source Projects
OpenFaaS - Serverless Functions Made SimpleProject mention: Why we moved from Lambda to ECS | reddit.com/r/devops | 2021-04-20
OpenFaaS isn't something I was previous familiar with. Thanks for linking it! In your experience, does it come with much management overhead? Part of what makes Lambda/ECS so appealing is that you can throw a definition (code .zip file or container image) at AWS, and it just runs. With OpenFaaS, it looks like you need to maintain some additional infrastructure (a Kubernetes cluster) to get it working, and that'd give you one more thing to worry about.
Lightweight KubernetesProject mention: My first DevOps job interview Part 2 of 3 | dev.to | 2021-04-22
After creating the Dockerfile it was about setting up a Kubernetes cluster. Which program I use for this was up to me. In my DevOps with Kubernetes course we use k3d, this implements K3s in Docker. During the course I had not experienced any problems with this solution, so I was sure to use k3d to solve the assignments. Installing k3d on macOS is easy via Homebrew with brew install k3d. The cluster can then be created with k3d cluster create --port '8082:[email protected]' -p 8081:[email protected] --agents 2. The 8081:[email protected] will allow our apps to be accessible to us via localhost:8081.
Scout APM - Leading-edge performance monitoring starting at $39/month. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
🐶 Kubernetes CLI To Manage Your Clusters In Style!
eBPF-based Networking, Security, and ObservabilityProject mention: Gopher Gold #20 - Wed Nov 18 2020 | dev.to | 2020-11-17
cilium/cilium (Go): eBPF-based Networking, Security, and Observability
MicroK8s is a small, fast, single-package Kubernetes for developers, IoT and edge.Project mention: PIs for my Aunts birthday! She wants to make a Kubernetes cluster! Thought you guys might enjoy the packaging | reddit.com/r/RASPBERRY_PI_PROJECTS | 2021-04-19
I’ve been dabbling with microk8s and my pies, but have yet to find a real use case other than a better way to host a Minecraft bedrock server than just one pi. Microk8s is developed by Canonical and is a very light kubernetes alternative (technically I think it’s just a skeleton version). Just for anyone interested.
Official Python client library for kubernetes (by kubernetes-client)Project mention: My Journey With Spark On Kubernetes... In Python (3/3) | dev.to | 2021-04-12
Build and deploy docker images to Kubernetes using git push
bootstrap Kubernetes with k3s over SSH < 1 min 🚀Project mention: Raspberry Pi 3 questions about kubernetes | reddit.com/r/selfhosted | 2021-04-20
I used to run a k3s cluster using RPI 3 and it worked fine. I used https://github.com/alexellis/k3sup to install it (just requires SSH access to each node)
Online resources that will help you prepare for taking the CNCF CKA 2020 "Kubernetes Certified Administrator" Certification exam. with time, This is not likely the comprehensive up to date list - please make a pull request if there something that should be added here.Project mention: All about Kubernetes Certifications – CKA/CKAD/CKS | news.ycombinator.com | 2021-02-21
Machine Learning Platform for KubernetesProject mention: Open source alternative to AWS Sagemaker, Google AI Platform, and Azure ML | reddit.com/r/CKsTechNews | 2021-03-28
👀 A Kubernetes cluster resource sanitizerProject mention: If you had one wish for a K8s-related tool, what would it be? | reddit.com/r/kubernetes | 2021-04-18
Popeye can help with that
ClearML - Auto-Magical Suite of tools to streamline your ML workflow. Experiment Manager, ML-Ops and Data-ManagementProject mention: [D] What’s the simplest, most lightweight but complete and 100% open source MLOps toolkit? -> MY OWN CONCLUSIONS | reddit.com/r/MachineLearning | 2021-03-30
There are mainly two solutions that are 100% open source and free to install and use, and that may solve most of the requirements of ML practitioners: Hopsworks and ClearML. Among this two, if I had to chose one right now, it will be ClearML. Hopsworks might be much more complete, but ClearML seems to have a bigger community behind it and to be easier to install and use. So ClearML will be something to take a look at in case we go for an all-in-one package. I also like the idea of having a platform with an UI with all our projects.
Bulk port forwarding Kubernetes services for local development.Project mention: Using Telepresence 2 for Kubernetes debugging and local development | dev.to | 2021-04-15
Kubefwd works similar to Telepresence by making your local environment think it is inside the cluster. The networking tunnel is one direction only. Telepresence is much smarter as it also makes the other cluster applications think that your local app is inside the same cluster. So with Kubefwd you only get 50% of what basic Telepresence offers. Telepresence also has volume mounting support for more advanced scenarios.
A Kubernetes controller to watch changes in ConfigMap and Secrets and do rolling upgrades on Pods with their associated Deployment, StatefulSet, DaemonSet and DeploymentConfig – [✩Star] if you're using it! (by stakater)Project mention: Catch K8s Events Using Python Client When | reddit.com/r/kubernetes | 2020-12-29
Kata Containers version 1.x runtime (for version 2.x see https://github.com/kata-containers/kata-containers). (by kata-containers)
Kubernetes controller for OpenFaaSProject mention: Show HN: faas-netes – Kubernetes controller for OpenFaaS | news.ycombinator.com | 2021-01-03
Open Source Kubernetes MarketplaceProject mention: Guess how much RAM my Raspberry Pi K3s cluster has? | reddit.com/r/kubernetes | 2021-04-05
Take a look at arkade, it has dozens of apps that we've hand-picked because we know that they work well: https://github.com/alexellis/arkade
A Function as a Service tool makes a function as a container-based service in seconds. (by metrue)
:gorilla: Kong for Kubernetes: the official Ingress Controller for Kubernetes.Project mention: Using Kubernetes Ingress Controller as an API Gateway | dev.to | 2021-03-23
This article will walk through how easy it is to set up the open source Kong Ingress Controller as a Kubernetes API gateway on a cluster.
CDK is an open-sourced container penetration toolkit, offering stable exploitation in different slimmed containers without any OS dependency. It comes with penetration tools and many powerful PoCs/EXPs helps you to escape container and takeover K8s cluster easily.
An active monitoring software to detect failures before your customers do.Project mention: How Best to Monitor Incoming Traffic for the Health of Applications | reddit.com/r/sre | 2021-04-20
If your service might at times fall to almost zero requests outside business hours, having a synthetic client is a must. You can use Blackbox exporter as mentioned by u/SuperQue or CloudProber, both work well for simple cases (one step site check or API call), for anything more complicated (multi step scenarios) you are better off scripting it.
Kata Containers version 2.x repository. Kata Containers is an open source project and community working to build a standard implementation of lightweight Virtual Machines (VMs) that feel and perform like containers, but provide the workload isolation and security advantages of VMs. https://katacontainers.io/Project mention: Docker Without Docker | news.ycombinator.com | 2021-04-08
I'm really impressed by fly.io, and the candidness with which they share some of their really awesome technology. Being container-first is the next step for PaaS IMO and they are ahead of the pack.
I aim to build a platform like theirs someday (probably not any time soon) but I don't think I'd do any of what they're doing -- it feels unnecessary. Bear with me as I recently learned that they use nomad and some of these suggestions are kubernetes projects but I'd love to hear why the following technologies were decided against (if they were):
- kata-containers (it does the whole container -> VM flow for you, automatically, nemu, firecracker) with multiple VMM options
- linuxkit (let's say you didn't go with kata-containers, this is another container->VM path)
- firecracker-containerd (very minimal keep-your-container-but-run-it-as-a-VM)
- kubevirt (if you just want to actually run VMs, regardless of how you built them)
- Ceph for storage -- make LVM pools and just give them to Ceph, you'll get blocks, distributed filesystems (CephFS), and object gateways (S3/Swift) out of it (in the k8s space Rook manages this)
As an aside to all this, there's also LXD, which supports running "system" (user namespace isolated) containers, VMs (somewhat recent), live migration via criu, management/migration of underlying filesystems, runs on LVM or zfs, it's basically all-in-one, but does fall behind in terms of ecosystem since everyone else is aboard the "cloud native"/"works-with-kubernetes" train.
I've basically how I plan to run a service like fly.io if I ever did -- so maybe my secret is out, but I sure would like to know just how much of this fly.io got built on (if any of it), and/or what was turned down.
Ingress controller for Google CloudProject mention: InterSystems Kubernetes Operator Deep Dive: Part 2 | dev.to | 2021-03-13
Google supports its own ingress controller, GCE, which you can use in place of an nginx controller. However, it has some drawbacks, for instance, lack of rewrite rules support, at least at the moment of writing.
What are some of the best open-source K8 projects? This list will help you: