SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 high-availability Open-Source Projects
-
advanced-java
😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
thanos
Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
-
-
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
-
postgres-operator
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service. (by CrunchyData)
-
cloudnative-pg
CloudNativePG is a comprehensive platform designed to seamlessly manage PostgreSQL databases within Kubernetes environments, covering the entire operational lifecycle from initial deployment to ongoing maintenance
-
-
k3s-ansible
The easiest way to bootstrap a self-hosted High Availability Kubernetes cluster. A fully automated HA k3s etcd install with kube-vip, MetalLB, and more. Build. Destroy. Repeat. (by techno-tim)
-
MooseFS
MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
-
-
-
postgresql_cluster
PostgreSQL High-Availability Cluster (based on "Patroni" and DCS "etcd" or "consul"). Automating with Ansible.
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
When it came to deployment, I had several options, and I chose the hard way: deploying Kubernetes on bare metal nodes using KubeSpray. Troubleshooting bare metal Kubernetes deployments honed my skills in pinpointing issues. This hands-on experience provided a deep understanding of how each component, like the Control Plane, kubelet, Container Runtime, and scheduler, interacts to orchestrate containers.
Project mention: Looking for a way to remote in to K's of raspberry pi's... | /r/sysadmin | 2023-12-10Monitoring = netdata on each RPi https://www.netdata.cloud/ binded to the vpn interface being scraped into a prometeus thaons https://thanos.io/ setup with grafana to give management the Green all is good screens (very important).
Citus doesn't provide fault tolerance. Each shard is a monolithic PostgreSQL. To reduce downtime on failures, you can protect each shard with a standby database. As this is a complex configuration, Patroni can help. For this lab I'll use the Citus+Patroni docker-compose-citus.yml from https://github.com/zalando/patroni.git:
I'm looking forward to Longhorn[1] taking advantage of this technology.
[1]: https://github.com/longhorn/longhorn
There's one in the stolon repo.
Project mention: Tell HN: ZFS silent data corruption bugfix – my research results | news.ycombinator.com | 2023-12-06https://github.com/gluster/glusterfs/issues/894
And apparently apart from modern coreutils using that, it is mostly gentoo users hitting the bugs in lseek.
Project mention: HAProxy is not affected by the HTTP/2 Rapid Reset Attack (CVE-2023-44487) | news.ycombinator.com | 2023-10-11I wanted to try it out just now but hit a roadblock immediately - it cannot automatically obtain and maintain TLS certificates. You have to use an external client (e.g. acme.sh), set up a cron to check/renew them, and poke HAProxy to reload them if necessary. I'm way past doing this in 2023.
https://www.haproxy.com/blog/haproxy-and-let-s-encrypt
https://github.com/haproxy/haproxy/issues/1864
Project mention: No disk space crashloop but pod healthy · Issue #3788 · CrunchyData/postgres-operator | /r/Health2020 | 2023-12-09
My holiday project was doing another pass at my Homelab Kubernetes cluster, part of which involved switching to a proper operator to manage Postgres. Coincidentally, I setup cloudnative-pg (https://github.com/cloudnative-pg/cloudnative-pg) yesterday.
Project mention: Show HN: OSS PostgreSQL RDS with Supabase,PGML,Vector,Ha,PITR,Monitor,&100 Exts | news.ycombinator.com | 2023-09-24And the only extension activated (`CREATE EXTENSION`) by default is pg_repack.
The AGPLv3 is infected by the Grafana, MinIO and citus.
https://github.com/Vonng/pigsty/blob/master/docs/PGSQL-EXTEN...
They recently open sourced internal framework: https://github.com/userver-framework/userver
I deployed k3s to a test node using Techno Tim's k3s-ansible playbook.
Project mention: Why PostgreSQL High Availability Matters and How to Achieve It | news.ycombinator.com | 2023-06-14one of the solutions which made it pretty simple for us to run postgresql in a ha environment (mostly in k8s, but works standalone as well) is zalandos patroni: https://github.com/zalando/patroni it's really solid and worked for us for a few years already.
or for k8s their operator: https://github.com/zalando/postgres-operator (docker image: https://github.com/zalando/spilo) we've also tried other operators which were easier to get started, but they failed miserably (crunchyrolls operator is basically based on the zalando one)
Project mention: Automated Deployment of PostgreSQL Ha Clusters Anywhere | news.ycombinator.com | 2023-06-21Creating a robust and reliable database cluster is often fraught with challenges.A manual deployment process can be fraught with risks, particularly for those who lack extensive experience. Even minor errors in configuration can drastically affect your database's performance and stability.
Recognizing this intricacy, many businesses choose to use cloud-based managed databases. These services offer convenience but not without limitations. These drawbacks can include being tied to a specific cloud provider and limited direct access to the database server for adjustments. These constraints can hinder your ability to tune your system and perform thorough performance analyses.
In response to these challenges, we've developed a project to make this process easier and more efficient. This project uses automation to streamline the deployment of High-Availability PostgreSQL Clusters. By doing so, it helps mitigate the risks involved with manual configuration and speeds up the deployment process.
Our solution caters to various deployment environments. It allows you to establish your cluster either in your own data center or in the cloud, providing a robust database solution similar to managed databases, but with you retaining full control.
Explore the project here: https://github.com/vitabaks/postgresql_cluster
Promxy
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
high-availability related posts
- Libreactor: High performance, robust and secure event-driven Linux framework
- Libreactor: High performance generic event-driven framework for Linux
- Command-line Tools can be 235x Faster than your Hadoop Cluster (2014)
- Diskomator – NVMe-TCP at your fingertips
- Difference between snapshot-cleanup and snapshot-delete in Longhorn recurring job?
- Ask HN: Any of you run Kubernetes clusters in-house?
- Ask HN: Options for K8s On-Prem
-
A note from our sponsor - SaaSHub
www.saashub.com | 24 Apr 2024
Index
What are some of the best open-source high-availability projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | advanced-java | 74,203 |
| 2 | kubespray | 15,328 |
| 3 | thanos | 12,577 |
| 4 | patroni | 6,212 |
| 5 | longhorn | 5,568 |
| 6 | orchestrator | 5,485 |
| 7 | stolon | 4,525 |
| 8 | GlusterFS | 4,478 |
| 9 | haproxy | 4,445 |
| 10 | keepalived | 3,787 |
| 11 | postgres-operator | 3,719 |
| 12 | cloudnative-pg | 3,342 |
| 13 | pigsty | 2,723 |
| 14 | cote | 2,310 |
| 15 | userver | 2,194 |
| 16 | k3s-ansible | 2,054 |
| 17 | MooseFS | 1,583 |
| 18 | agola | 1,431 |
| 19 | spilo | 1,307 |
| 20 | postgresql_cluster | 1,268 |
| 21 | promxy | 1,065 |
| 22 | pg_auto_failover | 1,035 |
| 23 | lizardfs | 945 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com