SaaSHub helps you find the best software and product alternatives Learn more →
Top 16 Go Replication Projects
-
seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
> When it gets too out of hand, people will paper it over with a new, simpler abstraction layer, and the process starts again, only with a layer of garbage spaghetti underneath.
I'm pretty happy that there are S3 compatible stores that you can host yourself, that aren't insanely complex.
MinIO: https://min.io/
SeaweedFS: https://github.com/seaweedfs/seaweedfs (this one's particularly nice and is permissively licensed, in contrast to everything else)
There was also Zenko, but I don't think they gained a lot of traction for the most part: https://www.zenko.io/
Of course, many will prefer hosted/managed solutions and that's perfectly fine, but at least when you run software yourself, you are more in control over it and for the most part can also make the judgement on how hard it is to operate and keep operational (e.g. similar to what you'd experience when running PostgreSQL/MariaDB/MySQL or trying to run Oracle).
-
InfluxDB
Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.
-
Project mention: Why SQLite Is Taking over with Brian Holt and Marco Bambini | news.ycombinator.com | 2024-06-12
As hruk pointed out, you can use docker volumes to solve for this. However, you can also ship multiple DBs depending on your use-case. If it's a shared DB, it's probably not a great idea for micro-services. But if you're building a majestic monolith, there's few reasons NOT to go with SQLite. Especially paired with litestream[0].
0: https://litestream.io/
-
-
cloudnative-pg
CloudNativePG is a comprehensive platform designed to seamlessly manage PostgreSQL databases within Kubernetes environments, covering the entire operational lifecycle from initial deployment to ongoing maintenance
Project mention: Data on Kubernetes: Part 2 - Deploying Databases in K8s with PostgreSQL, CloudNative-PG, and Ceph Rook on Amazon EKS | dev.to | 2024-07-15In this blog post, we'll explore how to combine CloudNative-PG (a PostgreSQL operator) and Ceph Rook (a storage orchestrator) to create a PostgreSQL cluster that scales easily, recovers from failures, and ensures data persistence - all within an Amazon Elastic Kubernetes Service EKS cluster.
-
If you're willing to accept eventual consistency (a big ask, but acceptable in some scenarios) then there are options like marmot [1] that replicate cdc over nats.
[1]: https://github.com/maxpert/marmot
-
-
Project mention: Technitium DNS Server: Self host a DNS server for privacy and security | news.ycombinator.com | 2024-01-16
This is my only gripe as compared to AdGuard Home.
However, Technitium is miles ahead in terms of raw customization. One such example is synchronizing DNS servers. Unlike AdGuard Home you have to resort to an additional app [1], with technitium you do proper NS transfer [2].
[2] https://github.com/bakito/adguardhome-sync
[1] https://reddit.com/comments/s91oo5/comment/htk9jnt
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
The current implementation of the webhook notifier will call the webhook URL at most once. There's no real reason for it beyond it being a first iteration of the webhook output plugin. I've created an issue in the repo to support retries , since this is a valuable feature (https://github.com/xataio/pgstream/issues/67).
Worth mentioning that the retry strategy is defined on a processor level. The opensearch indexer for instance does handle retries, making it "at least once" delivery.
Thanks for your feedback!
-
Project mention: Pgcapture – CDC Framework for PostgreSQL in Golang | news.ycombinator.com | 2024-09-02
-
-
-
kivi
Dynamo-inspired distributed leader-less key-value database that has no unique features and no apparent reason to exist
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Go Replication discussion
Go Replication related posts
-
Introducing pgstream: Postgres replication with DDL changes
-
Pgstream – Postgres replication that includes schema definitions
-
Pgstream – Postgres replication events with schema changes
-
Data on Kubernetes: Part 2 - Deploying Databases in K8s with PostgreSQL, CloudNative-PG, and Ceph Rook on Amazon EKS
-
Why SQLite Is Taking over with Brian Holt and Marco Bambini
-
Uber Migrates 1T Records from DynamoDB to LedgerStore to Save $6M Annually
-
Distributed SQLite: Paradigm shift or hype?
-
A note from our sponsor - SaaSHub
www.saashub.com | 17 Sep 2024
Index
What are some of the best open-source Replication projects in Go? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | seaweedfs | 22,288 |
| 2 | litestream | 10,667 |
| 3 | orchestrator | 5,602 |
| 4 | cloudnative-pg | 4,220 |
| 5 | marmot | 1,781 |
| 6 | zrepl | 932 |
| 7 | adguardhome-sync | 831 |
| 8 | pglogrepl | 319 |
| 9 | pgstream | 257 |
| 10 | pgcapture | 214 |
| 11 | go-craq | 121 |
| 12 | psql-streamer | 58 |
| 13 | kivi | 40 |
| 14 | rawkv | 11 |
| 15 | imsy | 8 |
| 16 | binlog | 8 |
Sponsored
Purpose built for real-time analytics at any scale.
InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.
www.influxdata.com