Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Top 15 Go Replication Projects
-
seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Both SeaweedFS and JuiceFS support external databases to store metadata . In terms of the supported databases, SeaweedFS supports up to 24 databases. Due to high requirements for database transactions (see below), JuiceFS supports 3 types of transactional databases, 10 in total.
-
Project mention: SQLite: can it do automatic backups (web application with about 10 users)? | reddit.com/r/SQL | 2023-03-15
Please look into litestream. It continuously backs up an SQLite database to another location (s3 bucket, azure blob storage, etc). The application doesn't have to do anything, just point litestream at the SQLite file and it just works.
-
InfluxDB
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
-
immudb
immudb - immutable database based on zero trust, SQL and Key-Value, tamperproof, data change history
-
-
cloudnative-pg
CloudNativePG is a Kubernetes operator that covers the full lifecycle of a PostgreSQL database cluster with a primary/standby architecture, using native streaming replication
Project mention: Can you create a Postgres Deployment with multiple replicas consuming to the same PV? | reddit.com/r/devops | 2022-11-28Another option would be https://github.com/cloudnative-pg/cloudnative-pg I got to see this talk at Kubecon last month that might be of use to you too -> https://www.youtube.com/watch?v=99uSJXkKpeI That talk is run in part by EDB, who are the company behind CloudNativePG, they are talking about their commercial offering, but the principle is the same.
-
-
Project mention: Multi AdGuard istances: redundancy and how to configure the network? (Unifi system) | reddit.com/r/homelab | 2023-03-13
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
-
Use Change Data Capture techniques to synchronize your replicas. This tool may help you if you are using PostgreSQL https://github.com/rueian/pgcapture
-
-
-
Project mention: Artie Transfer: Real time data replication from transactional databases to Snowflake | reddit.com/r/snowflake | 2023-01-20
-
Project mention: Running 2 web apps in one application using Go Routines | reddit.com/r/golang | 2023-01-30
For example in a distributed database like this, each node of the database has to start one server listening to a port to serve database users’ requests to CRUD data, and start another server on a different port to serve data replication requests between nodes. And you want only one main function for the code running on each node, so using a goroutine like what you shared makes perfect sense.
-
-
I did a similar thing a few years ago
It's less sophisticated but it uses the same core idea and the implementation is super simple
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Go Replication related posts
- Sqlite 'doesn't do automatic backups'? Is this true?
- SQLite: can it do automatic backups (web application with about 10 users)?
- Multi AdGuard istances: redundancy and how to configure the network? (Unifi system)
- Firewalla Gold + PiHole/AdGuard Home
- Load balancer/Fail over AdGuard
- Litestream is awesome for backing up sqlite databases
- An experimental high-concurrency backend for SQLite
-
A note from our sponsor - InfluxDB
www.influxdata.com | 26 Mar 2023
Index
What are some of the best open-source Replication projects in Go? This list will help you:
Project | Stars | |
---|---|---|
1 | seaweedfs | 16,892 |
2 | litestream | 8,277 |
3 | immudb | 8,121 |
4 | orchestrator | 4,822 |
5 | cloudnative-pg | 1,093 |
6 | zrepl | 588 |
7 | adguardhome-sync | 353 |
8 | pglogrepl | 161 |
9 | pgcapture | 113 |
10 | go-craq | 109 |
11 | psql-streamer | 48 |
12 | transfer | 31 |
13 | rawkv | 12 |
14 | binlog | 8 |
15 | imsy | 8 |