Go Replication

Open-source Go projects categorized as Replication
Edit details
Topics: #Golang #Database #Distributed Systems #Kubernetes #Postgresql
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 15 Go Replication Projects

  • seaweedfs

    SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

    Project mention: SeaweedFS vs JuiceFS | dev.to | 2023-02-16

    Both SeaweedFS and JuiceFS support external databases to store metadata . In terms of the supported databases, SeaweedFS supports up to 24 databases. Due to high requirements for database transactions (see below), JuiceFS supports 3 types of transactional databases, 10 in total.

  • litestream

    Streaming replication for SQLite.

    Project mention: SQLite: can it do automatic backups (web application with about 10 users)? | reddit.com/r/SQL | 2023-03-15

    Please look into litestream. It continuously backs up an SQLite database to another location (s3 bucket, azure blob storage, etc). The application doesn't have to do anything, just point litestream at the SQLite file and it just works.

  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • immudb

    immudb - immutable database based on zero trust, SQL and Key-Value, tamperproof, data change history

    Project mention: Was tun gegen den ganzen Papierkram? | reddit.com/r/de_EDV | 2023-02-15

  • orchestrator

    MySQL replication topology management and HA

  • cloudnative-pg

    CloudNativePG is a Kubernetes operator that covers the full lifecycle of a PostgreSQL database cluster with a primary/standby architecture, using native streaming replication

    Project mention: Can you create a Postgres Deployment with multiple replicas consuming to the same PV? | reddit.com/r/devops | 2022-11-28

    Another option would be https://github.com/cloudnative-pg/cloudnative-pg I got to see this talk at Kubecon last month that might be of use to you too -> https://www.youtube.com/watch?v=99uSJXkKpeI That talk is run in part by EDB, who are the company behind CloudNativePG, they are talking about their commercial offering, but the principle is the same.

  • zrepl

    One-stop ZFS backup & replication solution

    Project mention: Container Updating Strategies | reddit.com/r/selfhosted | 2022-12-31

  • adguardhome-sync

    🛡️ Synchronize AdGuard Home config to replicas

    Project mention: Multi AdGuard istances: redundancy and how to configure the network? (Unifi system) | reddit.com/r/homelab | 2023-03-13

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • pglogrepl

    PostgreSQL logical replication library for Go.

  • pgcapture

    A scalable Netflix DBLog implementation for PostgreSQL

    Project mention: Concurrency mutex patterns general question | reddit.com/r/golang | 2022-11-02

    Use Change Data Capture techniques to synchronize your replicas. This tool may help you if you are using PostgreSQL https://github.com/rueian/pgcapture

  • go-craq

    CRAQ (Chain Replication with Apportioned Queries) in Go

  • psql-streamer

    Stream database events from PostgreSQL to Kafka

  • transfer

    Real-time data replication from OLTP to OLAP dbs (by artie-labs)

    Project mention: Artie Transfer: Real time data replication from transactional databases to Snowflake | reddit.com/r/snowflake | 2023-01-20

  • rawkv

    Cloud-native distributed key-value database.

    Project mention: Running 2 web apps in one application using Go Routines | reddit.com/r/golang | 2023-01-30

    For example in a distributed database like this, each node of the database has to start one server listening to a port to serve database users’ requests to CRUD data, and start another server on a different port to serve data replication requests between nodes. And you want only one main function for the code running on each node, so using a goroutine like what you shared makes perfect sense.

  • binlog

    mysql binlog replication protocol in golang (by santhosh-tekuri)

  • imsy

    simple incremental pull of immutable large files

    Project mention: CDC File Transfer | news.ycombinator.com | 2023-01-08

    I did a similar thing a few years ago

    https://github.com/mkmik/imsy

    It's less sophisticated but it uses the same core idea and the implementation is super simple

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-03-15.

Go Replication related posts

Index

What are some of the best open-source Replication projects in Go? This list will help you:

Project Stars
1 seaweedfs 16,892
2 litestream 8,277
3 immudb 8,121
4 orchestrator 4,822
5 cloudnative-pg 1,093
6 zrepl 588
7 adguardhome-sync 353
8 pglogrepl 161
9 pgcapture 113
10 go-craq 109
11 psql-streamer 48
12 transfer 31
13 rawkv 12
14 binlog 8
15 imsy 8

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com