SQLedge: Replicate Postgres to SQLite on the Edge

1. sqledge

   1 4 1,017 3.8 Go

   Replicate postgres to SQLite on the edge

   

   It's nice to see another pg proxy using the pgx parser (their src[1]) - I built one using this lib too. However, this implementation is missing a lot of low level features to be considered close to compatible, including: multi-query transactions, auth, TLS, extended query mode, query cancellation.

   [1]: https://github.com/zknill/sqledge/blob/main/pkg/pgwire/postg...

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. ctlstore

   2 3 268 0.8 Go

   Control Data Store

   

   We replicated our MySQL database to a SQLite edge at Segment in ctlstore: https://github.com/segmentio/ctlstore

   We considered tailing binlogs directly but there's so much cruft and complexity involved trying to translate between types and such at that end, once you even just get passed properly parsing the binlogs and maintaining the replication connection. Then you have to deal with schema management across both systems too. Similar sets of problems using PostgreSQL as a source of truth.

   In the end we decided just to wrap the whole thing up and abstract away the schema with a common set of types and a limited set of read APIs. Biggest missing piece I regret not getting in was support for secondary indexes.

4. marmot

   3 34 1,942 6.5 Go

   A distributed SQLite replicator built on top of NATS

   

   Very interesting! I have question ( out of my experience in https://github.com/maxpert/marmot ) how do get around the boot time, specially when a change log of table is pretty large in Postgres? I've implemented snapshotting mechanism in Marmot as part of quickly getting up to speed. At some level I wonder if we can just feed this PG replication log into NATS cluster and Marmot can just replicate it across the board.

5. litefs

   4 40 4,193 2.9 Go

   FUSE-based file system for replicating SQLite databases across a cluster of machines

   

6. dolt

   5 95 18,204 10.0 Go

   Dolt – Git for Data

   

7. libpg_query

   6 15 1,227 8.6 C

   C library for accessing the PostgreSQL parser outside of the server environment

   

8. postlite

   7 18 1,190 0.0 Go

   Discontinued Postgres wire compatible SQLite proxy.

9. awesome-db-tools

   8 18 4,319 5.7

   Everything that makes working with databases easier

   

Suggest a related project