Our great sponsors
-
debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
These read-replicas leveraged WAL segments created by the primary database; however, we didn’t want to bog down the primary database with each replica by reading directly from production. To circumvent this issue, we leverage wal-e, a tool that performs continuous archiving of PostgreSQL WAL files and base backups, and read replicas restored from s3 or gcs versus reading directly from the primary database.
The solution that we use for snapshotting our data is a streaming change data capture (CDC) solution using Debezium that leverages our existing Kafka Infrastructure using Kafka Connect.
Related posts
- Duplicity
-
debezium VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023
- Home backup solution?
- Ask HN: How do you do backups for personal/home server?
- Are stupid database questions allowed? If a database is backed up only every hour, do we just lose the unbacked up data within the one hour time frame?