InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 9 Go Cdc Projects
-
peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Project mention: Go channels are bad and you should feel bad (2016) | news.ycombinator.com | 2025-04-13I'm guilty of this too https://github.com/PeerDB-io/peerdb/blob/d36da8bb2f4f6c1c821...
The inner channel is a poor man's future. Came up with this to have lua runtimes be able to process in parallel while maintaining ordering (A B C in, results of A B C out)
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
olake
Fastest open-source tool for replicating Databases to Data Lake in Open Table Formats like Apache Iceberg. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supporting Postgres, MongoDB and MySQL
Project mention: Debezium to olake.io – PhysicsWallah switch for CDC | news.ycombinator.com | 2025-04-30-> Automatic schema evolution: new MongoDB fields appear as nullable columns; complex sub-docs land as JSON strings you can parse later
-> Resumable, chunked full loads: a pod crash resumes instead of restarting
-> Runs as either a Kubernetes CronJob or an Airflow task; config is one YAML/JSON file.
Their stack in one line: MongoDB → OLake writer → Iceberg on S3 → Spark jobs → Trino / occasional Redshift, all orchestrated by Airflow and/or K8s.
Posting here because many of us still bolt Kafka onto CDC just to land files. If you only need Iceberg tables, a simpler path might exist now. Curious to hear others’ experiences with broker-less CDC tools.
(Disclaimer: I work on OLake and hosted the meetup, but the talk is purely technical.)
Check out github repo - https://github.com/datazip-inc/olake
-
transfer
Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.
-
-
Project mention: Pgcapture – CDC Framework for PostgreSQL in Golang | news.ycombinator.com | 2024-09-02
-
kuvasz-streamer
Kuvasz-Streamer is a Postgres-to-Postgres data consolidation and change data capture project.
Project mention: Kuvasz-streamer: open-source CDC for Postgres for low latency replication | news.ycombinator.com | 2025-01-03One will want to be cognizant of its AGPLv3 license https://github.com/kuvasz-io/kuvasz-streamer/blob/v1.19.2/LI...
-
Oh !
An ISC-licensed implementation of several Content-Defined Chunking algorithms in Golang at https://github.com/PlakarKorp/go-cdc-chunkers
Whenever you have redundant data you want to store / transfer, this library lets you perform fast content defined chunking
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
go-benchmarks
Comprehensive and reproducible benchmarks for Go developers and architects. (by skerkour)
-
Go Cdc discussion
Go Cdc related posts
-
Debezium to olake.io – PhysicsWallah switch for CDC
-
Partitioning in Apache Iceberg, Demo
-
Postgres dump to Apache Iceberg, OLake got one step closer
-
Support for Parquet writer to S3 and local storage in OLake
-
Pgcapture – CDC Framework for PostgreSQL in Golang
-
Neon – Serverless Postgres
-
A note from our sponsor - InfluxDB
www.influxdata.com | 10 Jul 2025
Index
What are some of the best open-source Cdc projects in Go? This list will help you:
# | Project | Stars |
---|---|---|
1 | peerdb | 2,579 |
2 | olake | 925 |
3 | transfer | 658 |
4 | tiflow | 438 |
5 | pgcapture | 269 |
6 | kuvasz-streamer | 133 |
7 | go-cdc-chunkers | 21 |
8 | go-benchmarks | 10 |
9 | imsy | 10 |