Stream MySQL changes

• debezium

  80 9,843 9.9 Java

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  

  If capturing the changes that occur on a database, and writing those changes elsewhere is what you want, then take a look at https://debezium.io/

• go-mysql

  1 4,410 7.6 Go

  a powerful mysql toolset with Go

  

  I like maxwell but I've used this as well. https://github.com/go-mysql-org/go-mysql

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• autobahn-binlog

  1 58 10.0 Go

  A Go package for tailing MySQL v5.5.x binary replication streams.

  

  You want to use the MySQL binlog. It’s basically an internal MySQL table/log of all changes to the db. You can set up a connector to pull changes from the binlog and push it into Kafka or pubsub or whatever you want. Here’s an example package that does this https://github.com/vsco/autobahn-binlog

Suggest a related project