Our great sponsors
-
pinot-debezium-basic-example
This is a basic Apache Pinot example for ingesting real-time MySQL change logs using Debezium
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
CDC Outbox pattern with MySQL, Debezium & Apache Pinot
For those of you that want to take a look at the CDC Outbox style pattern with QLDB and Kinesis, Matthew Lewis has created a demo available on github which highlights this process. It is also available as a running reference example that you can play around with at demo.qldbguide.com.
A pattern that has certainly grown a lot more popularity recently is the CDC outbox pattern which prescribes an outbox table where data can be streamed out to analytics and big data products such as Apache Pinot.