Our great sponsors
-
gradle-avro-plugin
Discontinued A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
spring-cloud-stream-kafka-confluent-avro-schema-registry
🍀 Spring Cloud Stream Kafka & Confluent Avro Schema Registry
-
cp-all-in-one
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
In this demo, based on the schema-registry-confluent-avro-serializer sample, we will create three Spring Cloud Stream applications, one consumer and two producers, all of them using the Confluent Schema Registry Server and the Confluent Avro Serializers.
As we do not use maven like the schema-registry-confluent-avro-serializer sample, we cannot use the official avro-maven-plugin. We will use davidmc24/gradle-avro-plugin instead.
We will use a docker-compose.yml based on the one from confluent/cp-all-in-one both to run it locally and to execute the integration tests. From that configuration we will keep only the containers: zookeeper, broker, schema-registry and control-center.
We will use a docker-compose.yml based on the one from confluent/cp-all-in-one both to run it locally and to execute the integration tests. From that configuration we will keep only the containers: zookeeper, broker, schema-registry and control-center.
Just to keep it simple we will put the consumer and the two producers as modules of a gradle multi-module project, with a little help of spring initializr.
Related posts
- My local Kafka instance stuck in "auto leader balancing"
- Has anyone seen and handled this error successfully ? : /bin/sh^M: bad interpreter: No such file or directory
- How to use Kafka to stream files using three separate machines (one for the producer, one for the broker, and one for the broker)?
- Kafka Streams application doesn't start up
- Apache Kafka Using Docker