data-mesh-demo
schema-registry
data-mesh-demo | schema-registry | |
---|---|---|
1 | 7 | |
59 | 2,140 | |
- | 0.6% | |
4.9 | 10.0 | |
8 months ago | 1 day ago | |
Java | Java | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data-mesh-demo
-
The Definitive Guide to Building a Data Mesh with Event Streams
This prototype shows how a data mesh can work in practice. We encourage you to go try out the prototype, fork it for your own needs, and join us in our community if you have any questions.
schema-registry
-
JR, quality Random Data from the Command line, part I
So, is JR yet another faking library written in Go? Yes and no. JR indeed implements most of the APIs in fakerjs and Go fake it, but it's also able to stream data directly to stdout, Kafka, Redis and more (Elastic and MongoDB coming). JR can talk directly to Confluent Schema Registry, manage json-schema and Avro schemas, easily maintain coherence and referential integrity. If you need more than what is OOTB in JR, you can also easily pipe your data streams to other cli tools like kcat thanks to its flexibility.
- What tool do you use to document your Kafka messages format?
-
How to handle failing message in a topic with Avro schema?
Check here for more details. https://github.com/confluentinc/schema-registry
-
What is Schema Registry and How Does It Work? [Explained]
Confluent Schema Registry for Apache Kafka [GitHub]
-
Testing a Kafka consumer with Avro schema messages in your Spring Boot application with Testcontainers
So that means we can configure the Kafka producer and consumer with an imaginary schema registry url, that only needs to start with “mock://” and you automatically get to work with the MockSchemaRegistryClient. This way you don't need to explicitly initiate the MockSchemaRegistryClient and configure everything accordingly. That also eradicates the need for the Confluent Schema Registry Container. Running the Kafka Testcontainer with the embedded Zookeeper, we no longer need an extra Zookeeper container and we are down to one Testcontainer for the messaging. This way I ended up with only two Testcontainers: Kafka and the database.
-
confluent Schema Registry and Rust
Confluent is a company founded by the creators of Apache Kafka. They are providing the Confluent Platform which consists of several components, all based on Kafka. The license for these components vary. The Schema Registry has the community-license, which basically means it's free to use as long as you don't offer the Schema Registry itself as a SaaS solution. The source code can be found on Github.
-
An Overview About the Different Kafka Connect Plugins
Schema Registry from Confluent (GitHub) => http://localhost:8081/
What are some alternatives?
kafka-connect-jdbc - Kafka Connect connector for JDBC-compatible databases
kafka-ui - Open-Source Web UI for Apache Kafka Management
kafka-rest - Confluent REST Proxy for Kafka
kafdrop - Kafka Web UI
kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector
schema-registry-gitops - Manage Confluent Schema Registry subjects through Infrastructure as code
rust-rdkafka - A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
kafka-avro-without-registry - Test Spring Kafka application (using Avro as a serialization mechanism) without the need for Confluent Schema Registry
Protobuf - Protocol Buffers - Google's data interchange format
ksqlDB-GraphQL-poc - A fairly simple setup to show how ksqlDB can be used with GraphQL.
logos - Create ridiculously fast Lexers
OSCAL - Open Security Controls Assessment Language (OSCAL)