ksqlDB-GraphQL-poc
schema-registry
ksqlDB-GraphQL-poc | schema-registry | |
---|---|---|
1 | 7 | |
8 | 2,140 | |
- | 0.6% | |
0.0 | 10.0 | |
over 1 year ago | about 11 hours ago | |
Rust | Java | |
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ksqlDB-GraphQL-poc
-
confluent Schema Registry and Rust
In order to prepare for a future blog with Confluent I wanted to play around with ksqlDB, which was the perfect opportunity to use the Rust library in a less trivial way. As it turned out there is even a library for communicating with ksqlDB from rust, using the Rest API. The PoC project for this contains some code to put protobuf data on a topic.
schema-registry
-
JR, quality Random Data from the Command line, part I
So, is JR yet another faking library written in Go? Yes and no. JR indeed implements most of the APIs in fakerjs and Go fake it, but it's also able to stream data directly to stdout, Kafka, Redis and more (Elastic and MongoDB coming). JR can talk directly to Confluent Schema Registry, manage json-schema and Avro schemas, easily maintain coherence and referential integrity. If you need more than what is OOTB in JR, you can also easily pipe your data streams to other cli tools like kcat thanks to its flexibility.
- What tool do you use to document your Kafka messages format?
-
How to handle failing message in a topic with Avro schema?
Check here for more details. https://github.com/confluentinc/schema-registry
-
What is Schema Registry and How Does It Work? [Explained]
Confluent Schema Registry for Apache Kafka [GitHub]
-
Testing a Kafka consumer with Avro schema messages in your Spring Boot application with Testcontainers
So that means we can configure the Kafka producer and consumer with an imaginary schema registry url, that only needs to start with “mock://” and you automatically get to work with the MockSchemaRegistryClient. This way you don't need to explicitly initiate the MockSchemaRegistryClient and configure everything accordingly. That also eradicates the need for the Confluent Schema Registry Container. Running the Kafka Testcontainer with the embedded Zookeeper, we no longer need an extra Zookeeper container and we are down to one Testcontainer for the messaging. This way I ended up with only two Testcontainers: Kafka and the database.
-
confluent Schema Registry and Rust
Confluent is a company founded by the creators of Apache Kafka. They are providing the Confluent Platform which consists of several components, all based on Kafka. The license for these components vary. The Schema Registry has the community-license, which basically means it's free to use as long as you don't offer the Schema Registry itself as a SaaS solution. The source code can be found on Github.
-
An Overview About the Different Kafka Connect Plugins
Schema Registry from Confluent (GitHub) => http://localhost:8081/
What are some alternatives?
rust-rdkafka - A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
kafka-ui - Open-Source Web UI for Apache Kafka Management
obm_confluent_blog - Open Bank Mark as will be used for the Confluent Blog, with ssl and multiple types in the same topic.
kafdrop - Kafka Web UI
Protobuf - Protocol Buffers - Google's data interchange format
schema-registry-gitops - Manage Confluent Schema Registry subjects through Infrastructure as code
logos - Create ridiculously fast Lexers
rustfmt - Format Rust code
kafka-avro-without-registry - Test Spring Kafka application (using Avro as a serialization mechanism) without the need for Confluent Schema Registry
schema_registry_converter - A crate to convert bytes to something more useable and the other way around in a way Compatible with the Confluent Schema Registry. Supporting Avro, Protobuf, Json schema, and both async and blocking.