jr
schema-registry
jr | schema-registry | |
---|---|---|
4 | 7 | |
114 | 2,141 | |
- | 0.7% | |
9.4 | 10.0 | |
about 2 months ago | 3 days ago | |
Go | Java | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jr
-
JR, quality Random Data from the Command line, part II
We have seen how to use JR in more advanced use cases, streaming quality random data with referential integrity. In the next part of this series, we will see how to use REST apis with JR. In the meanwhile, happy streaming!
- FLaNK Stack Weekly for 22 May 2023
-
JR, quality Random Data from the Command line, part I
Datagen is the de-facto standard to generate random data for Kafka. But customising what's generated is not something you can do in 30 seconds, and enabling compression is currently not an option with the managed connectors. So I decided to write a tool which you could use to easily start streaming random data to kafka in seconds, and that's why JR was born. With the help of some friends and colleagues we packed JR with a lot of features (and many more coming!)
schema-registry
-
JR, quality Random Data from the Command line, part I
So, is JR yet another faking library written in Go? Yes and no. JR indeed implements most of the APIs in fakerjs and Go fake it, but it's also able to stream data directly to stdout, Kafka, Redis and more (Elastic and MongoDB coming). JR can talk directly to Confluent Schema Registry, manage json-schema and Avro schemas, easily maintain coherence and referential integrity. If you need more than what is OOTB in JR, you can also easily pipe your data streams to other cli tools like kcat thanks to its flexibility.
- What tool do you use to document your Kafka messages format?
-
How to handle failing message in a topic with Avro schema?
Check here for more details. https://github.com/confluentinc/schema-registry
-
What is Schema Registry and How Does It Work? [Explained]
Confluent Schema Registry for Apache Kafka [GitHub]
-
Testing a Kafka consumer with Avro schema messages in your Spring Boot application with Testcontainers
So that means we can configure the Kafka producer and consumer with an imaginary schema registry url, that only needs to start with “mock://” and you automatically get to work with the MockSchemaRegistryClient. This way you don't need to explicitly initiate the MockSchemaRegistryClient and configure everything accordingly. That also eradicates the need for the Confluent Schema Registry Container. Running the Kafka Testcontainer with the embedded Zookeeper, we no longer need an extra Zookeeper container and we are down to one Testcontainer for the messaging. This way I ended up with only two Testcontainers: Kafka and the database.
-
confluent Schema Registry and Rust
Confluent is a company founded by the creators of Apache Kafka. They are providing the Confluent Platform which consists of several components, all based on Kafka. The license for these components vary. The Schema Registry has the community-license, which basically means it's free to use as long as you don't offer the Schema Registry itself as a SaaS solution. The source code can be found on Github.
-
An Overview About the Different Kafka Connect Plugins
Schema Registry from Confluent (GitHub) => http://localhost:8081/
What are some alternatives?
TornadoVM - TornadoVM: A practical and efficient heterogeneous programming framework for managed languages
kafka-ui - Open-Source Web UI for Apache Kafka Management
kcat - Generic command line non-JVM Apache Kafka producer and consumer
kafdrop - Kafka Web UI
docker-compose-viz - Docker compose graph visualization
schema-registry-gitops - Manage Confluent Schema Registry subjects through Infrastructure as code
junodb - JunoDB is PayPal's home-grown secure, consistent and highly available key-value store providing low, single digit millisecond, latency at any scale.
rust-rdkafka - A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
flink-statefun - Apache Flink Stateful Functions
kafka-avro-without-registry - Test Spring Kafka application (using Avro as a serialization mechanism) without the need for Confluent Schema Registry
schema-registry-statistics - Schema Registry Statistics Tool
Protobuf - Protocol Buffers - Google's data interchange format