jetstream
JetStream Utilities (by nats-io)
kafkacat
Generic command line non-JVM Apache Kafka producer and consumer [Moved to: https://github.com/edenhill/kcat] (by edenhill)
Our great sponsors
jetstream | kafkacat | |
---|---|---|
2 | 8 | |
428 | 3,573 | |
- | - | |
8.4 | 7.3 | |
almost 3 years ago | over 2 years ago | |
Dockerfile | C | |
Apache License 2.0 | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
jetstream
Posts with mentions or reviews of jetstream.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-07-20.
-
Centrifugo v4 released – with own WebSocket emulation layer, optimized client protocol, unified SDK behavior, experimental HTTP/3 and WebTransport support
Centrifugo can use Nats as PUB/SUB broker. I also tried to use Jetstream to implement Centrifugo history/recovery semantics – unfortunately Jetstream does not fit us very well as streams must be created over a separate call to admin API, and it's not possible to iterate/paginate over Jetstream streams to be suitable to current Centrifugo message history and recovery semantics (I asked about support for this – unfortunately the issue was closed and required API not implemented - https://github.com/nats-io/jetstream/issues/266, suggested solution is far from optimal for our use case).
- ZooKeeper-free Kafka is out. First Demo
kafkacat
Posts with mentions or reviews of kafkacat.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-05-10.
-
Build a data ingestion pipeline using Kafka, Flink, and CrateDB
To communicate with Kafka, you can use Kafkacat, a command-line tool that allows to produce and consume Kafka messages using a very simple syntax. It also allows you to view the topics' metadata.
-
Event Streaming Like it's 1978
Feels like you could get pretty far with kafkacat and a SQLite database.
- ZooKeeper-free Kafka is out. First Demo
-
Kafcat 0.1.1 release -- a cat for kafka
This is the second release version of Kafcat. Kafcat is a Rust fully async rewrite of kafkacat.
- Primeiros passos com Kafka - Parte 2
-
Spring Cloud Sleuth in action
Consume from the Kafka topic my.topic with kafkacat:
-
5 Things Every Apache Kafka Developer Should Know
From the code above, you can see that to process the headers, simply use the ConsumerRecord.headers() method to return the headers. In our example above, we’re printing the headers out to the console for demonstration purposes. Once you have access to the headers, you can process them as needed. For reading headers from the command line, KIP-431 adds support for optionally printing headers from the ConsoleConsumer, which will be available in the Apache Kafka 2.7.0 release.You can also use kafkacat to view headers from the command line. Here’s an example command:
-
Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
Note: In the example above, we have used kafkacat to consume the topics. The option -o-1 is used to only consume the latest message
What are some alternatives?
When comparing jetstream and kafkacat you can also consider the following projects:
Apache Kafka - Mirror of Apache Kafka
Docker Compose - Define and run multi-container applications with Docker
liftbridge - Lightweight, fault-tolerant message streams.
redpanda - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
kafcat - a rust port of kafkacat
Apache Pulsar - Apache Pulsar - distributed pub-sub messaging system
jepsen - A framework for distributed systems verification, with fault injection
java-pubsublite-kafka
styx - Simple, high-performance event streaming broker