kafka-connect-file-pulse
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka (by streamthoughts)
kafkacat
Generic command line non-JVM Apache Kafka producer and consumer [Moved to: https://github.com/edenhill/kcat] (by edenhill)
DISCONTINUED
Our great sponsors
| kafka-connect-file-pulse | kafkacat | |
|---|---|---|
| 3 | 8 | |
| 249 | 3,573 | |
| 4.8% | - | |
| 8.4 | 7.3 | |
| 12 days ago | over 1 year ago | |
| Java | C | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-connect-file-pulse
Posts with mentions or reviews of kafka-connect-file-pulse.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-01-05.
-
Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
Note : You can also install the connector either from GitHub Releases Page or from Confluent Hub.
This is the fourth and last article of the series "Streaming data into Kafka" series. In the first three articles, we saw how it's fairly easy to use Kafka Connect to load records from CSV, XML and JSON files into Apache Kafka without writing a single line of code. For doing this, we have used the Kafka Connect FilePulse connector which packs with a lot of nice features to parse and transform data.
kafkacat
Posts with mentions or reviews of kafkacat.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-05-10.
-
Build a data ingestion pipeline using Kafka, Flink, and CrateDB
To communicate with Kafka, you can use Kafkacat, a command-line tool that allows to produce and consume Kafka messages using a very simple syntax. It also allows you to view the topics' metadata.
-
Event Streaming Like it's 1978
Feels like you could get pretty far with kafkacat and a SQLite database.
- ZooKeeper-free Kafka is out. First Demo
-
Kafcat 0.1.1 release -- a cat for kafka
This is the second release version of Kafcat. Kafcat is a Rust fully async rewrite of kafkacat.
-
Spring Cloud Sleuth in action
Consume from the Kafka topic my.topic with kafkacat:
-
Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
Note: In the example above, we have used kafkacat to consume the topics. The option -o-1 is used to only consume the latest message
What are some alternatives?
When comparing kafka-connect-file-pulse and kafkacat you can also consider the following projects:
Docker Compose - Define and run multi-container applications with Docker
redpanda - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
kafcat - a rust port of kafkacat
jetstream - JetStream Utilities
Apache Kafka - Mirror of Apache Kafka
mongo-kafka - MongoDB Kafka Connector
java-pubsublite-kafka
kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector
kafka-connect-transform-xml - Transformation for converting XML data to Structured data.
kafka-connect-transform-grok - Grok Expression Transform for Kafka Connect.
zipkin - Zipkin is a distributed tracing system
styx - Simple, high-performance event streaming broker