kafka-connect-file-pulse
kafkacat
Our great sponsors
kafka-connect-file-pulse | kafkacat | |
---|---|---|
4 | 8 | |
305 | 3,573 | |
2.3% | - | |
8.9 | 7.3 | |
16 days ago | over 2 years ago | |
Java | C | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-connect-file-pulse
- Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀
-
Download json and csv file from github repository with apache kafka
E.g., https://github.com/streamthoughts/kafka-connect-file-pulse
-
Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
Note : You can also install the connector either from GitHub Releases Page or from Confluent Hub.
kafkacat
-
Build a data ingestion pipeline using Kafka, Flink, and CrateDB
To communicate with Kafka, you can use Kafkacat, a command-line tool that allows to produce and consume Kafka messages using a very simple syntax. It also allows you to view the topics' metadata.
-
Event Streaming Like it's 1978
Feels like you could get pretty far with kafkacat and a SQLite database.
- ZooKeeper-free Kafka is out. First Demo
-
Kafcat 0.1.1 release -- a cat for kafka
This is the second release version of Kafcat. Kafcat is a Rust fully async rewrite of kafkacat.
- Primeiros passos com Kafka - Parte 2
-
Spring Cloud Sleuth in action
Consume from the Kafka topic my.topic with kafkacat:
-
5 Things Every Apache Kafka Developer Should Know
From the code above, you can see that to process the headers, simply use the ConsumerRecord.headers() method to return the headers. In our example above, we’re printing the headers out to the console for demonstration purposes. Once you have access to the headers, you can process them as needed. For reading headers from the command line, KIP-431 adds support for optionally printing headers from the ConsoleConsumer, which will be available in the Apache Kafka 2.7.0 release.You can also use kafkacat to view headers from the command line. Here’s an example command:
-
Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
Note: In the example above, we have used kafkacat to consume the topics. The option -o-1 is used to only consume the latest message
What are some alternatives?
mongo-kafka - MongoDB Kafka Connector
Docker Compose - Define and run multi-container applications with Docker
kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector
redpanda - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
kryptonite-for-kafka - Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project
kafcat - a rust port of kafkacat
kafka-connect-transform-xml - Transformation for converting XML data to Structured data.
Apache Kafka - Mirror of Apache Kafka
PretendYoureXyzzy - A web clone of the card game Cards Against Humanity.
jetstream - JetStream Utilities
kafka-connect-client - Java client library for Apache Kafka Connect REST Interface
java-pubsublite-kafka