The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Java kafka-connect Projects
-
debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10They manage data in the application layer and your original data stays where it is. This way data consistency is no longer an issue as it was with streaming databases. You can use Change Data Capture (CDC) services like Debezium by directly connecting to your primary database, doing computational work, and saving the result back or sending real-time data to output streams.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
Project mention: Knative switchboard series, part 1. Setup Knative Eventing with Kafka from scratch, scale based on events volume, and monitor | dev.to | 2024-01-04
Knative dashboards together with Kafka's dashboards it sheds light on almost any aspect of what's going on in the system.
-
-
langstream
LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka. (by LangStream)
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
Project mention: Difficulty configuring log4j when deploying code as plugin for an app | /r/CodingHelp | 2023-10-27
I am working on a custom Kafka-Mongo sink connector (specifically, a custom WriteModelStrategy to be used with the official Mongo sink connector here: https://github.com/mongodb/mongo-kafka ). My code is not a standalone, executable Java application but rather a JAR that augments the functionality of another Java application.
-
kafka-connect-file-pulse
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Project mention: Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀 | /r/apachekafka | 2023-09-15 -
ksql-udf-deep-learning-mqtt-iot
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
-
Project mention: Show HN: Kafbat UI for Apache Kafka v1.0 is out | news.ycombinator.com | 2024-03-22
-
Project mention: Saving Kafka headers as mongo fields with mongo sink connector | /r/dotnet | 2023-07-15
But I get the following error: "MAP is not supported type", even though I'm sending as a string. Looking at the source code (https://github.com/jcustenborder/kafka-connect-transform-common/blob/master/src/main/java/com/github/jcustenborder/kafka/connect/transform/common/BaseTransformation.java) it blows at line 120, because it thinks it's Map type. I think the issue with this is because the header it not being correctly sent, because Azure EventHubs sends with Amqp protocol that adds a few bytes in the string...
-
Project mention: Dashdive (YC W23) – Track your cloud costs precisely | news.ycombinator.com | 2024-01-29
We actually use Kafka rather than Kinesis, although they're very similar. For writing to ClickHouse from Kafka, we use the ClickHouse Kafka sink connector: https://github.com/ClickHouse/clickhouse-kafka-connect.
-
-
-
-
kryptonite-for-kafka
Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project
-
-
Project mention: Bring Namespaces on Top of Kafka Brokers, Kafka Connect and Schema Registry | news.ycombinator.com | 2023-04-21
-
-
-
-
kafka-connect-quickstart
Example project to play around with Apache Kafka Connect. There are examples to develop and deploy Kafka Connect plugins (connectors, transforms, etc.) from a Java Maven project.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2024-03-22.
Java kafka-connect related posts
-
debezium VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023
- How the heck do I validate records with this kind of data??
- Difficulty configuring log4j when deploying code as plugin for an app
- Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀
- Managed Relational Databases with AWS RDS and Aurora
- Postgresql to hadoop in real time
- ClickHouse Advanced Tutorial: Apply CDC from MySQL to ClickHouse
-
A note from our sponsor - WorkOS
workos.com | 18 Apr 2024
Index
What are some of the best open-source kafka-connect projects in Java? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | debezium | 9,843 |
| 2 | kafka-ui | 8,416 |
| 3 | ksql | 5,803 |
| 4 | strimzi-kafka-operator | 4,445 |
| 5 | kafka-connect-elasticsearch | 744 |
| 6 | langstream | 351 |
| 7 | kcctl | 350 |
| 8 | mongo-kafka | 321 |
| 9 | kafka-connect-file-pulse | 305 |
| 10 | ksql-udf-deep-learning-mqtt-iot | 284 |
| 11 | kafka-ui | 266 |
| 12 | kafka-connect-transform-common | 145 |
| 13 | clickhouse-kafka-connect | 130 |
| 14 | kafka-connect-twitter | 126 |
| 15 | snowflake-kafka-connector | 121 |
| 16 | jdbc-connector-for-apache-kafka | 80 |
| 17 | kryptonite-for-kafka | 78 |
| 18 | gcs-connector-for-apache-kafka | 65 |
| 19 | ns4kafka | 64 |
| 20 | kafka-connect-cosmosdb | 45 |
| 21 | connor | 27 |
| 22 | kafka-connect-transform-xml | 22 |
| 23 | kafka-connect-quickstart | 22 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com