Java kafka-connect

Open-source Java projects categorized as kafka-connect

Top 23 Java kafka-connect Projects

  • debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  • Project mention: Choosing Between a Streaming Database and a Stream Processing Framework in Python | dev.to | 2024-02-10

    They manage data in the application layer and your original data stays where it is. This way data consistency is no longer an issue as it was with streaming databases. You can use Change Data Capture (CDC) services like Debezium by directly connecting to your primary database, doing computational work, and saving the result back or sending real-time data to output streams.

  • kafka-ui

    Open-Source Web UI for Apache Kafka Management

  • Project mention: FLaNK Stack Weekly 16 October 2023 | dev.to | 2023-10-17
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • ksql

    The database purpose-built for stream processing applications.

  • strimzi-kafka-operator

    Apache Kafka® running on Kubernetes

  • Project mention: Knative switchboard series, part 1. Setup Knative Eventing with Kafka from scratch, scale based on events volume, and monitor | dev.to | 2024-01-04

    Knative dashboards together with Kafka's dashboards it sheds light on almost any aspect of what's going on in the system.

  • kafka-connect-elasticsearch

    Kafka Connect Elasticsearch connector

  • langstream

    LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka. (by LangStream)

  • Project mention: FLaNK Stack Weekly 16 October 2023 | dev.to | 2023-10-17
  • kcctl

    A modern and intuitive command line client for Kafka Connect

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • mongo-kafka

    MongoDB Kafka Connector

  • Project mention: Difficulty configuring log4j when deploying code as plugin for an app | /r/CodingHelp | 2023-10-27

    I am working on a custom Kafka-Mongo sink connector (specifically, a custom WriteModelStrategy to be used with the official Mongo sink connector here: https://github.com/mongodb/mongo-kafka ). My code is not a standalone, executable Java application but rather a JAR that augments the functionality of another Java application.

  • kafka-connect-file-pulse

    🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

  • Project mention: Kafka Connect Filepulse 2.13.0 is now available! This version includes support for SFTP and Alibaba OSS. It also contains many bug fixes and improvements. 🚀 | /r/apachekafka | 2023-09-15
  • kafka-ui

    Open-Source Web UI for managing Apache Kafka clusters (by kafbat)

  • Project mention: Show HN: Kafbat UI for Apache Kafka v1.0 is out | news.ycombinator.com | 2024-03-22
  • ksql-udf-deep-learning-mqtt-iot

    Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

  • kafka-connect-transform-common

    Common Transforms for Kafka Connect.

  • Project mention: Saving Kafka headers as mongo fields with mongo sink connector | /r/dotnet | 2023-07-15

    But I get the following error: "MAP is not supported type", even though I'm sending as a string. Looking at the source code (https://github.com/jcustenborder/kafka-connect-transform-common/blob/master/src/main/java/com/github/jcustenborder/kafka/connect/transform/common/BaseTransformation.java) it blows at line 120, because it thinks it's Map type. I think the issue with this is because the header it not being correctly sent, because Azure EventHubs sends with Amqp protocol that adds a few bytes in the string...

  • clickhouse-kafka-connect

    ClickHouse Kafka Connector

  • Project mention: Dashdive (YC W23) – Track your cloud costs precisely | news.ycombinator.com | 2024-01-29

    We actually use Kafka rather than Kinesis, although they're very similar. For writing to ClickHouse from Kafka, we use the ClickHouse Kafka sink connector: https://github.com/ClickHouse/clickhouse-kafka-connect.

  • kafka-connect-twitter

    Kafka Connect connector to stream data in real time from Twitter.

  • snowflake-kafka-connector

    Snowflake Kafka Connector (Sink Connector)

  • jdbc-connector-for-apache-kafka

    Aiven's JDBC Sink and Source Connectors for Apache Kafka®

  • Project mention: FLaNK Stack Weekly for 14 Aug 2023 | dev.to | 2023-08-14
  • kryptonite-for-kafka

    Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project

  • gcs-connector-for-apache-kafka

    Aiven's GCS Sink Connector for Apache Kafka®

  • ns4kafka

    Ns4Kafka brings namespaces on top of Kafka brokers, Kafka Connect and Schema Registry.

  • Project mention: Bring Namespaces on Top of Kafka Brokers, Kafka Connect and Schema Registry | news.ycombinator.com | 2023-04-21
  • kafka-connect-cosmosdb

    Kafka Connect connectors for Azure Cosmos DB

  • connor

    A commandline tool for resetting Kafka Connect source connector offsets. (by helpermethod)

  • kafka-connect-quickstart

    Example project to play around with Apache Kafka Connect. There are examples to develop and deploy Kafka Connect plugins (connectors, transforms, etc.) from a Java Maven project.

  • kafka-connect-transform-xml

    Transformation for converting XML data to Structured data.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-22.

Java kafka-connect related posts

Index

What are some of the best open-source kafka-connect projects in Java? This list will help you:

Project Stars
1 debezium 9,843
2 kafka-ui 8,458
3 ksql 5,811
4 strimzi-kafka-operator 4,445
5 kafka-connect-elasticsearch 744
6 langstream 351
7 kcctl 350
8 mongo-kafka 321
9 kafka-connect-file-pulse 305
10 kafka-ui 291
11 ksql-udf-deep-learning-mqtt-iot 284
12 kafka-connect-transform-common 145
13 clickhouse-kafka-connect 130
14 kafka-connect-twitter 126
15 snowflake-kafka-connector 122
16 jdbc-connector-for-apache-kafka 80
17 kryptonite-for-kafka 78
18 gcs-connector-for-apache-kafka 65
19 ns4kafka 64
20 kafka-connect-cosmosdb 45
21 connor 27
22 kafka-connect-quickstart 23
23 kafka-connect-transform-xml 22

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com