Java kafka-connect

Open-source Java projects categorized as kafka-connect Edit details

Top 16 Java kafka-connect Projects

  • debezium

    Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

    Project mention: node good for handling non stopping coming datas ? | reddit.com/r/node | 2022-09-27
  • ksql

    The database purpose-built for stream processing applications.

    Project mention: PranaDB | news.ycombinator.com | 2022-04-28
  • talent.io

    Download talent.io’s Tech Salary Report. Median salaries, most in-demand technologies, state of the remote work... all you need to know your worth on the market by tech recruitment platform talent.io

  • strimzi-kafka-operator

    Apache Kafka® running on Kubernetes

    Project mention: Prometheus Additional Scrape Config node metrics limitation | reddit.com/r/PrometheusMonitoring | 2022-07-21

    But I encountered a problem. In the example files they provide prometheus-additional.yaml file which is referred to in prometheus.yaml as additionalScrapeConfigs field. It collects Kubernetes node metrics for which it has panels in example Grafana dashboards. All good. But the problem is, the prometheus-additional.yaml file has a field called namespaces: names: [] (File can be seen here - https://github.com/strimzi/strimzi-kafka-operator/blob/main/examples/metrics/prometheus-additional-properties/prometheus-additional.yaml) in kubernetes_sd_configs.

  • kafka-connect-elasticsearch

    Kafka Connect Elasticsearch connector

  • mongo-kafka

    MongoDB Kafka Connector

    Project mention: Database Replication using CDC | dev.to | 2021-10-05

    To create a connection between MongoDB and Apache Kafka, MongoDB has build official framework MongoDB Kafka Connector.

  • ksql-udf-deep-learning-mqtt-iot

    Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data

  • kcctl

    A modern and intuitive command line client for Kafka Connect

  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • kafka-connect-file-pulse

    🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka

  • kafka-connect-twitter

    Kafka Connect connector to stream data in real time from Twitter.

    Project mention: A few starter questions: What is a good setup for learning? Is Confluent platform ok? | reddit.com/r/apachekafka | 2022-02-13

    I'm reading O'Reilly's "Mastering Kafka Streams and ksqlDB" to start learning Kafka, it was suggested for me on an ad by Confluent. Unsurprisingly it uses Confluent's software throughout the book. One of the first projects is a simple app that does sentiment analysis on tweets. The book uses kafka-console-producer and a sample .json file for the tweets, but for my app I wanted to read actual tweets. To do that I've been reading about Kafka Connect and looking at this repository, but I'm having a hard time understating how to best deploy this for my local setup. So far I've been using docker-compose.yml files provided by the book, which in turn uses Confluent's docker images for kafka, zookeeper, etc. As for this Twitter Connect repository, it seems the recommended way of setting it up is to use Confluent's platform and its CLI tool to automagically install it, which is fine, but I wanted to learn how things work under the hood (to some extend) and if possible not rely so heavily upon Confluent's software. Is it a good idea to just stick with Confluent and the book, or should I be reading a different material for a first Kafka project and working with a different kind of setup? Perhaps I'm getting ahead of myself trying to use Kafka Connect at this point?

  • snowflake-kafka-connector

    Snowflake Kafka Connector (Sink Connector)

    Project mention: Snowflake Kafka Connector 1.7.0 supports EXACTLY_ONCE | reddit.com/r/snowflake | 2022-01-14
  • kryptonite-for-kafka

    Kryptonite for Kafka is a client-side 🔒 field level 🔓 crypto library for Apache Kafka® currently focused on Kafka Connect data integration use cases and ksqlDB stream processing scenarios. It's an ! UNOFFICIAL ! community project

  • kafka-connect-cosmosdb

    Kafka Connect connectors for Azure Cosmos DB

    Project mention: Critical New 0-day Vulnerability in Popular Log4j Library - List of applications | dev.to | 2021-12-13

    Kafka Connect CosmosDB : https://github.com/microsoft/kafka-connect-cosmosdb/blob/0f5d0c9dbf2812400bb480d1ff0672dfa6bb56f0/CHANGELOG.md

  • kafka-connect-transform-xml

    Transformation for converting XML data to Structured data.

  • connor

    A commandline tool for resetting Kafka Connect source connector offsets. (by helpermethod)

    Project mention: Spring Boot 2.6.2 on Raspberry Pi 4 | dev.to | 2022-01-17

    ~$ sudo apt -q install zip ~$ curl -s "https://get.sdkman.io" | bash ~$ source "$HOME/.sdkman/bin/sdkman-init.sh" ~$ sdk version ~$ ==== BROADCAST ================================================================= * 2022-01-06: connor 1.2.1 available on SDKMAN! https://github.com/helpermethod/connor/releases/tag/v1.2.1 * 2022-01-04: micronaut 3.2.4 available on SDKMAN! * 2022-01-02: jbang 0.86.0 available on SDKMAN! https://github.com/jbangdev/jbang/releases/tag/v0.86.0 ================================================================================ SDKMAN 5.13.1 ~$

  • kafka-connect-quickstart

    Example project to play around with Apache Kafka Connect. There are examples to develop and deploy Kafka Connect plugins (connectors, transforms, etc.) from a Java Maven project.

  • kafka-connect-client

    Java client library for Apache Kafka Connect REST Interface

  • Scout APM

    Truly a developer’s best friend. Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-09-27.

Java kafka-connect related posts

Index

What are some of the best open-source kafka-connect projects in Java? This list will help you:

Project Stars
1 debezium 7,528
2 ksql 5,204
3 strimzi-kafka-operator 3,449
4 kafka-connect-elasticsearch 667
5 mongo-kafka 275
6 ksql-udf-deep-learning-mqtt-iot 258
7 kcctl 232
8 kafka-connect-file-pulse 220
9 kafka-connect-twitter 121
10 snowflake-kafka-connector 83
11 kryptonite-for-kafka 38
12 kafka-connect-cosmosdb 27
13 kafka-connect-transform-xml 19
14 connor 19
15 kafka-connect-quickstart 12
16 kafka-connect-client 7
Find remote jobs at our new job board 99remotejobs.com. There are 5 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
Truly a developer’s best friend
Scout APM is great for developers who want to find and fix performance issues in their applications. With Scout, we'll take care of the bugs so you can focus on building great things 🚀.
scoutapm.com