kafka-connect-jdbc
Kafka Connect connector for JDBC-compatible databases (by confluentinc)
kafdrop
Kafka Web UI (by obsidiandynamics)
Our great sponsors
| kafka-connect-jdbc | kafdrop | |
|---|---|---|
| 2 | 10 | |
| 888 | 4,269 | |
| 1.1% | 1.3% | |
| 8.4 | 5.8 | |
| 8 days ago | 13 days ago | |
| Java | Java | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-connect-jdbc
Posts with mentions or reviews of kafka-connect-jdbc.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-08-31.
-
How Sendoso is using Kafka for Event-Driven Architecture
Event sourcing is an effective architectural pattern to record changes to the application state. Event sequence is important - we need changes as they were originally applied. incoming events are first persisted into Kafka and then processed by services independently. Kafka, hence, becomes our source of truth (SOT), a data source that gives a complete picture of the data object as a whole. This, however, meant dramatic changes in our core application. Our source of truth is still the core database, but we generate events in Kafka when data gets persisted. To ensure transactional behavior, we employed Transactional Outbox pattern. Essentially, we a) created a new events table in the database, b) wrote event data in the same transaction when we update our SOT table. Kafka Connect is subsequently used to read this table and insert records in relevant Kafka topics. This ensures that we never have an inconsistent situation where data was inserted in the database but the event is not added to Kafka topic or vice versa. We evaluated a few connectors for sourcing data from Mysql (JdbcSourceConnector, and Debezium). Our scenario was supported out of the box in JdbcSourceConnector, making it possible to have one event table in Mysql where different rows could be routed to a relevant topic based on the topic field.
-
Data Pipeline between PostgreSQL and Cassandra using Kafka Connect
This is different compared to the "polling" technique adopted by the Kafka Connect JDBC connector
kafdrop
Posts with mentions or reviews of kafdrop.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-30.
-
Getting Started as a Kafka Developer
Kafdrop - https://github.com/obsidiandynamics/kafdrop
-
UI for Serverless AWS MSK (Kafka)
No mentions, and 1 open issue with a question 2) Kafka Drop https://github.com/obsidiandynamics/kafdrop
-
What kind of monitoring tools are people using for their Kafka Deployment?
- https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)
Kafdrop (https://github.com/obsidiandynamics/kafdrop) is very popular and pretty solid. I'd start there. Kafka itself also comes with some cli tools and you can also extract metrics out of it via JMX/jolokia.
-
How Sendoso is using Kafka for Event-Driven Architecture
Kafdrop
-
Go, Kafka, gRPC and MongoDB microservice with metrics and tracing 👋
Good kafka docker setup with enclouded UI is confluent, but it's had huge images size and will download a half of world wide internet to your local pc.🤖 For this reason here as UI client i used kafdrop
-
An Overview About the Different Kafka Connect Plugins
Kafdrop from Obsidian Dynamics (GitHub) => http://localhost:8082/
What are some alternatives?
When comparing kafka-connect-jdbc and kafdrop you can also consider the following projects:
kafka-ui - Open-Source Web UI for Apache Kafka Management
akhq - Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
schema-registry - Confluent Schema Registry for Kafka
aws-eks-kubernetes-masterclass - AWS EKS Kubernetes - Masterclass | DevOps, Microservices
kafka-connect-quickstart - Example project to play around with Apache Kafka Connect. There are examples to develop and deploy Kafka Connect plugins (connectors, transforms, etc.) from a Java Maven project.
Kouncil - Powerful dashboard for your Kafka. Monitor status, manage groups, topics, send messages and diagnose problems. All in one user friendly web dashboard.
kafka-connect-ui - Web tool for Kafka Connect |
kafka-go - Kafka library in Go
nri-prometheus - Fetch metrics in the Prometheus metrics inside or outside Kubernetes and send them to the New Relic Metrics platform.
kafka-manager - CMAK is a tool for managing Apache Kafka clusters
sarama - Sarama is a Go library for Apache Kafka.