kafka-rest
kafka-connect-jdbc
kafka-rest | kafka-connect-jdbc | |
---|---|---|
3 | 2 | |
2,223 | 1,000 | |
0.6% | 0.2% | |
9.0 | 6.8 | |
6 days ago | 4 days ago | |
Java | Java | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-rest
-
How are events actually published to kafka?
There is a REST API Producer for Kafka - https://github.com/confluentinc/kafka-rest - which can take HTTP API requests and put them into a Kafka topic for you.
-
Kafka Rest API vs client library
When you say the Rest API, are you referring to the Confluent REST Proxy?
-
Why does Kafka use long-polling instead of websockets?
Maybe you're referring to kafka-rest and http based long polling? Nevertheless, the reason linked in the other comment is still the same.
kafka-connect-jdbc
-
How Sendoso is using Kafka for Event-Driven Architecture
Event sourcing is an effective architectural pattern to record changes to the application state. Event sequence is important - we need changes as they were originally applied. incoming events are first persisted into Kafka and then processed by services independently. Kafka, hence, becomes our source of truth (SOT), a data source that gives a complete picture of the data object as a whole. This, however, meant dramatic changes in our core application. Our source of truth is still the core database, but we generate events in Kafka when data gets persisted. To ensure transactional behavior, we employed Transactional Outbox pattern. Essentially, we a) created a new events table in the database, b) wrote event data in the same transaction when we update our SOT table. Kafka Connect is subsequently used to read this table and insert records in relevant Kafka topics. This ensures that we never have an inconsistent situation where data was inserted in the database but the event is not added to Kafka topic or vice versa. We evaluated a few connectors for sourcing data from Mysql (JdbcSourceConnector, and Debezium). Our scenario was supported out of the box in JdbcSourceConnector, making it possible to have one event table in Mysql where different rows could be routed to a relevant topic based on the topic field.
-
Data Pipeline between PostgreSQL and Cassandra using Kafka Connect
This is different compared to the "polling" technique adopted by the Kafka Connect JDBC connector
What are some alternatives?
examples - Apache Kafka and Confluent Platform examples and demos
firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
Apache Kafka - Mirror of Apache Kafka
nri-prometheus - Fetch metrics in the Prometheus metrics inside or outside Kubernetes and send them to the New Relic Metrics platform.
ksql-udf-deep-learning-mqtt-iot - Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector
fast-data-dev - Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors
kafdrop - Kafka Web UI
schema-registry - Confluent Schema Registry for Kafka
cosmosdb-cassandra-kafka
ns4kafka - Ns4Kafka brings namespaces on top of Kafka brokers, Kafka Connect and Schema Registry.
postgres-kafka-cassandra - Data Pipeline between PostgreSQL and Cassandra using Kafka Connect