kafka-connect-jdbc VS kafka-connect-file-pulse

Compare kafka-connect-jdbc vs kafka-connect-file-pulse and see what are their differences.

kafka-connect-jdbc

Kafka Connect connector for JDBC-compatible databases (by confluentinc)

kafka-connect-file-pulse

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka (by streamthoughts)
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
kafka-connect-jdbc kafka-connect-file-pulse
2 4
998 303
1.7% 2.3%
7.3 8.9
3 days ago 1 day ago
Java Java
GNU General Public License v3.0 or later Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

kafka-connect-jdbc

Posts with mentions or reviews of kafka-connect-jdbc. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-08-31.
  • How Sendoso is using Kafka for Event-Driven Architecture
    3 projects | dev.to | 31 Aug 2021
    Event sourcing is an effective architectural pattern to record changes to the application state. Event sequence is important - we need changes as they were originally applied. incoming events are first persisted into Kafka and then processed by services independently. Kafka, hence, becomes our source of truth (SOT), a data source that gives a complete picture of the data object as a whole. This, however, meant dramatic changes in our core application. Our source of truth is still the core database, but we generate events in Kafka when data gets persisted. To ensure transactional behavior, we employed Transactional Outbox pattern. Essentially, we a) created a new events table in the database, b) wrote event data in the same transaction when we update our SOT table. Kafka Connect is subsequently used to read this table and insert records in relevant Kafka topics. This ensures that we never have an inconsistent situation where data was inserted in the database but the event is not added to Kafka topic or vice versa. We evaluated a few connectors for sourcing data from Mysql (JdbcSourceConnector, and Debezium). Our scenario was supported out of the box in JdbcSourceConnector, making it possible to have one event table in Mysql where different rows could be routed to a relevant topic based on the topic field.
  • Data Pipeline between PostgreSQL and Cassandra using Kafka Connect
    3 projects | dev.to | 18 Jan 2021
    This is different compared to the "polling" technique adopted by the Kafka Connect JDBC connector

kafka-connect-file-pulse

Posts with mentions or reviews of kafka-connect-file-pulse. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-01-05.
  • Streaming data into Kafka S01/E04 — Loading Log files using Grok Expression
    5 projects | dev.to | 5 Jan 2021
    Note : You can also install the connector either from GitHub Releases Page or from Confluent Hub.
    5 projects | dev.to | 5 Jan 2021
    This is the fourth and last article of the series "Streaming data into Kafka" series. In the first three articles, we saw how it's fairly easy to use Kafka Connect to load records from CSV, XML and JSON files into Apache Kafka without writing a single line of code. For doing this, we have used the Kafka Connect FilePulse connector which packs with a lot of nice features to parse and transform data.

What are some alternatives?

When comparing kafka-connect-jdbc and kafka-connect-file-pulse you can also consider the following projects:

mongo-kafka - MongoDB Kafka Connector

kryptonite-for-kafka - Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project

kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector

kafka-connect-transform-xml - Transformation for converting XML data to Structured data.

PretendYoureXyzzy - A web clone of the card game Cards Against Humanity.

kafka-connect-client - Java client library for Apache Kafka Connect REST Interface

kafka-service - JMS Service is a utility for testing JMS based backends by simply using HTTP Endpoints. Currently supported backends are Kafka and RabbitMQ

kafka-connect-transform-grok - Grok Expression Transform for Kafka Connect.

firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

nri-prometheus - Fetch metrics in the Prometheus metrics inside or outside Kubernetes and send them to the New Relic Metrics platform.

kafdrop - Kafka Web UI