kafka-connect-cosmosdb
kafka-connect-datagen
Our great sponsors
| kafka-connect-cosmosdb | kafka-connect-datagen | |
|---|---|---|
| 2 | 3 | |
| 45 | 172 | |
| - | 2.3% | |
| 8.3 | 7.2 | |
| 1 day ago | 3 days ago | |
| Java | Java | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-connect-cosmosdb
-
Critical New 0-day Vulnerability in Popular Log4j Library - List of applications
Kafka Connect CosmosDB : https://github.com/microsoft/kafka-connect-cosmosdb/blob/0f5d0c9dbf2812400bb480d1ff0672dfa6bb56f0/CHANGELOG.md
-
Getting started with Kafka Connector for Azure Cosmos DB using Docker
The Azure Cosmos DB connector allows you to move data between Azure Cosmos DB and Kafka. It’s available as a source as well as a sink. The Azure Cosmos DB Sink connector writes data from a Kafka topic to an Azure Cosmos DB container and the Source connector writes changes from an Azure Cosmos DB container to a Kafka topic. At the time of writing, the connector is in pre-production mode. You can read more about it on the GitHub repo or install/download it from the Confluent Hub.
kafka-connect-datagen
-
Build a data pipeline on AWS with Kafka, Kafka connect and DynamoDB
The first part will keep things relatively simple - it's all about get started easily. I will be using the Kafka Connect Datagen source connector to pump data some sample data into MSK topic and then use the AWS DynamoDB sink connector to persist that data in a DynamoDB table.
-
Getting started with Kafka Connector for Azure Cosmos DB using Docker
For the remaining scenarios, we will use a producer component to generate records. The Kafka Connect Datagen connector is our friend. It is meant for generating mock data for testing, so let’s put it to good use!
-
Generate mock data with headers
Neither kafka-connect-datagen nor voluble offer the ability to generate headers, unfortunately. It's a cool idea though.
What are some alternatives?
cosmosdb-kafka-connect-docker - Getting started with Kafka Connector for Azure Cosmos DB using Docker
Docker Swarm - Source repo for Docker's Documentation
Apache Avro - Apache Avro is a data serialization system.
mongo-kafka - MongoDB Kafka Connector
aws-msk-iam-auth - Enables developers to use AWS Identity and Access Management (IAM) to connect to their Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters.
kafka-connect-elasticsearch - Kafka Connect Elasticsearch connector
Docker Compose - Define and run multi-container applications with Docker
Mailcow - mailcow: dockerized - 🐮 + 🐋 = 💕
firehose - Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.
kryptonite-for-kafka - Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project