nussknacker
cratedb-flink-jobs
Our great sponsors
nussknacker | cratedb-flink-jobs | |
---|---|---|
1 | 1 | |
609 | 2 | |
5.6% | - | |
9.8 | 5.4 | |
5 days ago | 29 days ago | |
Scala | Java | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nussknacker
cratedb-flink-jobs
-
Build a data ingestion pipeline using Kafka, Flink, and CrateDB
# Acquire Flink job VERSION=0.2 JARFILE="cratedb-flink-jobs-${VERSION}.jar" wget https://github.com/crate/cratedb-flink-jobs/releases/download/${VERSION}/${JARFILE} # Invoke Flink job docker run -it --network=scada-demo --volume=$(pwd)/${JARFILE}:/${JARFILE} flink:1.12 \ flink run --jobmanager=flink-jobmanager:8081 /${JARFILE} \ --kafka.servers kafka-broker:9092 \ --kafka.topic rides \ --crate.hosts cratedb:5432 \ --crate.table taxi_rides
What are some alternatives?
flink-faker - A data generator source connector for Flink SQL based on data-faker.
kafkacat - Generic command line non-JVM Apache Kafka producer and consumer [Moved to: https://github.com/edenhill/kcat]
flink-on-k8s-operator - Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
crate-jdbc - A JDBC driver for CrateDB.
yauaa - Yet Another UserAgent Analyzer
Scio - A Scala API for Apache Beam and Google Cloud Dataflow.
LakeSoul - LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.
kafka-manager - CMAK is a tool for managing Apache Kafka clusters
Gearpump - Lightweight real-time big data streaming engine over Akka
fs2-kafka - Kafka client for functional streams for scala (fs2)