Our great sponsors
-
redpanda-examples
Discontinued A collection of examples to demonstrate how to interact with Redpanda from various clients and languages.
-
redpanda
Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Let’s walk through an example to demonstrate how to stream data from Redpanda into a Structured Streaming application, execute a simple transformation on the stream, and write the results back to Redpanda. You can find all of the code and configuration used in this blog on GitHub.
$ git clone https://github.com/redpanda-data/redpanda-examples.git $ cd redpanda-examples/docker-compose $ docker-compose -f redpanda-spark.yml up -d [+] Running 4/4 ⠿ Network docker-compose_redpanda_network Created ⠿ Container spark-master Started ⠿ Container redpanda Started ⠿ Container spark-worker Started