examples VS cp-all-in-one

Relevant: - Suggested Enhancements to Python Producer Example

If you'd like to get a better idea of how it works when implemented in code, there are some sample repositories here https://github.com/confluentinc/examples/

Spend some time on https://developer.confluent.io , especially https://developer.confluent.io/get-started/java/ and look at https://github.com/confluentinc/examples . Those will give really practical examples for how to set up your configs and start consuming

The examples git repo has a great working producer and consumer. https://github.com/confluentinc/examples

Digging into this a bit, I guess the fastest way would be to use librdkafka via Dart FFI. It's what Confluent uses in their Node.js example. That way you only have to worry about the FFI parts.

# https://github.com/confluentinc/cp-all-in-one/blob/7.0.1-post/cp-all-in-one/docker-compose.yml version: '3' services: zookeeper: image: confluentinc/cp-zookeeper:7.3.0 container_name: zookeeper ports: - "2181:2181" environment: ZOOKEEPER_CLIENT_PORT: 2181 ZOOKEEPER_TICK_TIME: 2000 broker: image: confluentinc/cp-kafka:7.3.0 container_name: broker ports: - "9092:9092" depends_on: - zookeeper environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: "zookeeper:2181" KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:29092,PLAINTEXT_HOST://localhost:9092 KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1 KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1 KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1 mongodb: container_name: mongo_c image: mongo:6.0 volumes: - ./db:/data/db ports: - "27017:27017" environment: MONGO_INITDB_ROOT_USERNAME: root MONGO_INITDB_ROOT_PASSWORD: example

Hi everyone,i'm using Kafka on Docker (https://github.com/confluentinc/cp-all-in-one/blob/7.3.3-post/cp-all-in-one/docker-compose.yml), when I run producer.py, it runs very smooth and consumer.py as well. however when I check the schema-register at localhost:8081 it is null and so is the Confluent Ui (localhost:9021). Is there anything missing? Thanks for your help!

I found this confluent repo https://github.com/confluentinc/cp-all-in-one/tree/7.3.0-post/cp-all-in-one-kraft for an all in one which from what i understand will allow me to connect files etc so that i can "upload" to kafka.

To make it more fun, I'm using Kafka in KRaft mode (so without Zookeeper) based on this example running in Docker provided by Confluent.

Example: https://github.com/confluentinc/cp-all-in-one/blob/7.3.0-post/cp-all-in-one/docker-compose.yml

We will use a docker-compose.yml based on the one from confluent/cp-all-in-one both to run it locally and to execute the integration tests. From that configuration we will keep only the containers: zookeeper, broker, schema-registry and control-center.

There are a lot of extraneous services here, and CP version is very old. Current version is 7.1 with 7.2 on the way. Maybe look at using Confluent local services start with the Confluent CLI to run services locally or perhaps use https://github.com/confluentinc/cp-all-in-one as a good reference docker compose

You can even just run the preview without Zookeeper in docker-compose https://github.com/confluentinc/cp-all-in-one/tree/7.0.1-post/cp-all-in-one-kraft

You could try the Confluent Platform images. Here is the compose file for everything you need: https://github.com/confluentinc/cp-all-in-one/blob/6.2.0-post/cp-all-in-one/docker-compose.yml