Python Apache Kafka

Open-source Python projects categorized as Apache Kafka

Top 6 Python Apache Kafka Projects

  • cp-all-in-one

    docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

  • Project mention: My local Kafka instance stuck in "auto leader balancing" | /r/apachekafka | 2023-11-22

    # https://github.com/confluentinc/cp-all-in-one/blob/7.0.1-post/cp-all-in-one/docker-compose.yml version: '3' services: zookeeper: image: confluentinc/cp-zookeeper:7.3.0 container_name: zookeeper ports: - "2181:2181" environment: ZOOKEEPER_CLIENT_PORT: 2181 ZOOKEEPER_TICK_TIME: 2000 broker: image: confluentinc/cp-kafka:7.3.0 container_name: broker ports: - "9092:9092" depends_on: - zookeeper environment: KAFKA_BROKER_ID: 1 KAFKA_ZOOKEEPER_CONNECT: "zookeeper:2181" KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:29092,PLAINTEXT_HOST://localhost:9092 KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1 KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1 KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1 mongodb: container_name: mongo_c image: mongo:6.0 volumes: - ./db:/data/db ports: - "27017:27017" environment: MONGO_INITDB_ROOT_USERNAME: root MONGO_INITDB_ROOT_PASSWORD: example

  • quix-streams

    A Python library for building containerized ML and Generative AI applications with Apache Kafka.

  • Project mention: Show HN: Streaming DataFrames–a Pandas-like syntax for real-time data | news.ycombinator.com | 2024-04-23
  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • KQ

    Kafka-based Job Queue for Python

  • python-fake-data-producer-for-apache-kafka

    The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

  • Project mention: ElephantSQL Is Shutting Down | news.ycombinator.com | 2024-04-07

    I had good experience with Aiven in the past, we needed something located in the EU: https://aiven.io/

  • strimzi-kafka-cli

    Command Line Interface for the Strimzi Kafka Operator

  • esque

    esque - an operational kafka tool.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Apache Kafka related posts

  • ElephantSQL Is Shutting Down

    1 project | news.ycombinator.com | 7 Apr 2024
  • My local Kafka instance stuck in "auto leader balancing"

    1 project | /r/apachekafka | 22 Nov 2023
  • Crossplane: Streamline your infrastructure provisioning & management

    1 project | dev.to | 17 Oct 2023
  • Scale up: a MySQL bug story, or why Aiven works

    1 project | dev.to | 7 Jul 2023
  • What are your favorite tools or components in the Kafka ecosystem?

    10 projects | /r/apachekafka | 31 May 2023
  • Apache Kafka Using Docker

    2 projects | /r/apachekafka | 26 Apr 2023
  • Has anyone seen and handled this error successfully ? : /bin/sh^M: bad interpreter: No such file or directory

    1 project | /r/apachekafka | 25 Feb 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 4 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Apache Kafka projects in Python? This list will help you:

Project Stars
1 cp-all-in-one 882
2 quix-streams 692
3 KQ 571
4 python-fake-data-producer-for-apache-kafka 77
5 strimzi-kafka-cli 76
6 esque 24

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com