Python Apache Kafka

Open-source Python projects categorized as Apache Kafka

Top 6 Python Apache Kafka Projects

Apache Kafka
  1. cp-all-in-one

    docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. KQ

    Kafka-based Job Queue for Python

  4. python-fake-data-producer-for-apache-kafka

    The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

    Project mention: Postgres on a Budget: 3 Free Solutions You Should Know | dev.to | 2025-07-04

    Aiven offers a range of open-source managed data infrastructures, including PostgreSQL, Apache Kafka, Elasticsearch, Grafana, InfluxDB, MySQL, Redis and more.

  5. strimzi-kafka-cli

    Command Line Interface for the Strimzi Kafka Operator

  6. esque

    esque - an operational kafka tool.

  7. e2e-structured-streaming

    End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API, sends the data to Kafka, and processes it with Spark before writing to Cassandra. The pipeline, built with Python and Apache Zookeeper, is containerized with Docker for easy deployment and scalability.

    Project mention: End-to-End Realtime Streaming Data Engineering Project | dev.to | 2024-08-07

    $ git clone https://github.com/akarce/e2e-structured-streaming.git

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Apache Kafka discussion

Log in or Post with

Python Apache Kafka related posts

  • Postgres on a Budget: 3 Free Solutions You Should Know

    2 projects | dev.to | 4 Jul 2025
  • How to Connect Your Next.js React Application to Redis

    2 projects | dev.to | 21 Apr 2025
  • Run Postgres For Free: Top 3 Options

    3 projects | dev.to | 27 Mar 2025
  • Building Scalable Data Pipelines with Python – A Complete Guide.

    1 project | dev.to | 8 Feb 2025
  • Helping PostgreSQL® professionals with AI-assisted performance recommendations

    1 project | dev.to | 28 May 2024
  • ElephantSQL Is Shutting Down

    1 project | news.ycombinator.com | 7 Apr 2024
  • My local Kafka instance stuck in "auto leader balancing"

    1 project | /r/apachekafka | 22 Nov 2023
  • A note from our sponsor - Stream
    getstream.io | 14 Jul 2025
    Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure. Learn more →

Index

What are some of the best open-source Apache Kafka projects in Python? This list will help you:

# Project Stars
1 cp-all-in-one 1,060
2 KQ 571
3 python-fake-data-producer-for-apache-kafka 85
4 strimzi-kafka-cli 84
5 esque 25
6 e2e-structured-streaming 20

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?