Python Apache Kafka

Open-source Python projects categorized as Apache Kafka

Top 7 Python Apache Kafka Projects

Apache Kafka
  • quix-streams

    A Python library for building containerized ML and Generative AI applications with Apache Kafka.

    Project mention: Show HN: Denormalized – Embeddable Stream Processing in Rust and DataFusion | news.ycombinator.com | 2024-08-15

    Congratulations on launching your project! We spoke back in March at a Kafka Summit London social meetup and talked all things Python and Kafka (I work on https://github.com/quixio/quix-streams). Always great to see a new stream processing project tackle a new segment

  • CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  • cp-all-in-one

    docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

  • KQ

    Kafka-based Job Queue for Python

  • python-fake-data-producer-for-apache-kafka

    The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

    Project mention: Top 10 Affordable Options To Host Your PostgreSQL Database | dev.to | 2024-08-18

    Aiven

  • strimzi-kafka-cli

    Command Line Interface for the Strimzi Kafka Operator

  • esque

    esque - an operational kafka tool.

  • e2e-structured-streaming

    End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to schedule scripts that fetch data from an API, sends the data to Kafka, and processes it with Spark before writing to Cassandra. The pipeline, built with Python and Apache Zookeeper, is containerized with Docker for easy deployment and scalability.

    Project mention: End-to-End Realtime Streaming Data Engineering Project | dev.to | 2024-08-07

    $ git clone https://github.com/akarce/e2e-structured-streaming.git

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Apache Kafka discussion

Log in or Post with

Python Apache Kafka related posts

  • Helping PostgreSQL® professionals with AI-assisted performance recommendations

    1 project | dev.to | 28 May 2024
  • ElephantSQL Is Shutting Down

    1 project | news.ycombinator.com | 7 Apr 2024
  • My local Kafka instance stuck in "auto leader balancing"

    1 project | /r/apachekafka | 22 Nov 2023
  • Crossplane: Streamline your infrastructure provisioning & management

    1 project | dev.to | 17 Oct 2023
  • Scale up: a MySQL bug story, or why Aiven works

    1 project | dev.to | 7 Jul 2023
  • What are your favorite tools or components in the Kafka ecosystem?

    10 projects | /r/apachekafka | 31 May 2023
  • Apache Kafka Using Docker

    2 projects | /r/apachekafka | 26 Apr 2023
  • A note from our sponsor - CodeRabbit
    coderabbit.ai | 11 Dec 2024
    Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR. Learn more →

Index

What are some of the best open-source Apache Kafka projects in Python? This list will help you:

Project Stars
1 quix-streams 1,231
2 cp-all-in-one 974
3 KQ 571
4 python-fake-data-producer-for-apache-kafka 82
5 strimzi-kafka-cli 80
6 esque 24
7 e2e-structured-streaming 10

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you konow that Python is
the 2nd most popular programming language
based on number of metions?