Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more! Learn more →
Top 23 Python Kafka Projects
-
Project mention: Fullstack Open Source Projects That Will Help You Become AI Devs (Python, JavaScript, AI) | dev.to | 2025-05-27
Give Pathway a try: https://github.com/pathwaycom/pathway 🌟 Pathway on GitHub
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
-
faststream
FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
Project mention: FastStream: A powerful library for building services with event streams | news.ycombinator.com | 2024-10-29FastStream (https://github.com/airtai/faststream) simplifies the process of writing producers and consumers for message queues, handling all the parsing, networking and documentation generation automatically. It is a new package based on the ideas and experiences gained from FastKafka and Propan. By joining our forces, we picked up the best from both packages and created a unified way to write services capable of processing streamed data regardless of the underlying protocol. We'll continue to maintain both packages, but new development will be in this project.
Making streaming microservices has never been easier. Designed with junior developers in mind, FastStream simplifies your work while keeping the door open for more advanced use cases. Here's a look at the core features that make FastStream a go-to framework for modern, data-centric microservices.
Multiple Brokers: FastStream provides a unified API to work across multiple message brokers (Apache Kafka, RabbitMQ, NATS and Redis)
-
-
quix-streams
A Python library for building containerized ML and Generative AI applications with Apache Kafka.
-
-
Sevalla
Deploy and host your apps and databases, now with $50 credit! Sevalla is the PaaS you have been looking for! Advanced deployment pipelines, usage-based pricing, preview apps, templates, human support by developers, and much more!
-
-
nagios-plugins
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
-
cp-all-in-one
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform
-
kaskade
kaskade is a text user interface for kafka, which allows you to interact and consume topics from your terminal in style!
-
streamify
A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
-
-
-
-
-
-
python-fake-data-producer-for-apache-kafka
The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.
Aiven offers a range of open-source managed data infrastructures, including PostgreSQL, Apache Kafka, Elasticsearch, Grafana, InfluxDB, MySQL, Redis and more.
-
django-action-triggers
A Django library for asynchronously triggering actions in response to database changes. It supports integration with webhooks, message brokers (e.g., Kafka, RabbitMQ), and can trigger other processes, including AWS Lambda functions.
django-action-triggers – Django library for asynchronously triggering actions in response to database changes
-
-
inferencedb
🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python Kafka discussion
Python Kafka related posts
-
Show HN: Kaskade version 3 was released
-
FastStream: A powerful library for building services with event streams
-
Build a real-time crypto analytics dashboard with Beavers and Perspective
-
Industry Standard for Cloud Instance Initialization: Cloud-Init
-
Show HN: Streaming DataFrames–a Pandas-like syntax for real-time data
-
🦿🛴Smarcity garbage reporting automation w/ ollama
-
FastStream v0.4.0: Introducing Confluent Kafka Integration with Async Support
-
A note from our sponsor - Sevalla
sevalla.com | 1 Sep 2025
Index
What are some of the best open-source Kafka projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | pathway | 32,741 |
| 2 | Faust | 6,810 |
| 3 | kafka-python | 5,800 |
| 4 | faststream | 4,478 |
| 5 | faust | 1,817 |
| 6 | quix-streams | 1,433 |
| 7 | aiokafka | 1,305 |
| 8 | DataEngineeringProject | 1,284 |
| 9 | nagios-plugins | 1,144 |
| 10 | cp-all-in-one | 1,075 |
| 11 | kaskade | 947 |
| 12 | streamify | 722 |
| 13 | KQ | 571 |
| 14 | tributary | 458 |
| 15 | clickhouse-sink-connector | 277 |
| 16 | kafka-ml | 194 |
| 17 | spark_app_twitter | 86 |
| 18 | python-fake-data-producer-for-apache-kafka | 85 |
| 19 | django-action-triggers | 84 |
| 20 | strimzi-kafka-cli | 84 |
| 21 | inferencedb | 81 |
| 22 | kafka-crypto-questdb | 69 |
| 23 | cp-ansible | 63 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com