Python Kafka

Open-source Python projects categorized as Kafka | Edit details

Top 16 Python Kafka Projects

  • Faust

    Python Stream Processing

    Project mention: Using Kafka with Python... is Confluent the only option? | | 2022-05-08

    Unfortunately Faust is dead, robinhood abandoned it 2020, there are no new commits and they don’t react to any questions etc..:

  • kafka-python

    Python client for Apache Kafka

    Project mention: Using Kafka with Python... is Confluent the only option? | | 2022-05-08

    Related issue thread -

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • nagios-plugins

    450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

  • KQ

    Kafka-based Job Queue for Python

  • faust

    Python Stream Processing. A Faust fork (by faust-streaming)

    Project mention: Using Kafka with Python... is Confluent the only option? | | 2022-05-08

    There is a community fork which was stale for a while but got a new commit a couple days ago, this one might be usable, but is still quite risky (70 open issues etc.):

  • DataEngineeringProject

    Example end to end data engineering project.

    Project mention: Is it me or are beginner-friendly ETL pipeline guides that explain from the ground-up how to incorporate the use of various technologies notoriously difficult to find. | | 2021-07-23
  • tributary

    Streaming reactive and dataflow graphs in Python

    Project mention: Show HN: Hamilton, a Microframework for Creating Dataframes | | 2021-11-08

    Having worked on "Dagger", you may be interested in

  • SonarLint

    Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.

  • strimzi-kafka-cli

    Command Line Interface for Strimzi Kafka Operator

    Project mention: A CLI for Strimzi Kafka Operator | | 2021-09-02
  • python-fake-data-producer-for-apache-kafka

    Kafka Python Fake Data Producer is a complete demo app allowing you to quickly produce a Python fake Pizza-based streaming dataset and push it to an Apache Kafka topic. It gives an example on how easy is to create great fake streaming data to feed Apache Kafka.

    Project mention: April on Open Source Databases | | 2022-04-20

    Gregory Stark is a Senior Open Source PostgreSQL Developer at Aiven. Postgres has a reputation for being stable and reliable. “It does all the things SQL databases are traditionally good at - live backups, replication, storage.” Originally an academic project, Postgres’ open source stewards were interested in its extensibility, the ability to merge it into any project and with any codebase. “SQL databases have been a great fit for business needs, PostgreSQL is different in that it’s developer-oriented, but today serves both needs.”

  • kafka-crypto-questdb

    Using Kafka to track cryptocurrency price trends

  • kafkaml-anomaly-detection

    Project for real-time anomaly detection using Kafka and python

    Project mention: Real time anomalies detection using kafka and scikit-learn | | 2021-06-26

    Hello everyone, I want to share with you a project I made for real time anomalies detection using kafka in python and scikit-learn, it has the generation of streaming data, the real time predictions and slack alerts, full code here

  • makinage

    Stream Processing Made Easy

  • esque

    esque - an operational kafka tool.

    Project mention: Gathering opinions on kafka management tools | | 2021-10-06

    At my former employer, we developed a CLI Kafka management tool, maybe it'll help someone here.

  • Realtime-ticket-booking-solution

    A simple demo showing how to use Ably and fastAPI to route messages into Kafka for stream processing

    Project mention: Building a realtime ticket booking solution with Kafka, FastAPI, and Ably | | 2021-10-12

    I hope this guide serves as a helpful description and walkthrough of building a dependable realtime ticket booking solution. Next, you can dive into the GitHub repository. You might also want to check out Ably Labs on GitHub, for more examples of what you can do with Ably.

  • minifi-xaviernx

    NVIDIA XAVIER NX - MiNiFi - NiFi - Kafka - Flink

  • FKR

    Example of event-driven architecture with FastAPI Gateway, Kafka, Redis pub/sub and Faust-streaming

    Project mention: Example of Event-driven architecture with Fastapi Kafka, Redis PubSub and Faust | | 2022-01-12
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-08.

Python Kafka related posts


What are some of the best open-source Kafka projects in Python? This list will help you:

Project Stars
1 Faust 6,161
2 kafka-python 4,832
3 nagios-plugins 1,053
4 KQ 544
5 faust 505
6 DataEngineeringProject 475
7 tributary 367
8 strimzi-kafka-cli 42
9 python-fake-data-producer-for-apache-kafka 35
10 kafka-crypto-questdb 33
11 kafkaml-anomaly-detection 27
12 makinage 24
13 esque 21
14 Realtime-ticket-booking-solution 9
15 minifi-xaviernx 2
16 FKR 1
Find remote jobs at our new job board There are 7 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives