Top 16 Python Kafka Projects
Python Stream ProcessingProject mention: Using Kafka with Python... is Confluent the only option? | reddit.com/r/apachekafka | 2022-05-08
Unfortunately Faust is dead, robinhood abandoned it 2020, there are no new commits and they don’t react to any questions etc..: https://github.com/robinhood/faust
Python client for Apache KafkaProject mention: Using Kafka with Python... is Confluent the only option? | reddit.com/r/apachekafka | 2022-05-08
Related issue thread - https://github.com/dpkp/kafka-python/issues/2290
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
Kafka-based Job Queue for Python
Python Stream Processing. A Faust fork (by faust-streaming)Project mention: Using Kafka with Python... is Confluent the only option? | reddit.com/r/apachekafka | 2022-05-08
There is a community fork which was stale for a while but got a new commit a couple days ago, this one might be usable, but is still quite risky (70 open issues etc.): https://github.com/faust-streaming/faust
Example end to end data engineering project.Project mention: Is it me or are beginner-friendly ETL pipeline guides that explain from the ground-up how to incorporate the use of various technologies notoriously difficult to find. | reddit.com/r/dataengineering | 2021-07-23
Streaming reactive and dataflow graphs in Python
Deliver Cleaner and Safer Code - Right in Your IDE of Choice!. SonarLint is a free and open source IDE extension that identifies and catches bugs and vulnerabilities as you code, directly in the IDE. Install from your favorite IDE marketplace today.
Command Line Interface for Strimzi Kafka OperatorProject mention: A CLI for Strimzi Kafka Operator | news.ycombinator.com | 2021-09-02
Kafka Python Fake Data Producer is a complete demo app allowing you to quickly produce a Python fake Pizza-based streaming dataset and push it to an Apache Kafka topic. It gives an example on how easy is to create great fake streaming data to feed Apache Kafka.Project mention: April contributing.today: on Open Source Databases | dev.to | 2022-04-20
Gregory Stark is a Senior Open Source PostgreSQL Developer at Aiven. Postgres has a reputation for being stable and reliable. “It does all the things SQL databases are traditionally good at - live backups, replication, storage.” Originally an academic project, Postgres’ open source stewards were interested in its extensibility, the ability to merge it into any project and with any codebase. “SQL databases have been a great fit for business needs, PostgreSQL is different in that it’s developer-oriented, but today serves both needs.”
Using Kafka to track cryptocurrency price trends
Project for real-time anomaly detection using Kafka and pythonProject mention: Real time anomalies detection using kafka and scikit-learn | reddit.com/r/Python | 2021-06-26
Hello everyone, I want to share with you a project I made for real time anomalies detection using kafka in python and scikit-learn, it has the generation of streaming data, the real time predictions and slack alerts, full code here
Stream Processing Made Easy
esque - an operational kafka tool.Project mention: Gathering opinions on kafka management tools | reddit.com/r/devops | 2021-10-06
At my former employer, we developed a CLI Kafka management tool, maybe it'll help someone here. https://github.com/real-digital/esque
A simple demo showing how to use Ably and fastAPI to route messages into Kafka for stream processingProject mention: Building a realtime ticket booking solution with Kafka, FastAPI, and Ably | dev.to | 2021-10-12
I hope this guide serves as a helpful description and walkthrough of building a dependable realtime ticket booking solution. Next, you can dive into the GitHub repository. You might also want to check out Ably Labs on GitHub, for more examples of what you can do with Ably.
NVIDIA XAVIER NX - MiNiFi - NiFi - Kafka - Flink
Example of event-driven architecture with FastAPI Gateway, Kafka, Redis pub/sub and Faust-streamingProject mention: Example of Event-driven architecture with Fastapi Kafka, Redis PubSub and Faust | reddit.com/r/Python | 2022-01-12
Python Kafka related posts
Using Kafka with Python... is Confluent the only option?
3 projects | reddit.com/r/apachekafka | 8 May 2022
Why did Robinhood abandon Faust?
2 projects | reddit.com/r/dataengineering | 25 Apr 2022
How to integrate Faust with Django?
1 project | reddit.com/r/codehunter | 8 Apr 2022
Apache Spark on Apple m1
2 projects | reddit.com/r/apachespark | 22 Feb 2022
How to use FastAPI with Materialize for real-time data processing
4 projects | dev.to | 15 Feb 2022
Project with Faust and Django
1 project | reddit.com/r/django | 1 Dec 2021
Faust vs Spark Streaming vs Kafka Streams
2 projects | reddit.com/r/apachekafka | 25 Oct 2021
What are some of the best open-source Kafka projects in Python? This list will help you:
Are you hiring? Post a new remote job listing for free.