aiokafka
faststream
aiokafka | faststream | |
---|---|---|
3 | 13 | |
1,054 | 1,828 | |
2.3% | 8.3% | |
8.6 | 9.7 | |
4 days ago | 7 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aiokafka
-
FastStream: Python's framework for Efficient Message Queue Handling
Our journey with FastStream started when we needed to integrate our machine learning models into a customer's Apache Kafka environment. To streamline this process, we created FastKafka using AIOKafka, AsyncAPI, and asyncio. It was our first step in making message queue management easier.
-
Improving Kafka interfaces
aiokafka - https://github.com/aio-libs/aiokafka
-
Recently joined a DE team and I've been asked to study async, multiprocessing, queuing, and Kafka. Can anybody tell me how to proceed and also share resources that I can use.
It’s hard to understand exactly what is meant by what you posted but could they be referring to asyncio libraries for use with Kafka in this process? For example, https://github.com/aio-libs/aiokafka
faststream
- FastStream v0.4.0: Introducing Confluent Kafka Integration with Async Support
-
Show HN: Confluent Kafka support added to FastStream v0.4.0rc0
FastStream - https://github.com/airtai/faststream, a stream processing framework, already supports Kafka stream processing using the aiokafka library, as well as other brokers such as Redis, RabbitMQ, and NATS.
-
Processing streaming messages from a Django service
FastStream is a powerful and easy-to-use FOSS framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ and NATS. It simplifies the process of writing producers and consumers for message queues, handling all the parsing, networking and documentation generation automatically.
-
FastStream: Python's framework for Efficient Message Queue Handling
Ready to join the FastStream revolution? Head over to our GitHub repository and show your support by starring it. By doing so, you'll stay in the loop with the latest developments, updates, and enhancements as we continue to refine and expand FastStream.
-
How we deprecated two successful projects and joined forces to create an even more successful one
After two months of hard work, we presented the newly released FastStream framework at Infobip Shift conference and got featured at ShiftMag. The framework now supports both Apache Kafka and RabbitMQ, but also NATS protocol with the plan to add more protocols in the near future. The overall code is much cleaner and the implementation is streamlined with abstractions covering the common functionality across the protocols. We deprecated both FastKafka and Propan, but promised to fix bugs as long as needed. However, it seems like the community already decided to switch over to gain new functionalities.
- FastStream 0.2.0 adds NATS support in addition to Apache Kafka and RabbitMQ. It is the easiest way to add broker-agnostic support for streaming protocols to your microservices.
-
Generating production-level streaming microservices using GPT
faststream-gen(https://github.com/airtai/faststream-gen/) uses GPT models to automatically generate microservices using the FastStream(https://github.com/airtai/faststream) framework for Apache Kafka, RabbitMQ and NATS. Simply describe your microservice in plain English, and it will generate a production-level FastStream application ready to deploy in a few minutes and under $1 cost, together with unit and integration tests, documentation and Docker images.
-
Generating production-level streaming microservices using AI
faststream-gen is a Python library that uses generative AI to automatically generate FastStream applications. Simply describe your microservice in plain English, and faststream-gen will generate a production-level FastStream application ready to deploy in a few minutes and under $1 cost.
-
Introducing FastStream: the easiest way to write microservices for Apache Kafka and RabbitMQ in Python
FastStream simplifies the process of writing producers and consumers for message queues, handling all the parsing, networking and documentation generation automatically. It is a new package based on the ideas and experiences gained from FastKafka and Propan. By joining our forces, we picked up the best from both packages and created a unified way to write services capable of processing streamed data regardless of the underlying protocol. We'll continue to maintain both packages, but new development will be in this project.
-
FastStream: the easiest way to add Kafka and RabbitMQ support to FastAPI services
FastStream (https://github.com/airtai/faststream) is a new Python framework, born from Propan and FastKafka teams' collaboration (both are deprecated now). It extremely simplifies event-driven system development, handling all the parsing, networking, and documentation generation automatically. Now FastStream supports RabbitMQ and Kafka, but supported brokers are constantly growing (wait for NATS and Redis a bit). FastStream itself is a really great tool to build event-driven services. Also, it has a native FastAPI integration. Just create a StreamRouter (very close to APIRouter) and register event handlers the same with the regular HTTP-endpoints way:
What are some alternatives?
confluent-kafka-python - Confluent's Kafka Python Client
Propan - Propan is a powerful and easy-to-use Python framework for building event-driven applications that interact with any MQ Broker
Faust - Python Stream Processing
faust - Python Stream Processing. A Faust fork
aiorabbit - An AsyncIO RabbitMQ client for Python 3
quix-streams - A Python library for building containerized ML and Generative AI applications with Apache Kafka.
cookiecutter-faststream - Cookiecutter template for FastStream apps
faststream-gen - The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.
fastkafka - FastKafka is a powerful and easy-to-use Python library for building asynchronous web services that interact with Kafka topics. Built on top of Pydantic, AIOKafka and AsyncAPI, FastKafka simplifies the process of writing producers and consumers for Kafka topics.
pydantic - Data validation using Python type hints