kafka-python
redpanda
kafka-python | redpanda | |
---|---|---|
8 | 70 | |
5,489 | 8,822 | |
- | 2.0% | |
6.4 | 10.0 | |
19 days ago | 7 days ago | |
Python | C++ | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-python
-
kafka-python VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023
-
quix-streams VS kafka-python - a user suggested alternative
2 projects | 7 Dec 2023
Kafka-python is a producer-consumer library for one message at a time applications. Quix Streams is a Python stream processing library for ML and AI applications. Use them together in your event streaming architecture.
-
Improving Kafka interfaces
kafka-python - https://github.com/dpkp/kafka-python
-
Monitor Kafka Producer and Consumer Metrics using Prometheus
If you're using kafka-python take a look at it's sourcecode.
-
Transition from RPA to "traditional" programming role
contribute to opensource. companies care about distributed systems at the moment, so if you can contribute to something like kafka https://kafka.apache.org/project or a popular wrapper https://github.com/dpkp/kafka-python, or a distributed systems platform https://github.com/redpanda-data/redpanda, that would be a strong signal that you can provide value and work with others as you deliver code.
-
New to kafka..
Eg this https://kafka-python.readthedocs.io/
-
Using Kafka with Python... is Confluent the only option?
Related issue thread - https://github.com/dpkp/kafka-python/issues/2290
-
Librdkafka – the Apache Kafka C/C++ client library
I've been working on a pure-Racket Kafka client[1] off and on (for fun) since February and it's a good amount of work. When the official protocol docs and Wireshark fail me, I usually look at librdkafka and kafka-python[2] to figure out how things are supposed to fit together. Kudos to the authors of both libraries for writing code that's easy to follow!
[1]: https://defn.io/2022/03/12/ann-racket-kafka/
[2]: https://github.com/dpkp/kafka-python
redpanda
-
Using Redpanda with OpenTelemetry and Grafana for real-time event monitoring
To learn more about Redpanda and stay up-to-date, see Redpanda's source codes available on GitHub and join the Redpanda Community on Slack with fellow developers and data engineers.
-
Choosing Between a Streaming Database and a Stream Processing Framework in Python
Stream-processing platforms such as Apache Kafka, Apache Pulsar, or Redpanda are specifically engineered to foster event-driven communication in a distributed system and they can be a great choice for developing loosely coupled applications. Stream processing platforms analyze data in motion, offering near-zero latency advantages. For example, consider an alert system for monitoring factory equipment. If a machine's temperature exceeds a certain threshold, a streaming platform can instantly trigger an alert and engineers do timely maintenance.
-
The best WebAssembly runtime may be no runtime at all
Yeah it’s just the stack switching itself that is a handful of cycles, but there is not much more overhead for the full VM switch if you structure your embedding the right way. Code the code is source available if you want to peek at it!
https://github.com/redpanda-data/redpanda/blob/dev/src/v/was...
-
redpanda VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023
-
Kafka Is Dead, Long Live Kafka
that's a littlebit of a stretch. when you say "no shortage" - outside of redpanda what product exists that actually compete in all deployment modes?
it's a misconception that redpanda is simply a better kafka. the way to think about it is that is a new storage engine, from scratch, that speaks the kafka protocol. similar to all of the pgsql companies in a different space, i.e.: big table pgsql support is not a better postgres, fundamentally different tech. you can read the src and design here: https://github.com/redpanda-data/redpanda. or an electric car is not the same as a combustion engine, but only similar in that they are cars that take you from point a to point b.
-
Real-time Data Processing Pipeline With MongoDB, Kafka, Debezium And RisingWave
Redpanda with the MongoDB Debezium Connector installed. We use Redpanda as a Kafka broker.
- Redpanda
-
Flink CDC / alternatives
And Kafka + Kafka Connect has https://www.confluent.io/ https://aiven.io/ https://upstash.com/ (and not quite Kafka, but protocol-compatible, https://redpanda.com/)
-
The Redpanda Project
There exists a C++ project which was created after Rust the language was available. github.com/redpanda-data/redpanda/
-
SOCKS Proxy Server Architecture for High Concurrency
I suggest you check out io_uring and thread per core architecture. Applications like scylladb and redpanda have thread per core architecture and use io_uring for async io.
What are some alternatives?
redis-py - Redis Python client
Apache Kafka - Mirror of Apache Kafka
PyMongo - MongoDB Ecosystem Documentation
Apache Pulsar - Apache Pulsar - distributed pub-sub messaging system
py2neo - Py2neo is a comprehensive toolkit for working with Neo4j from within Python applications or from the command line.
NATS - High-Performance server for NATS.io, the cloud and edge native messaging system.
kcat - Generic command line non-JVM Apache Kafka producer and consumer
jetstream - JetStream Utilities
HappyBase - A developer-friendly Python library to interact with Apache HBase
RabbitMQ - Open source RabbitMQ: core server and tier 1 (built-in) plugins
Plyvel - Plyvel, a fast and feature-rich Python interface to LevelDB
kafkacat - Generic command line non-JVM Apache Kafka producer and consumer [Moved to: https://github.com/edenhill/kcat]