SaaSHub helps you find the best software and product alternatives Learn more →
Top 6 Rust message-queue Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
laminarmq
A scalable, distributed message queue powered by a segmented, partitioned, replicated and immutable log.
-
rc_event_queue
VecDeque-like fast, unbounded, mpmc/spmc concurent FIFO message queue. Lockless reads, write-lock writes.
Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08That's exactly why we built Svix[1]. Building webhooks services, even with amazing tools like FastAPI, Celery and Redis is still a big pain. So we just built a product to solve it.
Hatchet looks cool nonetheless. Queues are a pain for many other use-cases too.
1: https://www.svix.com
laminarmq: https://github.com/arindas/laminarmq
I am building a message queue from scratch in Rust. It is intended to be a resource efficient alternative to Apache Kafka. (It does not rely on any Kafka libraries.)
It has similar concepts like topics and partitions. It is intended to be distributed in nature, with no reliance on any third party component.
Currently it only provides a segmented log implementation which can be used on it's own if necessary. We support both persistent and in-memory storage.
It is still very much in a nascent stage as there are no message queue level APIs or Web endpoints yet.
I tried to keep it as decoupled from different Rust async runtimes as possible to make it easier to integrate to different ecosystems. It currently supports tokio and glommio.
There is also an example to show how the segmented log might be used in a server:
https://github.com/arindas/laminarmq/tree/examples/laminarmq...
Next steps would be to design the message queue level APIs and gradually implement the distributed components.
This is the first time I am implementing something at this scale so any feedback or advice would be great.
I'm using Cap'N Proto in a message broker application(LcuidMQ) I'm building for serialization. It has allowed me to created client applications rather quickly. There are some quirks can be difficult to wrap your head around, but once you understand it is really solid.
There are some difference between the language libraries and documentation can be lacking around those language specific solutions. I'm hoping to add blog articles and or contribute back to the example of these repositories to help future users in the future.
Check out my repo here for how I use it across Rust and Python, with Golang coming soon: https://github.com/lucidmq/lucidmq
Rust message-queue related posts
- Show HN: Arroyo – Write SQL on streaming data
- What's everyone working on this week (45/2021)?
- Event Sourcing
- Someone built a chat backend with Rust for a production website?
- message-io: an event-driven message library to build network applications easy and fast. Now with WebSocket support
-
A note from our sponsor - SaaSHub
www.saashub.com | 28 Apr 2024
Index
What are some of the best open-source message-queue projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | svix-webhooks | 2,075 |
2 | message-io | 1,031 |
3 | laminarmq | 55 |
4 | LucidMQ | 27 |
5 | rc_event_queue | 20 |
6 | mesg | 7 |
Sponsored