nsq
Apache Kafka
Our great sponsors
nsq | Apache Kafka | |
---|---|---|
14 | 25 | |
24,491 | 27,123 | |
0.6% | 1.4% | |
6.3 | 9.9 | |
9 days ago | about 15 hours ago | |
Go | Java | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nsq
-
MQTT vs. Kafka: An IoT Advocate's Perspective
Interesting. What are you thoughts on NSQ?
Was looking at it earlier today, but haven't ever tried it out.
-
Any thoughts on using Redis to extend Go's channels across application / machine boundaries?
(G)NATS can do millions of messages per second and is the right tool for the job (either that or NSQ). Redis isn't even the fastest Redis protocol implementation, KeyDB significantly outperforms it.
-
FileWave: Why we moved from ZeroMQ to NATS
Bit.ly's NSQ is also an excellent message queue option.
-
Infinite loop pattern to poll for a queue in a REST server app
Queue consumers are interesting because there are many solutions for them, from using Redis and persisting the data in a data store - but for fast and scalable the approach I would take is something like SQS (as I advocate AWS even free tier) or NSQ for managing your own distributed producers and consumers.
-
What are pros and cons of Go?
distrubition server engine ( for example websocket server multi ws gateway and worker pool,nsq.io realtime message queue and so on)
- Is there any conventionally accepted repo that is representative of well designed go code ?
-
Distributed IM Service in Golang
NSQ is a message queue implemented by Golang, and all messages are routed through NSQ. Reasons for choosing NSQ compared to other MQs: decentralized distribution (direct connection between production and consumption), low latency, No ordering, high performance, simple binary protocol.
-
Fluvio: The Programmable Data Platform
If we are talking about "cloud-native", I would really recommend taking a look at nsq or nats. I am really big fanboy of NSQ [1], it is simple, easy to setup and conceptually easy to learn.
[1] https://nsq.io
-
For those running Go in production at scale, what do you use for distributed task queues?
Here is link number 1 - Previous text "NSQ"
I've been using NSQ in production for a number of years now. It's also written in Go and has a first class client library maintained by the devs
Apache Kafka
- Scala DevInTraining looking to contribute to projects
- *bip*
-
What is Kafka ?
Source and documentation on GitHub
-
Can someone please eli5 how the hierarchical timing wheel algorithm works?
I briefly described the algorithm in this article and there is a wonderful article from Kafka that goes into more depth in their general purpose implementation. My implementation is specialized and over optimized in comparison, e.g. by using bit manipulation to avoid more expensive division/modulus instructions. Tokio rewrote their timerwheel after I showed them mine, borrowing some ideas but also staying more general. Hope that helps!
-
How-to-Guide: Contributing to Open Source
Apache Kafka
-
I am proud to announce, a new Sorting algorithm!
AFAIK, the Linux kernel actually uses a LinkedList for this (Ref: workqueue.c, types.h) and message queues use Timing Wheel (Ref: Kafka's TimingWheel)
- Project Ideas Thread
-
Which diagram tool Kafka using in its documentation
Looks like the author for that image is Guozhang Wang, who is still active in the kafka repo.
-
How to get `byte[]` as `byte[]` in a Kafka Record (in an SMT)
Perhaps you are looking for org.apache.kafka.connect.converters.ByteArrayConverter?
-
Open Source Analytics Stack: Bringing Control, Flexibility, and Data-Privacy to Your Analytics
With the increase in real-time data streams and event streams, certain use cases emerged that require access to real-time data such as financial services risk reporting or detecting a credit card fraud. Real-time streams can be obtained using a stream processing framework like Apache Kafka (website, GitHub). The focus is to direct the stream of data from various sources into reliable queues where data can be automatically transformed, stored, analyzed and reported concurrently.
What are some alternatives?
celery - Distributed Task Queue (development branch)
Apache ActiveMQ Artemis - Mirror of Apache ActiveMQ Artemis
redpanda - Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
jetstream - JetStream Utilities
NATS - Golang client for NATS, the cloud native messaging system.
Aeron - Efficient reliable UDP unicast, UDP multicast, and IPC message transport
NATS - High-Performance server for NATS.io, the cloud and edge native messaging system.
Apache Qpid - Mirror of Apache Qpid
Hermes - Fast and reliable message broker built on top of Kafka.
JBoss HornetQ - HornetQ is an open source project to build a multi-protocol, embeddable, very high performance, clustered, asynchronous messaging system.
Chronicle Queue - Micro second messaging that stores everything to disk