Gearman
Chronicle Queue
Gearman | Chronicle Queue | |
---|---|---|
2 | 2 | |
724 | 3,159 | |
0.3% | 0.5% | |
5.7 | 9.3 | |
26 days ago | about 9 hours ago | |
C++ | Java | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Gearman
-
[D] What are the compute options you've considered for your projects?
I am a fan of Gearman to schedule and dispatch distributed jobs, Redis as a collaborative blackboard, and GlusterFS to share models across multiple systems and make bulk data available across the entire system (usually referenced in the blackboard as a pathname).
-
How do you deal with process heavy, long execution time for loops?
At work we typically use Gearman (http://gearman.org/) or Symfony messenger (https://symfony.com/doc/current/messenger.html) to queue up a batch of jobs. And then we use supervisord (http://supervisord.org/) to keep a pool of PHP processes running to process the jobs.
Chronicle Queue
-
Cues: low-latency persistent blocking queues, processors, and graphs via ChronicleQueue
Cues extends ChronicleQueue and Tape to provide:
- Micro second messaging that stores everything to disk
What are some alternatives?
celery - Distributed Task Queue (development branch)
Apache Kafka - Mirror of Apache Kafka
ZeroMQ - ZeroMQ core engine in C++, implements ZMTP/3.1
RabbitMQ - Open source RabbitMQ: core server and tier 1 (built-in) plugins
BeanstalkD - Beanstalk is a simple, fast work queue.
Agrona - High Performance data structures and utility methods for Java
NATS - High-Performance server for NATS.io, the cloud and edge native messaging system.
Apache ActiveMQ - Mirror of Apache ActiveMQ
Sidekiq - Simple, efficient background processing for Ruby
Redisson - Redisson - Easy Redis Java client and Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring Cache, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache ...