vc5
BeanstalkD
vc5 | BeanstalkD | |
---|---|---|
5 | 14 | |
75 | 6,477 | |
- | 0.3% | |
8.7 | 0.0 | |
2 days ago | 7 days ago | |
Go | C | |
GNU General Public License v3.0 only | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vc5
-
Load Balancing
Should you wish to give DSR load balancing a go without having to invest in hardware/licenses you could try https://github.com/davidcoles/vc5
Put that in front of some HAProxy servers to do TLS termination and farm out requests to another layer of NGINX/uWSGI boxes and Robert is your cousins father.
- a load balancer with XDP and Go
- vc5 - Load balancer with XDP and Go.
- Show HN: I wrote a load balancer with XDP and Go
BeanstalkD
-
Ruby 3.3
There's beanstalkd, it has a few Python libraries and it works out of the box with ActiveJob via Backburner.
https://beanstalkd.github.io/
-
A Developer's Journal: Simplifying the Twelve-Factor App
Messaging/Queueing Systems (Amazon SQS, RabbitMQ, Beanstalkd)
- Load Balancing
-
SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a Postgres Queue
Not when a queue is involved. IME trying to replicate something like beanstalkd (https://beanstalkd.github.io/) in postgres is asking for trouble for anything but trivial workloads.
If you're measuring throughput in jobs/s, use a real work queue.
-
Christmas giveaway: 10 copies of my book Domain-driven Design with Golang book, also AMA
Before Kafka was a standard, I created a go library for beanstalkd that act like an RPC.
-
PHP parallel processing idea
Then there are queue libraries like beanstalkd, RabbitMQ or built-in features like queues from Laravel. These will probably get you quicker to your goal then trying the process managing route.
- How to do distributed cronjobs with worker queues?
-
Write Your Own Task Queue
The only task queue I loved was beanstalkd -- it's beautifully written and highly performant. Starting it takes seconds and it's been running for a decade:
https://beanstalkd.github.io/
- Golang task queue
-
What are some popular background job processing frameworks in the Rust ecosystem?
It's not rust (it's C), but beanstalkd is a pretty incredible work queue that processes millions of jobs a day (10K+/s at peak) for my company. I know there are a few rust drivers available.
What are some alternatives?
back-to-back - proof of concept io queue
RabbitMQ - Open source RabbitMQ: core server and tier 1 (built-in) plugins
durdur - eBPF-powered L3/L4 packet dropper.
Apache Kafka - Mirror of Apache Kafka
Gearman
NATS - High-Performance server for NATS.io, the cloud and edge native messaging system.
celery - Distributed Task Queue (development branch)
nsq - A realtime distributed messaging platform
Redis - Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.
ZeroMQ - ZeroMQ core engine in C++, implements ZMTP/3.1
pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss
Apache ActiveMQ - Mirror of Apache ActiveMQ