Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Top 18 Ruby Queue Projects
-
Project mention: Sidekiq / Redis fail to deploy background job with render.com | reddit.com/r/rails | 2023-03-23
Starting service with 'bundle exec sidekiq' Mar 23 04:44:14 PM 2023-03-23T20:44:14.698Z pid=68 tid=2ks INFO: Booted Rails 7.0.4.2 application in production environment Mar 23 04:44:14 PM 2023-03-23T20:44:14.699Z pid=68 tid=2ks INFO: Running in ruby 3.1.3p185 (2022-11-24 revision 1a6b16756e) [x86_64-linux] Mar 23 04:44:14 PM 2023-03-23T20:44:14.699Z pid=68 tid=2ks INFO: See LICENSE and the LGPL-3.0 for licensing details. Mar 23 04:44:14 PM 2023-03-23T20:44:14.699Z pid=68 tid=2ks INFO: Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org Mar 23 04:44:14 PM 2023-03-23T20:44:14.699Z pid=68 tid=2ks INFO: Sidekiq 7.0.7 connecting to Redis with options {:size=>5, :pool_name=>"internal", :url=>"redis://red-cgc7iqo2qv267ubpeaf0:6379"} Mar 23 04:44:14 PM getaddrinfo: Name or service not known Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/3.1.0/socket.rb:227:in `getaddrinfo' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/3.1.0/socket.rb:227:in `foreach' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/3.1.0/socket.rb:632:in `tcp' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client/ruby_connection.rb:111:in `connect' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client/ruby_connection.rb:49:in `initialize' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:671:in `new' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:671:in `block in connect' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client/middlewares.rb:12:in `connect' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:670:in `connect' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:657:in `raw_connection' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:624:in `ensure_connected' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client.rb:209:in `call' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/redis-client-0.14.0/lib/redis_client/decorator.rb:26:in `call' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/lib/sidekiq/config.rb:137:in `block in redis_info' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/lib/sidekiq/config.rb:156:in `block in redis' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/connection_pool-2.3.0/lib/connection_pool.rb:65:in `block (2 levels) in with' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/connection_pool-2.3.0/lib/connection_pool.rb:64:in `handle_interrupt' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/connection_pool-2.3.0/lib/connection_pool.rb:64:in `block in with' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/connection_pool-2.3.0/lib/connection_pool.rb:61:in `handle_interrupt' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/connection_pool-2.3.0/lib/connection_pool.rb:61:in `with' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/lib/sidekiq/config.rb:153:in `redis' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/lib/sidekiq/config.rb:136:in `redis_info' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/lib/sidekiq/cli.rb:75:in `run' Mar 23 04:44:14 PM /opt/render/project/.gems/ruby/3.1.0/gems/sidekiq-7.0.7/bin/sidekiq:31:in `' Mar 23 04:44:14 PM /opt/render/project/.gems/bin/sidekiq:27:in `load' Mar 23 04:44:14 PM /opt/render/project/.gems/bin/sidekiq:27:in `' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:58:in `load' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:58:in `kernel_load' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:23:in `run' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:492:in `exec' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/command.rb:27:in `run' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/invocation.rb:127:in `invoke_command' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor.rb:392:in `dispatch' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:34:in `dispatch' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/base.rb:485:in `start' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:28:in `start' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/gems/3.1.0/gems/bundler-2.4.9/exe/bundle:45:in `block in ' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/site_ruby/3.1.0/bundler/friendly_errors.rb:117:in `with_friendly_errors' Mar 23 04:44:14 PM /opt/render/project/rubies/ruby-3.1.3/lib/ruby/gems/3.1.0/gems/bundler-2.4.9/exe/bundle:33:in `' Mar 23 04:44:14 PM /opt/render/project/.gems/bin/bundle:113:in `load' Mar 23 04:44:14 PM /opt/render/project/.gems/bin/bundle:113:in `'
-
Resque
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
Project mention: Add web scraping data into the database at regular intervals [ruby & ror] | reddit.com/r/learnprogramming | 2022-06-16You can use a background job queue like Resque to scrape and process data in the background, and a scheduler like resque-scheduler to schedule jobs to run your scraper periodically.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: How to narrow down race condition in delayed job/mysql2? | reddit.com/r/rails | 2023-01-31
I included this in the github issue but we had coverband induced log spam, it got fixed and suddenly we hit the bug. I did find this from someone with a similar issue but there was no conclusion.
-
Sucker Punch
Sucker Punch is a Ruby asynchronous processing library using concurrent-ruby, heavily influenced by Sidekiq and girl_friday.
-
-
-
Project mention: Sidekiq (a Ruby background processing lib) has made $13.5M in 10 years | news.ycombinator.com | 2022-04-05
Sidekiq has stayed with me for most of my rails projects. Happy to read this. And I bet I'll continue to remember it as I run into projects that were inspired by it, like Shoryuken (which tries to be "sidekiq for AWS SNS/SQS" https://github.com/ruby-shoryuken/shoryuken).
-
InfluxDB
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
-
In this case I would try to set up tcn (a Postgres extension) and a trigger that inserts a job in a goodjob jobs table. https://github.com/bensheldon/good_job is like sidekiq but uses Postgres as a queue.
-
Project mention: Add web scraping data into the database at regular intervals [ruby & ror] | reddit.com/r/learnprogramming | 2022-06-16
You can use a background job queue like Resque to scrape and process data in the background, and a scheduler like resque-scheduler to schedule jobs to run your scraper periodically.
-
Project mention: ruby-kafka has been officially deprecated and is no longer recommended for production usage | reddit.com/r/ruby | 2022-12-08
It is no longer recommended for production usage. If you use it, you can either switch to rdkafka-ruby or one of high-level libraries like karafka.
-
-
-
-
Project mention: Announcing sidekiq-iteration - a gem that makes your sidekiq jobs interruptible and resumable by design | reddit.com/r/ruby | 2022-11-02
Richard, thank you for the comment. You can also look at nested iterations enumerator - https://github.com/fatkodima/sidekiq-iteration#nested-iteration with a custom enumerator - https://github.com/fatkodima/sidekiq-iteration/blob/master/guides/custom-enumerator.md (if you are iterating over some non-activerecord resources for each repository).
-
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Ruby Queue related posts
- Sidekiq / Redis fail to deploy background job with render.com
- How do you go about consuming APIs from your Rails app? Looking for advice on process and architecture
- Watching for changes to DB by another app
- Anyone leveraged spot instances/elastic instances on AWS for sidekiq workers?
- Sidekiq + Redis in Heroku Production
- Is Ruby on the right track with Ractors? I think not.
- How to send slack notifications from Rails app using sidekiq
-
A note from our sponsor - InfluxDB
www.influxdata.com | 23 Mar 2023
Index
What are some of the best open-source Queue projects in Ruby? This list will help you:
Project | Stars | |
---|---|---|
1 | Sidekiq | 12,383 |
2 | Resque | 9,273 |
3 | Delayed::Job | 4,756 |
4 | Sucker Punch | 2,603 |
5 | Sneakers | 2,195 |
6 | Que | 2,174 |
7 | Shoryuken | 1,953 |
8 | good_job | 1,744 |
9 | resque-scheduler | 1,734 |
10 | Karafka | 1,656 |
11 | Bunny | 1,326 |
12 | Backburner | 420 |
13 | RocketJob | 286 |
14 | sidekiq-iteration | 167 |
15 | Lowkiq | 137 |
16 | March Hare | 98 |
17 | Sidekiq::Undertaker | 18 |
18 | Laboristo | 2 |