Anyone leveraged spot instances/elastic instances on AWS for sidekiq workers?

This page summarizes the projects mentioned and recommended in the original post on /r/rails
Queue Ruby Sidekiq background-jobs Jobs

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • kube-sidekiq-autoscale

    Dynamically scale k8s resources using the amount of enqueued Sidekiq jobs to determine the load

    • We've done something very similar to auto scale Sidekiq worker containers running on preemptible/spot VM nodes within Google Cloud Kubernetes Engine using https://github.com/streemau/kube-sidekiq-autoscale.

  • Sidekiq

    Simple, efficient background processing for Ruby

    • Not sure about EKS on AWS but on GCP spot instances have a 30s graceful shutdown which is enough for most of our jobs to complete, otherwise they'll be picked up again by the next worker since we use Sidekiq Pro and its https://github.com/sidekiq/sidekiq/wiki/Reliability feature

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts