Postgres as Queue

• river

  3 1,945 9.4 Go

  Fast and reliable background jobs in Go (by riverqueue)

  

There's also Riverqueue https://github.com/riverqueue/river

• oban

  27 3,043 9.3 Elixir

  💎 Robust job processing in Elixir, backed by modern PostgreSQL and SQLite3

In Elixir land Oban[0] uses Postgres as queue and seems to work quite well.

[0] - https://github.com/sorentwo/oban

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• worker

  19 1,641 9.7 TypeScript

  High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)

  

Big fan of Graphile Worker to handle this job. https://github.com/graphile/worker

• windmill

  86 8,518 10.0 Svelte

  Open-source developer platform to turn scripts into workflows and UIs. Fastest workflow engine (5x vs Airflow). Open-source alternative to Airplane and Retool.

  

If you need a job queue on Postgres, https://windmill.dev provide an all-integrated developer platform with a Pg queue at its core that support jobs defined in python/typescript/sql

• pg-queue

  2 7 4.7 Python

I wrote one of these not long ago: https://github.com/mattbillenstein/pg-queue

• good_job

  36 2,446 9.3 Ruby

  Multithreaded, Postgres-based, Active Job backend for Ruby on Rails.

In the world of Ruby, GoodJob [0] has been doing a _good job_ so far.

[0] - https://github.com/bensheldon/good_job

• pgmq

  11 864 9.0 Rust

  A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.

  

some notes about pgmq, https://github.com/tembo-io/pgmq, that is on this list. It is built as an extension in Postgres, which makes it compatible with all languages that have a Postgres driver.

There's no 'magic' to it, it uses existing Postgres features so all the performance and consistency guarantees of Postgres are to be expected. Easily gets to 10k+ concurrent reads and writes even on smaller sized Postgres instances, which is more than most applications need.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project