Show HN: Hatchet – Open-source distributed task queue

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • hatchet

    A distributed, fault-tolerant task queue

  • Yep, we're backed by YC in the W24 batch - this is evident on our landing page [1].

    We're both second time CTOs and we've been on both sides of this, as consumers of and creators of OSS. I was previously a co-founder and CTO of Porter [2], which had an open-core model. There are two risks that most companies think about in the open core model:

    1. Big companies using your platform without contributing back in some way or buying a license. I think this is less of a risk, because these organizations are incentivized to buy a support license to help with maintenance, upgrades, and since we sit on a critical path, with uptime.

    2. Hyperscalers folding your product in to their offering [3]. This is a bigger risk but is also a bit of a "champagne problem".

    Note that smaller companies/individual developers are who we'd like to enable, not crowd out. If people would like to use our cloud offering because it reduces the headache for them, they should do so. If they just want to run our service and manage their own PostgreSQL, they should have the option to do that too.

    Based on all of this, here's where we land on things:

    1. Everything we've built so far has been 100% MIT licensed. We'd like to keep it that way and make money off of Hatchet Cloud. We'll likely roll out a separate enterprise support agreement for self hosting.

    2. Our cloud version isn't going to run a different core engine or API server than our open source version. We'll write interfaces for all plugins to our servers and engines, so even if we have something super specific to how we've chosen to do things on the cloud version, we'll expose the options to write your own plugins on the engine and server.

    3. We'd like to make self-hosting as easy to use as our cloud version. We don't want our self-hosted offering to be a second-class citizen.

    Would love to hear everyone's thoughts on this.

    [1] https://hatchet.run

    [2] https://github.com/porter-dev/porter

    [3] https://www.elastic.co/blog/why-license-change-aws

  • svix-webhooks

    The enterprise-ready webhooks service 🦀

  • That's exactly why we built Svix[1]. Building webhooks services, even with amazing tools like FastAPI, Celery and Redis is still a big pain. So we just built a product to solve it.

    Hatchet looks cool nonetheless. Queues are a pain for many other use-cases too.

    1: https://www.svix.com

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • sdk-java

    Temporal Java SDK

  • How does this compare against Temporal/Cadence/Conductor? Does hatchet also support durable execution?

    https://temporal.io/

  • conductor

    Conductor is an event driven orchestration platform (by conductor-oss)

  • cadence

    Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

  • porter

    Kubernetes powered PaaS that runs in your own cloud.

  • Yep, we're backed by YC in the W24 batch - this is evident on our landing page [1].

    We're both second time CTOs and we've been on both sides of this, as consumers of and creators of OSS. I was previously a co-founder and CTO of Porter [2], which had an open-core model. There are two risks that most companies think about in the open core model:

    1. Big companies using your platform without contributing back in some way or buying a license. I think this is less of a risk, because these organizations are incentivized to buy a support license to help with maintenance, upgrades, and since we sit on a critical path, with uptime.

    2. Hyperscalers folding your product in to their offering [3]. This is a bigger risk but is also a bit of a "champagne problem".

    Note that smaller companies/individual developers are who we'd like to enable, not crowd out. If people would like to use our cloud offering because it reduces the headache for them, they should do so. If they just want to run our service and manage their own PostgreSQL, they should have the option to do that too.

    Based on all of this, here's where we land on things:

    1. Everything we've built so far has been 100% MIT licensed. We'd like to keep it that way and make money off of Hatchet Cloud. We'll likely roll out a separate enterprise support agreement for self hosting.

    2. Our cloud version isn't going to run a different core engine or API server than our open source version. We'll write interfaces for all plugins to our servers and engines, so even if we have something super specific to how we've chosen to do things on the cloud version, we'll expose the options to write your own plugins on the engine and server.

    3. We'd like to make self-hosting as easy to use as our cloud version. We don't want our self-hosted offering to be a second-class citizen.

    Would love to hear everyone's thoughts on this.

    [1] https://hatchet.run

    [2] https://github.com/porter-dev/porter

    [3] https://www.elastic.co/blog/why-license-change-aws

  • river

    Fast and reliable background jobs in Go (by riverqueue)

  • How does this compare to River Queue (https://riverqueue.com/)? Besides the additional Python and TS client libraries.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • inngest-js

    The developer platform for easily building reliable workflows with zero infrastructure for TypeScript & JavaScript

  • You might want to look at https://www.inngest.com for that. Disclaimer: I'm a cofounder. We released event-driven step functions about 20 months ago.

  • toil

    A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

  • a little late now, but I wonder if https://github.com/DataBiosphere/toil might meet your requirements

  • wakaq

    Background task queue for Python backed by Redis, a super minimal Celery

  • wakaq-ts

    Background task queue for TypeScript backed by Redis, a super minimal Celery

  • client_python

    Prometheus instrumentation library for Python applications

  • Here you go: https://stackoverflow.com/questions/75652326/celery-spawn-si...

    Plus some adjacent discussion on GitHub: https://github.com/prometheus/client_python/issues/902

    Hope that helps!

  • neoq

    Queue-agnostic background job library for Go, with a pleasant API and powerful features.

  • gue

    Golang queue on top of PostgreSQL

  • pgmq

    A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.

  • Have you considered https://github.com/tembo-io/pgmq for the queue bit?

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts