cadence
proposals
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cadence
- Show HN: Hatchet – Open-source distributed task queue
-
Ask HN: Who is hiring? (December 2023)
Uber | Software Engineers | Hybrid (Denmark) | https://www.uber.com/dk/en/careers/locations/aarhus/
Work with an amazing team responsible for the infrastructure software that makes Uber’s data centers around the world reliable and scalable. If you want to solve the toughest engineering challenges alongside some of the smartest people in the industry, Uber Aarhus is the right place for you.
The team in Aarhus build and operate the stateless and stateful compute platforms used by nearly every other engineer in the company (Up - https://www.uber.com/en-GB/blog/up-portable-microservices-re... and Odin - https://www.uber.com/en-GB/blog/how-uber-optimized-cassandra...) as well as other related infrastructure projects such as Cadence - https://github.com/uber/cadence.
-
Best way to schedule events and handle them in the future?
May be this..https://cadenceworkflow.io/
- Mandala: experiment data management as a built-in (Python) language feature
-
Why messaging is much better than REST for inter-microservice communications
Having done a reasonable amount of messaging code in my time, I would say the final form of this sort of thing might look more like Cadence[0] than anything like this.
-
cadence VS javactrl-kafka - a user suggested alternative
2 projects | 2 Feb 2023
-
[P] My co-founder and I quit our engineering jobs at AWS to build “Tensor Search”. Here is why.
Emit events from your primary DB (postgres, etc.) to something like kafka or rabbitmq and then catch that in your search engine. There's also some end-to-end solutions like temporal (temporal.io) or cadence (https://cadenceworkflow.io/)
-
Workflow Engines
Are there any mature workflow engines such as https://github.com/uber/cadence but with Rust client support?
-
How can you ensure all Microservices have finished their tasks?
You should definitely check Uber Cadence https://cadenceworkflow.io/
- Apache Hop 2.0
proposals
-
Is there an alternative for Airflow for running thousands of dynamic tasks?
Check out temporal.io open source project. It was built at Uber for large scale business-level processes. So any data pipelines are low-rate use cases by definition.
-
How to handle background jobs in Rust?
Otherwise you may want to look into Kafka or Fluvio to ensure that task runs at least once. If you're doing something like batch operations as a background task, Temporal is another great option.
-
No-code or Workflow as code? Better both
The runtime is developed using Temporal, which is one of the main tools that we are currently using at KuFlow. Thanks to, all the workflow executions are robust: your application will be durable, reliable, and scalable.
-
Temporal Programming, a new name for an old paradigm
Hmmm I got confused by the name. I thought it's related to https://temporal.io/
-
Possible innovations in Event Sourcing frameworks.
Have you looked at temporal.io open source platform? It uses event sourcing as an implementation detail. But it greatly simplifies the user experience compared to "raw event sourcing."
-
After Airflow. Where next for DE?
Rewrite Airflow on top of temporal.io. This way, you get unlimited scalability and very high reliability out of the box and would be able to innovate on the features that matter for DE.
-
How KuFlow supports Temporal as a worfkows engine for our processes?
In such a diverse world, it would be boring to have a single way of doing things. That's why at KuFlow we support different ways to implement the logic of our processes and tasks. And in this post, we will talk about one of them, the orchestration through Temporal, which gives us a powerful way to manage our workflows.
-
How to do distributed cronjobs with worker queues?
Use Temporal open source project. It is much more than a cronjob service. But it supports managing periodic jobs natively.
-
Laravel Workflow: Orchestration vs. Choregraphy?
It is the same type of code that is in AWS Step Functions, Azure Durable Functions and Temporal.
-
Looking for a mature distributed task queuer/scheduler in go
Give Temporal a look https://temporal.io/
What are some alternatives?
temporal - Temporal service
Flowable (V6) - A compact and highly efficient workflow and Business Process Management (BPM) platform for developers, system admins and business users.
conductor - Conductor is a microservices orchestration engine.
gocelery - Celery Distributed Task Queue in Go
Asynq - Simple, reliable, and efficient distributed task queue in Go
docker-compose - Temporal docker-compose files
Faktory - Language-agnostic persistent background job server
machinery - Machinery is an asynchronous task queue/job queue based on distributed message passing.
argo-events - Event-driven Automation Framework for Kubernetes
optimus - Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
cron - a cron library for go
Maestro - Maestro is a language agnostic Open Source Job Queuing System written in Go