Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Job Scheduler Open-Source Projects
-
incubator-dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
Resque
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
-
django-schedule
A calendaring app for Django. It is now stable, Please feel free to use it now. Active development has been taken over by bartekgorny.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13
Project mention: The GIL can now be disabled in Python's main branch | news.ycombinator.com | 2024-03-11Thank you for your insight!
I asked about it to the dev if you're interested, by the way. No replies yet though, since the lib isn't very active to begin with.
While many ways to write scalable Node.js applications exist, all narrow down to the underlying architecture. However, common hurdles in Node.js include serving static files, task scheduling, and utilizing available resources. To combat these, you can use a tactical approach. Because serving static assets with Node.js takes CPU time, a proxy content delivery network like CloudFront should help fix it. Recurring tasks need to fire events, which isn’t reliable with setTimeout or setInterval. As a solution, you can use a task scheduler framework like agenda.js. To handle resource utilization, you can use the cluster feature in Node.js, which listens to ports, accepts new connections, and distributes them across workers with built-in smarts to avoid overloading the process.
Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04
Project mention: Faktory: Language-agnostic persistent background job server | news.ycombinator.com | 2023-12-25
Project mention: JobRunr: A library for background processing in Java | news.ycombinator.com | 2023-05-25Looks like it's abandoned fork and the current development is at https://github.com/go-co-op/gocron
Project mention: How do you deal with CI, project config, etc. falling out of sync across repos? | /r/ExperiencedDevs | 2023-12-06I like mage for Go and doit for Python.
Project mention: Open source Job Scheduler Library in java for high throughput | /r/java | 2023-11-20In java we have found Quartz( Quartz) , Job Runr(Jobrunr) and db-scheduler(db-scheduler) and need to evaluate these for our use case.
Job Scheduler related posts
- Prefect: A workflow orchestration tool for data pipelines
- The GIL can now be disabled in Python's main branch
- Faktory: Language-agnostic persistent background job server
- How do you deal with CI, project config, etc. falling out of sync across repos?
- Show HN: Jeeves – A Pythonic Alternative to GNU Make
- Software Disenchantment
- MongoDB Materialized Views in NodeJS + Mongoose
-
A note from our sponsor - InfluxDB
www.influxdata.com | 19 Apr 2024
Index
What are some of the best open-source Job Scheduler projects? This list will help you:
Project | Stars | |
---|---|---|
1 | Prefect | 14,512 |
2 | incubator-dolphinscheduler | 11,969 |
3 | schedule | 11,467 |
4 | Resque | 9,385 |
5 | agenda | 9,232 |
6 | PowerJob | 6,446 |
7 | QuartzNet | 6,212 |
8 | APScheduler | 5,688 |
9 | skypilot | 5,602 |
10 | Faktory | 5,469 |
11 | gocron | 4,882 |
12 | Joblib | 3,647 |
13 | Bee-Queue | 3,610 |
14 | Foundatio | 1,904 |
15 | doit | 1,780 |
16 | go-quartz | 1,641 |
17 | Spiff | 1,590 |
18 | Plan | 1,167 |
19 | db-scheduler | 1,111 |
20 | django-schedule | 833 |
21 | gunnery | 755 |
22 | openpbs | 671 |
23 | Furiko | 458 |