#Job Scheduler

Open-source projects categorized as Job Scheduler | Edit details

Top 23 Job Scheduler Open-Source Projects

  • GitHub repo schedule

    Python job scheduling for humans.

  • GitHub repo agenda

    Lightweight job scheduling for Node.js

    Project mention: 3 Task Scheduling Packages for Node.js | dev.to | 2021-05-28

    Agenda

  • GitHub repo Prefect

    The easiest way to automate your data

    Project mention: Hi, how can I do pipeline automation? | reddit.com/r/learnpython | 2021-04-18

    If you are just starting out or new to doing automation, I would look at just python scripts executed with CRON if on Linux/Mac or Windows Task Scheduler if on Windows. But you'll need bash (Linux/Mac) knowledge or DOS/batch knowledge (Windows). Then graduate to using frameworks. Since you didnt specify what types of jobs you want to automate, for general purpose needs, I would look at a class of frameworks called task orchestration frameworks or workflow management libraries. I would highly recommend dagster as it comes with a native scheduler so you would be free from having to use CRON or Windows Task Scheduler. Other options include prefect, but if you want its other features like its scheduler and web GUI, you'll have to mess with docker. That's what's nice about dagster, it all works out of the box without need for non-Python dependencies.

  • GitHub repo incubator-dolphinscheduler

    Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available `out of the box`.

    Project mention: The Apache Software Foundation Announces Apache® DolphinScheduler™ as a Top-Level Project | reddit.com/r/u_mrlifeng | 2021-04-11

    Apache DolphinScheduler software is released under the Apache License v2.0 and is overseen by a self-selected team of active contributors to the project. A Project Management Committee (PMC) guides the Project’s day-to-day operations, including community development and product releases. For downloads, documentation, and ways to become involved with Apache DolphinScheduler, visit https://DolphinScheduler.apache.org/ , https://twitter.com/DolphinSchedule , and https://asf-dolphinscheduler.slack.com/ .

  • GitHub repo android-job

    Android library to handle jobs in the background.

    Project mention: Why is the android app always consuming CPU when "idle"? | reddit.com/r/EufyCam | 2021-05-16

    The lazy programmers are using deprecated code from https://github.com/evernote/android-job to create alarms, but that project is no longer maintained, and is probably very buggy, and they are most likely using the API wrong in the first place.

  • GitHub repo QuartzNet

    Quartz Enterprise Scheduler .NET

    Project mention: A little help with Task async await | reddit.com/r/dotnet | 2021-04-22

    If what you are looking for is background processing, look into Quartz, HangFire and event driven architecture. Have fun learning about this the coming years as this will keep you busy for quite some time.😀

  • GitHub repo Faktory

    Language-agnostic persistent background job server

    Project mention: What is everyone using for job scheduling? | reddit.com/r/golang | 2021-04-13

    In the Ruby world Sidekiq is very popular, I've seen the faktory service and companion go library which looks like it might work (https://github.com/contribsys/faktory) but may be a bit heavy for my needs.

  • GitHub repo APScheduler

    Task scheduling library for Python

    Project mention: Scheduling All Kinds of Recurring Jobs with Python | dev.to | 2020-11-14

    The most feature rich and powerful library for scheduling jobs of any kind in Python is definitely APScheduler, which stands for Advanced Python Scheduler.

  • GitHub repo Joblib

    Computing with Python functions.

    Project mention: Celery & Scikit-Learn: Using n_jobs under a Celery task throws joblib/Loky warning | reddit.com/r/learnpython | 2021-05-12

    Here's a thread from a few years ago btw on using billiard as a backend for joblib. https://github.com/joblib/joblib/issues/311

  • GitHub repo Bee-Queue

    A simple, fast, robust job/task queue for Node.js, backed by Redis.

  • GitHub repo Foundatio

    Pluggable foundation blocks for building distributed apps.

  • GitHub repo Plan

    Crontab jobs management in Python

  • GitHub repo doit

    task management & automation tool

    Project mention: A stupid simple make wrapper that makes my life easier | news.ycombinator.com | 2021-06-03
  • GitHub repo Spiff

    A powerful workflow engine implemented in pure Python

  • GitHub repo gocron

    Easy and fluent Go cron scheduling. This is a fork from https://github.com/jasonlvhit/gocron

    Project mention: Chrono is a scheduler library that lets you run your tasks and code periodically | reddit.com/r/golang | 2021-05-30
  • GitHub repo django-schedule

    A calendaring app for Django. It is now stable, Please feel free to use it now. Active development has been taken over by bartekgorny.

  • GitHub repo gunnery

    Remote task execution tool

  • GitHub repo openpbs

    An HPC workload manager and job scheduler for desktops, clusters, and clouds.

    Project mention: A PBS question. | reddit.com/r/HPC | 2021-01-23

    So the one in GitHub (https://github.com/openpbs/openpbs) is abandoned or still going on?

  • GitHub repo db-scheduler

    Persistent cluster-friendly scheduler for Java

  • GitHub repo TaskFlow

    A library to complete workflows/tasks in HA manner. Mirror of code maintained at opendev.org. (by openstack)

  • GitHub repo SwiftQueue

    Job Scheduler for IOS with Concurrent run, failure/retry, persistence, repeat, delay and more

  • GitHub repo neph

    A modern command line job processor, similar with make command

  • GitHub repo Factotum

    A system to programmatically run data pipelines

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-06-03.

Index

What are some of the best open-source Job Scheduler projects? This list will help you:

Project Stars
1 schedule 8,701
2 agenda 7,538
3 Prefect 6,425
4 incubator-dolphinscheduler 5,932
5 android-job 5,374
6 QuartzNet 4,529
7 Faktory 4,327
8 APScheduler 3,448
9 Joblib 2,460
10 Bee-Queue 2,426
11 Foundatio 1,400
12 Plan 1,134
13 doit 1,038
14 Spiff 974
15 gocron 882
16 django-schedule 790
17 gunnery 730
18 openpbs 452
19 db-scheduler 397
20 TaskFlow 289
21 SwiftQueue 283
22 neph 175
23 Factotum 162