Top 9 Python Scheduling Projects

luigi

14 17,310 6.4 Python

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

Project mention: Ask HN: What is the correct way to deal with pipelines? | news.ycombinator.com | 2023-09-21

I agree there are many options in this space. Two others to consider:
- https://airflow.apache.org/
- https://github.com/spotify/luigi
There are also many Kubernetes based options out there. For the specific use case you specified, you might even consider a plain old Makefile and incrond if you expect these all to run on a single host and be triggered by a new file showing up in a directory…

rocketry

32 3,175 0.6 Python

Modern scheduling library for Python
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
oncall

1 1,102 5.9 Python

Oncall is a calendar tool designed for scheduling and managing on-call shifts. It can be used as source of dynamic ownership info for paging systems like http://iris.claims. (by linkedin)
ecs-deploy

3 827 4.7 Python

Powerful CLI tool to simplify Amazon ECS deployments, rollbacks & scaling (by fabfuel)
pretalx

0 661 9.7 Python

Conference planning tool: CfP, scheduling, speaker management
VMAgent

1 75 1.4 Python

Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.
Lynx

7 44 4.5 Python

A very light weight dependency graph for systems with massive calculation complexities or scheduling systems (by hosseinmoein)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
wheatley

1 27 8.7 Python

Next-generation scheduling problem solver based on GNNs and Reinforcement Learning

Project mention: [D] What's the current state/consensus on using neural networks for solving combinatorial scheduling problems? | /r/MachineLearning | 2023-06-06

See L2D https://github.com/zcaicaros/L2D for a seminal work, and https://github.com/jolibrain/wheatley/ that beats L2D and extends to RCPSPs (aka scheduling with resources), a work by colleagues of mine, with application to real-world scheduling problems.

snag

1 4 5.4 Python

Schedule your tasks so there's not a sausage of CO2

Project mention: Show HN: Snag – schedule tasks to minimise carbon emissions | news.ycombinator.com | 2023-05-12

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).