Python Job Scheduler

Open-source Python projects categorized as Job Scheduler
Edit details
Topics: #Python #Workflow #Data Science #workflow-automation #Scheduler
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com
Sponsored

Top 12 Python Job Scheduler Projects

  • Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: self hosted Alternative to easycron.com? | reddit.com/r/selfhosted | 2022-12-30

  • schedule

    Python job scheduling for humans.

    Project mention: simple CPP schedule library | reddit.com/r/cpp_questions | 2023-03-08

    similar to this this library in python3

  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • APScheduler

    Task scheduling library for Python

    Project mention: Libs or advice on how to handle time in Django | reddit.com/r/django | 2022-11-18

  • Joblib

    Computing with Python functions.

  • skypilot

    SkyPilot is a framework for easily running machine learning workloads on any cloud through a unified interface.

    Project mention: Show HN: Run LLaMA LLM chatbots on any cloud with one click | news.ycombinator.com | 2023-03-21

  • doit

    task management & automation tool

    Project mention: Write Posix Shell | news.ycombinator.com | 2023-03-11

    If you code in Python, your probably should use the language as much as possible and avoid calling shell commands.

    E.G:

    - manipulate the file system with pathlib

    - do hashes with hashlib

    - zip with zipfile

    - set error code with sys.exit

    - use os.environ for env vars

    - print to stderr with print(..., file=...)

    - sometimes you'll need to install lib. Like, if you want to manipulate a git repo, instead of calling the git command, use gitpython (https://gitpython.readthedocs.io/en/stable/)

    But if you don't feel like installing a too many libs, or just really want to call commands because you know them well, then the "sh" lib is going to make things smoother:

    https://pypi.org/project/sh/

    Also, enjoy the fact Python comes with argparse to parse script arguments (or if you feel like installing stuff, use typer). It sucks to do it in bash .

    If what you need is more build oriented, like something to replace "make", then I would instead recommend "doit":

    https://pydoit.org/

    It's the only task runner that I haven't run away from yet.

    Remember to always to everything in a venv. But you can have a giant venv for all the scripts, and just she-bang the venv python executable so that it's transparent. Things don't have to be difficult.

  • Spiff

    A powerful workflow engine implemented in pure Python

    Project mention: Looking for beginner/intermediate level open source projects to contribute to | reddit.com/r/Python | 2022-10-17

    u/kaerfkeerg's recommendation is the best general advice -- but you might take a look at SpiffWorkflow, an open source library that allows novice programmers and BA's to contribute directly to major software projects. It's smaller, lesser known project, but fully open source with lots of oppertunity to make important contributions.

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • Plan

    Crontab jobs management in Python

  • django-schedule

    A calendaring app for Django. It is now stable, Please feel free to use it now. Active development has been taken over by bartekgorny.

  • gunnery

    Remote task execution tool

  • TaskFlow

    A library to complete workflows/tasks in HA manner. Mirror of code maintained at opendev.org. (by openstack)

  • JDR

    Job Dependency Runner

    Project mention: JDR Tool Introduction (Job Dependency Runner) | reddit.com/r/madeinpython | 2023-03-19

    Documentation: https://hackmd.io/xsLDRVAMTF2gO0YHo3lxYw

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-03-21.

Python Job Scheduler related posts

Index

What are some of the best open-source Job Scheduler projects in Python? This list will help you:

Project Stars
1 Prefect 11,503
2 schedule 10,643
3 APScheduler 4,900
4 Joblib 3,096
5 skypilot 1,564
6 doit 1,552
7 Spiff 1,403
8 Plan 1,164
9 django-schedule 814
10 gunnery 750
11 TaskFlow 332
12 JDR 4

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com