Python Scheduler

Open-source Python projects categorized as Scheduler

Top 23 Python Scheduler Projects

  • Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  • Project mention: How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop | dev.to | 2024-06-17

    Instead of the custom orchestrator I used, a proper orchestration tool should replace it like Apache Airflow, Dagster, ..., etc.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • dagster

    An orchestration platform for the development, production, and observation of data assets.

  • Project mention: How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop | dev.to | 2024-06-17

    Instead of the custom orchestrator I used, a proper orchestration tool should replace it like Apache Airflow, Dagster, ..., etc.

  • rocketry

    Modern scheduling library for Python

  • rq-scheduler

    A lightweight library that adds job scheduling capabilities to RQ (Redis Queue)

  • flask-apscheduler

    Adds APScheduler support to Flask

  • couler

    Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

  • Project mention: (Not) to Write a Pipeline | news.ycombinator.com | 2023-06-27

    author seems to be describing the kind of patterns you might make with https://argoproj.github.io/argo-workflows/ . or see for example https://github.com/couler-proj/couler , which is an sdk for describing tasks that may be submitted to different workflow engines on the backend.

    it's a little confusing to me that the author seems to object to "pipelines" and then equate them with messaging-queues. for me at least, "pipeline" vs "workflow-engine" vs "scheduler" are all basically synonyms in this context. those things may or may not be implemented with a message-queue for persistence, but the persistence layer itself is usually below the level of abstraction that $current_problem is really concerned with. like the author says, eventually you have to track state/timestamps/logs, but you get that from the beginning if you start with a workflow engine.

    i agree with author that message-queues should not be a knee-jerk response to most problems because the LoE for edge-cases/observability/monitoring is huge. (maybe reach for a queue only if you may actually overwhelm whatever the "scheduler" can handle.) but don't build the scheduler from scratch either.. use argowf, kubeflow, or a more opinionated framework like airflow, mlflow, databricks, aws lamda or step-functions. all/any of these should have config or api that's robust enough to express rate-limit/retry stuff. almost any of these choices has better observability out-of-the-box than you can easily get from a queue. but most importantly.. they provide idioms for handling failure that data-science folks and junior devs can work with. the right way to structure code is just much more clear and things like structuring messages/events, subclassing workers, repeating/retrying tasks, is just harder to mess up.

  • OpenCue

    A render management system you can deploy for visual effects and animation productions.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • scheduler-component

    Custom component for HA that enables the creation of scheduler entities

  • girok

    A powerful and beautiful CLI scheduler

  • TerrariumPI

    Home automated terrarium/aquarium or other enclosed environment with a Raspberry Pi

  • django-q2

    A multiprocessing distributed task queue for Django. Django Q2 is a fork of Django Q. Big thanks to Ilan Steemers for starting this project. Unfortunately, development has stalled since June 2021. Django Q2 is the new updated version of Django Q, with dependencies updates, docs updates and several bug fixes. Original repository: https://github.com/Koed00/django-q

  • Flask-RQ2

    A Flask extension for RQ.

  • deck-chores

    A job scheduler for Docker containers, configured via labels.

  • diffusion-for-beginners

    denoising diffusion models, as simple as possible

  • beatserver

    Beatserver, a periodic task scheduler for Django 🎵

  • plugsched

    Live upgrade Linux kernel scheduler subsystem

  • walnats

    🌰 Nats-powered event-driven background jobs and microservices framework for Python.

  • scheduler

    A simple in-process python scheduler library with asyncio, threading and timezone support. Schedule tasks by their time cycles, fixed times, weekdays, dates, weights, offsets and execution counts and automate Jobs. (by DigonIO)

  • Project mention: Push notifications from server with Telegram Bot API | dev.to | 2024-06-16

    For something more serious I would recommend using scheduler, but I don't see why a barebones while loop with a time.sleep won't do the same thing.

  • AnnA_Anki_neuronal_Appendix

    Using machine learning on your anki collection to enhance the scheduling via semantic clustering and semantic similarity

  • WSPRBeacon

    Worldwide Network of WSPR Beacons

  • regta

    📅 Production-ready scheduler with async, multithreading and multiprocessing support for Python

  • Project mention: [Automation] Scheduling Python Programs: Pushing Notifications, Executing SQLs, etc... | dev.to | 2023-09-24

    If your automation needs are focused on Python exclusively, Regta emerges as a compelling option, offering a wealth of Python-specific optimizations. Give it a try, and feel free to share your thoughts in the comments 🙌

  • JDR

    Job Dependency Runner

  • pipelines

    Create Async Processing Pipelines Quick! (by theboxahaan)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Scheduler discussion

Log in or Post with

Python Scheduler related posts

  • Loading large amount of data - when is best?

    2 projects | /r/flask | 9 Feb 2023
  • How do you manage scheduled tasks?

    4 projects | /r/selfhosted | 10 Jan 2023
  • self hosted Alternative to easycron.com?

    7 projects | /r/selfhosted | 30 Dec 2022
  • Is SQL a prerequisite to learning Python ?

    3 projects | /r/Python | 29 Dec 2022
  • Easiest way to run a scheduled Python script?

    1 project | /r/learnpython | 3 Dec 2022
  • Scheduling in Data Engineering

    3 projects | /r/dataengineering | 1 Dec 2022
  • Run external programs intuitively in Python

    5 projects | /r/Python | 12 Nov 2022
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 20 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Scheduler projects in Python? This list will help you:

Project Stars
1 Airflow 35,036
2 dagster 10,552
3 rocketry 3,209
4 rq-scheduler 1,399
5 flask-apscheduler 1,097
6 couler 895
7 OpenCue 814
8 scheduler-component 598
9 girok 454
10 TerrariumPI 398
11 django-q2 293
12 Flask-RQ2 225
13 deck-chores 192
14 diffusion-for-beginners 145
15 beatserver 142
16 plugsched 79
17 walnats 64
18 scheduler 64
19 AnnA_Anki_neuronal_Appendix 57
20 WSPRBeacon 42
21 regta 20
22 JDR 3
23 pipelines 3

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com