Top 6 Python slurm Projects

ml-engineering

9 9,753 9.7 Python

Machine Learning Engineering Open Book

Project mention: Accelerators | news.ycombinator.com | 2024-02-22

toil

2 869 9.2 Python

A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.

Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08

a little late now, but I wonder if https://github.com/DataBiosphere/toil might meet your requirements

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
slurm-mail

1 82 9.3 Python

Slurm-Mail is a drop in replacement for Slurm's e-mails to give users much more information about their jobs compared to the standard Slurm e-mails.

Project mention: Send custom email only when jobs fails. | /r/SLURM | 2023-06-28

Since I am unsure how your HPC admin implemented email sending, you might want to talk to your HPC administrator and see if they could implement something like slurm-mail. It has been working very well for the my managed cluster so far and is very customisable based on users' need.

stui

1 71 0.0 Python

A Slurm dashboard for the terminal.
soopervisor

3 42 5.0 Python

☁️ Export Ploomber pipelines to Kubernetes (Argo), Airflow, AWS Batch, SLURM, and Kubeflow.
slurm-monitoring-public

1 17 0.0 Python

Monitor your high performance infrastructure configured over slurm using TIG stack

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).