nvidia-gpu-scheduler
fastapi-cloud-tasks
Our great sponsors
| nvidia-gpu-scheduler | fastapi-cloud-tasks | |
|---|---|---|
| 1 | 2 | |
| 7 | 32 | |
| - | - | |
| 0.0 | 0.0 | |
| over 1 year ago | about 1 month ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nvidia-gpu-scheduler
-
[D] How to be more productive while doing Deep Learning experiments?
Sure. No, a simple bash script is not enough. In my case, we have several machines shared in the department, some with GPUs, some without. What I have is a python script that gets a list of jobs and then it schedule them in the first available machine (according to memory/CPU/GPU availability). Unfortunately, what I have is really entangled with our computing platform (Docker-based with a shared filesystem) and not really easy to have it as standalone project (that's why I said "know you infrastructure"). The most similar thing that I could find online is this project. I believe there are then some HPC tools that could be useful (e.g. Slurm), but that's way too much for what we need.
fastapi-cloud-tasks
-
FastAPI Cloud Tasks
We are using https://github.com/Adori/fastapi-cloud-tasks to use Google cloud task with fastapi to trigger cloud tasks functions and schedule tasks. This library does not get updated anymore and before trying to maintain it ourselves we would like to know how other developers are managing cloud tasks en scheduled tasks in the python/fastapi projects?
- Show HN: Strongly typed background jobs with FastAPI and CloudTasks
What are some alternatives?
detectron2 - Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
rq-scheduler - A lightweight library that adds job scheduling capabilities to RQ (Redis Queue)
stable-diffusion-nvidia-docker - GPU-ready Dockerfile to run Stability.AI stable-diffusion model v2 with a simple web interface. Includes multi-GPUs support.
celery - Distributed Task Queue (development branch)
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
dramatiq - A fast and reliable background task processing library for Python 3.
tmux - tmux source code
threaded-cron-task-engine - An multi-threaded cron/supervisord replacement which offers a bit more and is dead simple
Sacred - Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
deck-chores - A job scheduler for Docker containers, configured via labels.
aim - Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
gesture - Simple, robust background processing for Python