fastapi-cloud-tasks
nvidia-gpu-scheduler
Our great sponsors
fastapi-cloud-tasks | nvidia-gpu-scheduler | |
---|---|---|
2 | 1 | |
32 | 7 | |
- | - | |
0.0 | 0.0 | |
about 1 month ago | over 1 year ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fastapi-cloud-tasks
-
FastAPI Cloud Tasks
We are using https://github.com/Adori/fastapi-cloud-tasks to use Google cloud task with fastapi to trigger cloud tasks functions and schedule tasks. This library does not get updated anymore and before trying to maintain it ourselves we would like to know how other developers are managing cloud tasks en scheduled tasks in the python/fastapi projects?
- Show HN: Strongly typed background jobs with FastAPI and CloudTasks
nvidia-gpu-scheduler
-
[D] How to be more productive while doing Deep Learning experiments?
Sure. No, a simple bash script is not enough. In my case, we have several machines shared in the department, some with GPUs, some without. What I have is a python script that gets a list of jobs and then it schedule them in the first available machine (according to memory/CPU/GPU availability). Unfortunately, what I have is really entangled with our computing platform (Docker-based with a shared filesystem) and not really easy to have it as standalone project (that's why I said "know you infrastructure"). The most similar thing that I could find online is this project. I believe there are then some HPC tools that could be useful (e.g. Slurm), but that's way too much for what we need.
What are some alternatives?
rq-scheduler - A lightweight library that adds job scheduling capabilities to RQ (Redis Queue)
detectron2 - Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
celery - Distributed Task Queue (development branch)
stable-diffusion-nvidia-docker - GPU-ready Dockerfile to run Stability.AI stable-diffusion model v2 with a simple web interface. Includes multi-GPUs support.
dramatiq - A fast and reliable background task processing library for Python 3.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
threaded-cron-task-engine - An multi-threaded cron/supervisord replacement which offers a bit more and is dead simple
tmux - tmux source code