Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Top 23 Python Celery Projects
-
full-stack-fastapi-postgresql
Full stack, modern web application generator. Using FastAPI, PostgreSQL as database, Docker, automatic HTTPS and more.
Project mention: How to build a scalable project file structure for a beginner. | reddit.com/r/FastAPI | 2023-03-10I've just recently switched to a structure that follows Netflix's Dispatch application after starting with https://github.com/tiangolo/full-stack-fastapi-postgresql and it feels way better and organized.
-
cookiecutter-django
Cookiecutter Django is a framework for jumpstarting production-ready Django projects quickly.
Also, cookiecutter django is a great resource to get a Django site off the ground without reinventing the wheel.
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
Use flower to monitor workers and tasks.
-
It is feasible and there are a number of ways to do it. There are a few issues, though, mainly how to make sure that you are accessing the latest data and not getting part of the data mid write. A database handles these issues pretty well, since generally they are meant to be an intermediary between different processes. Another solution, that is often more flexible, is a message queue, like this one: https://github.com/celery/kombu
-
django-react-boilerplate
Django 3, React, Bootstrap 4 with Python 3 and webpack project boilerplate (by vintasoftware)
-
-
Project mention: Dynamically update periodic tasks in Celery and Django | reddit.com/r/django | 2022-10-17
I was looking for a nice way to manipulate periodic tasks in Celery. I found an amazing django-celery-beat package that provides PeriodicTask database objects. With PeriodicTask objects, you can dynamically add/remove/update periodic tasks in Celery. I want to share my approach. I've created an example GitHub repository and wrote step-by-step article.
-
InfluxDB
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
-
Project mention: How to build our own SMS service/gateway in nodejs? | reddit.com/r/node | 2022-11-29
-
redbeat
RedBeat is a Celery Beat Scheduler that stores the scheduled tasks and runtime metadata in Redis.
afaik you cant dynamically create scheduled tasks - but i was able to achieve this with redbeat. curious to see what more experienced ppl have to say as well.
-
Project mention: Use Celery with any Django Storage as a Result Backend | reddit.com/r/django | 2023-02-07
The Celery package provides some number of (undocumented!) result backends to store task results in different local, network, and cloud storages. The django-celery-result package adds options to use Django-specific ORM-based result storage, as well as Django-specific cache subsystem.
-
https://github.com/wakatime/wakaq/blob/main/wakaq/__init__.p...
and
https://github.com/wakatime/wakaq/blob/main/wakaq/worker.py
is the meat of it. The blog post talks about the Redis data structures used, and there's not much to it beyond that.
-
celery-progress
Drop in, configurable, dependency-free progress bars for your Django/Celery applications.
-
django-guid
Inject an ID into every log message from a Django request. ASGI compatible, integrates with Sentry, and works with Celery
Project mention: GitHub - snok/django-guid: Inject an ID into every log message from a Django request. ASGI compatible, integrates with Sentry, and works with Celery | reddit.com/r/savedForMS | 2023-01-25 -
-
-
-
django-step-by-step
A Django + Vue reference project that focuses on developer tooling and CI/CD + IaC
Project mention: What is your development cycle when using docker and containers? What's the general flow between developing locally and running the containers to test. | reddit.com/r/django | 2023-01-22Here's an example of a docker-compose file in my reference Django project: https://github.com/briancaffey/django-step-by-step/blob/main/docker-compose.yml
-
celery-kubernetes-example
Small Flask app with scalable, asynchronous backend workers deployed on Kubernetes.
-
-
django-sqs-celery-template
An effortlessly pre configured Django, Celery and SQS template repository for those who want to process asynchronous background tasks.
Project mention: Django + Celery + AWS SQS setup on Elastic Beanstalk | reddit.com/r/django | 2022-05-30I also found this project on github: https://github.com/rodolfolottin/django-sqs-celery-template . Do you think this is a good reference?
-
docker-compose-django-celery-redis-postgres
Create docker compose for Django, Celery, Redis and Postgres
Project mention: Save your weekend and deploy Django 4, Celery, Redis and Postgres with docker-compose | reddit.com/r/django | 2022-11-18All code from the article in the GitHub repository - with MIT license, so you can copy and change as you want!
-
Nested serializers and so on. If you would like to strengthen your skills, I highly recommend you to check it out
-
While it's of course not ideal, stub files can help with this issue. For example you can get stubs for Celery that make both `shared_task` and `delay` properly typed: https://github.com/sbdchd/celery-types
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-03-10.
Python Celery related posts
- walnats: Nats-powered event-driven background jobs and microservices framework for Python.
- walnats: Nats-powered event-driven background jobs and microservices framework for Python. It's like Celey or Dramatiq but for microservices, asyncio-powered, and type-safe.
- Scaling Celery to handle workflows and multiple queues
- Python Celery - high level overview(animated video)
- Processing input and letting user download the result
- Tricks for starting a new project
- Grafana dashboards for Celery
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 Mar 2023
Index
What are some of the best open-source Celery projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | full-stack-fastapi-postgresql | 11,406 |
| 2 | cookiecutter-django | 10,318 |
| 3 | flower | 5,609 |
| 4 | kombu | 2,513 |
| 5 | django-react-boilerplate | 1,556 |
| 6 | django-celery | 1,481 |
| 7 | django-celery-beat | 1,315 |
| 8 | jasmin | 824 |
| 9 | redbeat | 772 |
| 10 | django-celery-results | 543 |
| 11 | wakaq | 522 |
| 12 | celery-progress | 385 |
| 13 | django-guid | 314 |
| 14 | pdbr | 284 |
| 15 | banking-system | 248 |
| 16 | asgi-correlation-id | 194 |
| 17 | django-step-by-step | 126 |
| 18 | celery-kubernetes-example | 83 |
| 19 | guane-intern-fastapi | 55 |
| 20 | django-sqs-celery-template | 41 |
| 21 | docker-compose-django-celery-redis-postgres | 33 |
| 22 | django-ecommerce-api | 29 |
| 23 | celery-types | 29 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com