celery-kubernetes-example
flower
| celery-kubernetes-example | flower | |
|---|---|---|
| 1 | 3 | |
| 113 | 6,169 | |
| - | - | |
| 0.0 | 7.7 | |
| about 2 years ago | 14 days ago | |
| Python | Python | |
| MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
celery-kubernetes-example
-
how to have a continuously running script with flask?
I had a similar question a week ago and celery was the move but it took a while to figure it out. Some things that helped me was https://blog.miguelgrinberg.com/post/using-celery-with-flask and https://github.com/matiaslindgren/celery-kubernetes-example If you want to deploy it in kube I move out of google cloud run because of the redis and celery workers. (I added a pull request to add a gke branch to deploy it there.)
flower
-
Scaling Celery to handle workflows and multiple queues
Use flower to monitor workers and tasks.
-
Python Celery - high level overview(animated video)
Not sure what your criteria for good observability ist, but flower served me well enough for this in the last couple of years.
-
Wondering if I should use Celery vs threads for what I want to do
From experience i would not use threads for this or any background jobs. I would use Celery or Flask-RQ2 to be your workers, you will also probably end up using them to run other tasks as you encounter the need for other jobs. They both use Redis as a broker and job store and you can use Redis for other things like caching and so many other useful features. I kind of like RQ2 more then Celery because its a little simpler but Celery has a lot more to offer, more features. RQ2 has rq-dashboard for monitoring jobs and Celery has Flower.
What are some alternatives?
celery-exporter - A Prometheus exporter for Celery metrics
django-suit - Modern theme for Django admin interface
guane-intern-fastapi - FastAPI-PostgreSQL-Celery-RabbitMQ-Redis bakcend with Docker containerization
django-jet - Modern responsive template for the Django admin interface with improved functionality. We are proud to announce completely new Jet. Please check out Live Demo
kubernetes-workshop - ⚙️ A Gentle introduction to Kubernetes with more than just the basics. 🌟 Give it a star if you like it.
Celery-Kubernetes-Operator - An operator to manage celery clusters on Kubernetes (Work in Progress)
nagios-plugins - 450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...
flask-admin - Simple and extensible administrative interface framework for Flask
kombu - Messaging library for Python.
rq-dashboard - Flask-based web front-end for monitoring RQ queues
django-celery-results - Celery result back end with django
Wooey - A Django app that creates automatic web UIs for Python scripts.