celery

Distributed Task Queue (development branch) (by celery)
Python #Distributed Task Queue #Python #task-manager #task-scheduler #task-runner #queue-workers #queued-jobs #queue-tasks #Amqp #Redis #Sqs #sqs-queue #Python3 #python-library
Source Code docs.celeryproject.org raw.githubusercontent.com

Stats

Basic celery repo stats
1
17,079
9.3
8 days ago

celery/celery is an open source project licensed under BSD 3-clause "New" or "Revised" License which is an OSI approved license.

Celery Alternatives

Similar projects and alternatives to celery based on common topics and language

  • GitHub repo terraform

    Terraform enables you to safely and predictably create, change, and improve infrastructure. It is an open source tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

  • GitHub repo dramatiq

    A fast and reliable background task processing library for Python 3.

  • GitHub repo Rqueue

    Rqueue aka Redis Queue [Task Queue, Message Broker] for Spring framework

  • GitHub repo kombu

    Messaging library for Python.

  • GitHub repo rq-scheduler

    A lightweight library that adds job scheduling capabilities to RQ (Redis Queue)

  • GitHub repo amqpstorm

    Thread-safe Python RabbitMQ Client & Management library

  • GitHub repo rich

    Rich is a Python library for rich text and beautiful formatting in the terminal.

NOTE: The number of mentions on this list indicates mentions on common posts. Hence, a higher number means a better celery alternative or higher similarity.

Posts

Posts where celery has been mentioned. We have used some of these posts to build our list of alternatives and similar projects - the last one was on 2021-04-13.
  • Turning AWS Log Insights into metrics
    dev.to | 2021-04-13
    Leo Giordani one of POP's developers has written up a detailed blog on his recent work creating a Cloudwatch metrics dashboard. The dashboard helps visualise our application's use of Celery tasks and to provide alerts where problems in the system occur such as tasks backing up as demand spikes.
  • Am I able to defend using Celery + Redis or was it not necessary what I did?
    reddit.com/r/django | 2021-03-15
    lol what on earth do you mean? there are definitely some projects that celery is overkill and others you should be using Hadoop or Kafka. The best feature of celery is the scheduler, and imo its a tragedy they removed it from django to make the project "bigger". Flower is nice and pretty, but I would give it up to have celery actually a Django project with less extra stuff to manage. If you look at the github issues they are full of people trying to use it as a complex map reduce system and having issues.
  • Best Automation App
    reddit.com/r/django | 2021-02-08
    But the worst thing is, they have a memory leak since 2018!
  • How are folks horizontally scaling Celery brokers?
    reddit.com/r/django | 2021-01-04
    Celery does not yet support Redis clustered mode unfortunately per https://github.com/celery/celery/issues/2852