mrq VS huey

mrq

We haven't tracked posts mentioning mrq yet.
Tracking mentions began in Dec 2020.

huey

• Nextflow: Data-Driven Computational Pipelines
  9 projects | news.ycombinator.com | 10 Aug 2023

  I've considered using Nextflow for bioinformatics pipelines but have yet to take the plunge. At work, I develop a proteomics pipeline that is composed of huey¹ tasks (Python library; simple alternative to Celery) which either use subprocess to call out to some external tool, or are just pure python. It runs in a worker container which is created by docker swarm, and all containers pull jobs from redis. For our scale, it works great. However, I don't have control over the resource utilization of individual steps, and in the past I've had issues with the pipeline blocking as a result of how I was chaining tasks together. I think something like Nextflow would remove these limitations, but one thing I think I would miss is the ability to debug individual pipeline steps locally with an interactive debugger. As far as I can tell, Nextflow has logging/tracing facilities but nothing quite like an interactive debugger. I'd be happy to be told I'm wrong, or even that I'm doing it wrong.

  ____

  ¹ https://github.com/coleifer/huey/

• Background jobs with Django
  4 projects | /r/django | 30 May 2023

  Other options are DjangoQ and Huey, which tend to work ok. Of the two I prefer DjangoQ. Database backed, don't require the Redis/Celery rigmarole.

• What's the best thing you've learned about Django this year?
  3 projects | /r/django | 14 Dec 2022

  Funny, just this moment i finally switched from Celery to huey. And so far I don't regret. huey looks very promising, has good documentation and is well integrated into DJango. You should give it a try: https://github.com/coleifer/huey

• This Week in Python
  5 projects | dev.to | 3 Jun 2022

  huey – a little task queue for python

• What is your favourite task queuing framework?
  8 projects | /r/Python | 2 May 2022

  Huey -> Same again?

• 5 background scheduling libraries in Python you must know
  4 projects | /r/Python | 8 Mar 2022

  Huey: https://github.com/coleifer/huey

• Celery in production: Three more years of fixing bugs
  3 projects | news.ycombinator.com | 5 Mar 2022
• Not sure if I should use celery or asyncio
  1 project | /r/flask | 20 Jan 2022

  I just want to add that a couple celery alternatives worth looking at include huey and dramatiq.

• What is the best option for a (Python 3) task queue on Windows now that Celery 4 has dropped Windows support?
  2 projects | /r/codehunter | 11 Dec 2021

  huey

• Django 4.0 released
  3 projects | /r/django | 7 Dec 2021

  same, I ran into an issue cos of django-background-tasks. I am thinking to replace it with huey