silverback VS Hangfire

MassTransit, SlimMessageBus, and SilverBack abstract interactions with message queueing systems. Some of what you are trying to do (I didn't read it deep enough to know exactly what you're using the queue for) would be done as a queue configuration instead (e.g. ordering, de-dupe, etc.).

You can look here to have an idea of the tools and the pipeline (I also use azure devops): https://github.com/BEagle1984/silverback

I tend to declare the parameter as IReadOnlyCollection because I can safely iterate without extra allocations. I know you could just do a ToList by default but it would mean allocating a few arrays in the process, in worst case. You could be smarter and check if the IEnumerable can be casted to IReadOnlyCollection and perform a ToList only when needed, this would be the most flexible implementation. I sometimes create an extension method for this: https://github.com/BEagle1984/silverback/blob/master/src/Silverback.Core/Util/EnumerableAsCollectionExtensions.cs.

I strongly believe in CQRS and all my projects implement it (using a mediator etc. - I even built a framework myself for those stuff https://silverback-messaging.net).

Yes we do use Kafka in the company I work for. I built a library/framework on top of Confluent.Kafka for it. Check it out: https://silverback-messaging.net/ or https://github.com/BEagle1984/silverback.

Silverback! https://github.com/BEagle1984/silverback / https://silverback-messaging.net

😁 Nope, not really. The code displayed is from my “hobby” project: https://github.com/BEagle1984/silverback.

By the way, if you are looking for a good/great library to interact with the brokers -> https://github.com/BEagle1984/silverback

Unpopular opinion incoming... What I see is yet another way that the backend JS world is finally achieving something .NET had years ago[0].

Node/Deno/Bun/etc. + npm sounds super straightforward at first glance (and it is at first). But I've thought for years that it's far easier to be productive as an organization on .NET in Visual Studio, since it's simpler to design, deliver, and maintain infrastructure.

[0] https://www.hangfire.io/

you can read about it here HangFire Documentation

I mostly work in .NET, and typically use Hangfire, but all languages has similar frameworks

Its hard to tell what tool would be a best fit without more information, but I would suggest looking at Hangfire for background job processing: https://www.hangfire.io/

You might want to look at https://www.hangfire.io/. Their docs explain how to set up queues: https://docs.hangfire.io/en/latest/background-processing/configuring-queues.html

In this article we looked at how to use Hangfire to schedule background jobs in ASP.NET according to our requirements. In a follow up article, I will talk about using Hangfire with a Redis storage. To learn more about Hangfire, you can visit the official website.

Easy to understand if you want to implement your own background service. If you want a more easy and complete tool you can use hangfire.

Try https://www.hangfire.io/

If, as you stated, you really need to use your own servers, that seems exactly like a job for Hangfire.