piscina VS tarn.js

Workers multi-threading via Tinypool (a lightweight fork of Piscina)

For threading best to use piscina and for clustering best to use pm2 which does not even need one line of code change in Node.js code.

We used piscina at it was quite good: https://github.com/piscinajs/piscina

We used Benchmark.js for benchmarking and piscina as a pool for worker threads. benchmark.js was used to run the same code in 2 scenarios - one using a single thread and one using the piscina pool. The degree of parallelism was passed to the program via an environment variable. The test code is present in worker.js in both the cases.

piscina for managing node's worker threads

One other thing...this passed by in my feeds last week, I’m not an expert in web workers or browser threads etc, but it seems like it might be relevant, so sharing it just in case:

“A fast, efficient Node.js Worker Thread Pool implementation”

https://github.com/piscinajs/piscina

This is by no means a complete list of what piscina can do.... checkout the official docs here.

Knex, the SQL query builder, uses Tarn.js[1] for connection pooling to the db.

I've been using Tarn a bunch at work recently. We're doing some batch jobs, and I'm queuing work at each stage in Tarn.js pools. I created my own enqueue function that waits until the pool is less than a high-water mark in size before enqueueing. Then the pool has however many workers running.

[1] https://github.com/vincit/tarn.js/