Piscina – The Node.js Worker Pool

• pambdajs

  2 28 0.0 TypeScript

  Parallelized Lambda, the wrapper to help run lambda/anonymous function in parallel. 🚀

I assume u can, but how it performs, it really dependents on the virtual CPU of the, platform.

I did something similar

https://github.com/tim-hub/pambdajs

but I haven't done the comparison on aws lambda yet

• piscina

  14 3,913 8.5 TypeScript

  A fast, efficient Node.js Worker Thread Pool implementation

  

• SurveyJS

  surveyjs.io sponsored

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• camaro

  3 547 6.2 JavaScript

  camaro is an utility to transform XML to JSON, using Node.js binding to native XML parser pugixml, one of the fastest XML parser around.

AFAIK this is a wrapper of worker_threads API. https://github.com/tuananh/camaro utilises this for multi-threading processing of XML input.

• bree

  11 2,864 6.0 JavaScript

  Bree is a Node.js and JavaScript job task scheduler with worker threads, cron, Date, and human syntax. Built for @ladjs, @forwardemail, @spamscanner, @cabinjs.

  

Yeah. I built Bree @ https://jobscheduler.net

It has support for worker threads + cron + human strings

GH: https://github.com/breejs/bree

• tarn.js

  1 454 0.0 JavaScript

  Simple and robust resource pool for node.js (by Vincit)

  

Knex, the SQL query builder, uses Tarn.js[1] for connection pooling to the db.

I've been using Tarn a bunch at work recently. We're doing some batch jobs, and I'm queuing work at each stage in Tarn.js pools. I created my own enqueue function that waits until the pool is less than a high-water mark in size before enqueueing. Then the pool has however many workers running.

[1] https://github.com/vincit/tarn.js/

• worm-scraper

  6 184 0.0 JavaScript

  Scrapes the web serial Worm and its sequel Ward into an eBook format

I maintain a command-line utility which assembles an eBook from scraped .xhtml files. It uses a similar package, workerpool, to process multiple chapters in parallel.

https://github.com/domenic/worm-scraper/blob/master/lib/conv...

• poolifier

  7 311 10.0 JavaScript

  Fast and small Node.js worker_threads and cluster worker pool

  

At work I use https://github.com/pioardi/poolifier

We have an api used for generating reports from mongo dB to csv, this let's the report process in the background leaving the report api to still handle requests.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• NodeLearn

  2 0 0.0 JavaScript

  Learning node js app

If you can use redis, redlock can be a nice implementation.

Example: https://github.com/fendy3002/NodeLearn/blob/master/Redlock/s...

Suggest a related project