tarn.js VS worm-scraper

Knex, the SQL query builder, uses Tarn.js[1] for connection pooling to the db.

I've been using Tarn a bunch at work recently. We're doing some batch jobs, and I'm queuing work at each stage in Tarn.js pools. I created my own enqueue function that waits until the pool is less than a high-water mark in size before enqueueing. Then the pool has however many workers running.

[1] https://github.com/vincit/tarn.js/

If you (or someone you know) is technical, here is a program that creates an e-book for your personal use based on the HTML pages. That's how I ended up reading it: https://github.com/domenic/worm-scraper

https://github.com/domenic/worm-scraper can be adapted for any site.

I maintain a command-line utility which assembles an eBook from scraped .xhtml files. It uses a similar package, workerpool, to process multiple chapters in parallel.

https://github.com/domenic/worm-scraper/blob/master/lib/conv...

Officially is only available in its website. But you can scrap a epub version yourself with this extremely easy to use tool and then convert to kindle format.

You can use this tool to produce an ebook of Worm and read it with your favorite ebook reader. Just make sure not to distribute the ebook itself anywhere on the internet.