puppeteer-cluster
scraper
puppeteer-cluster | scraper | |
---|---|---|
5 | 3 | |
3,094 | 445 | |
- | - | |
6.2 | 0.0 | |
14 days ago | over 2 years ago | |
TypeScript | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
puppeteer-cluster
-
Puppeteer in Node.js: Common Mistakes to Avoid
If urlsToScrape happens to be large enough, the memory and processor load from spawning dozens or hundreds of pages can bring a system down quickly. Consider puppeteer-cluster.
-
Looking for something and I'm not sure what it would be called.....
You could set up a service with something like playwright, puppeteer puppeteer-cluster, browserless, to access the service internally and serve screenshots of it to the outside user. You'd have to set up probably some kind of web service with the appropriate routes.
-
Building Unlighthouse: Open-Source Package For Site-wide Google Lighthouse scans
To make Unlighthouse fast, we combined this lighthouse binary with the package puppeteer-cluster, which allows for multi-threaded lighthouse scans.
-
Redis with puppeteer for web scraping
https://github.com/thomasdondorf/puppeteer-cluster is doing queue-like mechanism but it is not using redis.
-
How to reuse puppeteer browser?
I've used this library: Puppeteer cluster
scraper
-
Reset Collection Cartridge Art
I previously used a scraper found here https://github.com/sselph/scraper to scrap from screenscraper.fr, but I haven't used it lately and it looks like the project is dead.
-
Is there a scraper in existence that uses file hashes instead of file names?
Thanks, I'm reading the source code now. It looks like the hash comparison is done against OpenVGDB, but I'm also curious how the images are fetched. Would you happen to know this by chance?
- Scrape games with out WiFi
What are some alternatives?
rendertron - A Headless Chrome rendering solution
playwright-python - Python version of the Playwright testing and automation library.
puppeteer - Node.js API for Chrome
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)
deno-puppeteer - A port of puppeteer running on Deno
vopono - Run applications through VPN tunnels with temporary network namespaces
scraper - Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
Scrapy - Scrapy, a fast high-level web crawling & scraping framework for Python.
vitest - Next generation testing framework powered by Vite.
Arthur - How to build your own AI art installation from scratch [Moved to: https://github.com/maxvfischer/DIY-ai-art]
ing-au-login - Login to your ING Australia bank account using puppeteer
OpenVGDB - OpenVGDB