APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product. Learn more →
Top 23 JavaScript Crawler Projects
-
EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/网页爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
-
Kargo
Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
-
-
browser-fingerprinting
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
-
work_crawler
Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.
-
-
single-file-cli
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
Project mention: Show HN: Kage – Shadow any website to a binary for offline viewing | news.ycombinator.com | 2026-06-14Singlefile supports scoped recursive crawls too: https://github.com/gildas-lormeau/single-file-cli
-
fredy
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, houses, and flats in Europe on platforms like ImmoScout24, Immowelt, eBay Kleinanzeigen and instantly delivers the results to you via Slack, Telegram, Email, Discord or ntfy, so you can focus on the more important things in life ;)
Project mention: Fredy: Deriving a local rent index from your own scraped listings | news.ycombinator.com | 2026-09-09 -
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
rebrowser-patches
Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.
-
-
-
th-music-video-generator
Touhou Project random music video generator/player, crawling image and video from websites to generate MV.
-
spiderable-middleware
Pre-rendering for JavaScript websites that delivers SSR-level SEO, enhanced link previews, and performance via effortless middleware integration — ideal for PWAs, SPAs, and modern JS-driven apps, websites, and webpages
-
-
-
images-downloader
A Node.js module for downloading a single image or multiple images to disk from a given Url
-
-
Studybyte
Studybyte is a search engine designed to help students find educational content effortlessly.
-
CodexDrake
An open source, privacy-first, self-hosting capable and blazing fast search engine written in JavaScript. Browse anonymously and safely without the need to pay third-party APIs. 👀
-
-
-
-
-
scrapewright
LLM-powered web scraping platform. Build reusable scraping services as step-graph state machines via an AI-guided wizard, expose them through a local HTTP API. Chrome Extension (MV3) + Node.js native messaging host. Data never leaves your machine.
Repo: github.com/singhand-labs/scrapewright — GPLv3, quick start in the README, whitepaper for the architecture. If you're building agents that touch the web, spend one evening making a service and pointing your agent at its API doc — the drop in latency, cost, and flakiness is the whole argument.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
JavaScript Crawler discussion
JavaScript Crawler related posts
-
A 50-capability map for governed web crawling and AI agents
-
I gave open claw and codex the whole internet without any api keys using this tool and it was never performed better
-
Show HN: CockroachCrawler–1 package for crawling,browsers,PDF,extraction,and MCP
-
Ask HN: Anyone using device fingerprint in production?
-
Cool ChatGPT Finance Sentiment Analysis
-
GitHub - simwai/finance-news-crawler: Finance News Crawler uses News API to fetch some latest articles and generates a sentiment report with the OpenAI API or VADER
-
Would it be worth publishing my Chrome Extension even if I anticipate that it will have very few users?
-
A note from our sponsor - AppSignal
www.appsignal.com | 13 Sep 2026
Index
What are some of the best open-source Crawler projects in JavaScript? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | EasySpider | 44,524 |
| 2 | awesome-web-scraping | 8,148 |
| 3 | browser-fingerprinting | 5,132 |
| 4 | work_crawler | 4,218 |
| 5 | google-play-scraper | 2,960 |
| 6 | single-file-cli | 1,593 |
| 7 | fredy | 1,493 |
| 8 | rebrowser-patches | 1,412 |
| 9 | sitemap-generator | 451 |
| 10 | JSSoup | 372 |
| 11 | th-music-video-generator | 280 |
| 12 | spiderable-middleware | 43 |
| 13 | undetectable-crawler | 35 |
| 14 | selector-finder | 26 |
| 15 | images-downloader | 20 |
| 16 | socialblade-com-api | 17 |
| 17 | Studybyte | 16 |
| 18 | CodexDrake | 12 |
| 19 | airbnb-scraper | 11 |
| 20 | Netflix-Hotkeys | 9 |
| 21 | dora-cli | 7 |
| 22 | tumblweed | 6 |
| 23 | scrapewright | 7 |
Sponsored
Stop Scripting Promotions. Start Shipping with Kargo
Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
akuity.io