Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Top 12 JavaScript Crawler Projects
-
-
browser-fingerprinting
Analysis of Bot Protection systems with available countermeasures 🚿. How to defeat anti-bot system 👻 and get around browser fingerprinting scripts 🕵️♂️ when scraping the web?
So he here is a link to the original, true Github repo, so at least the author might get reimbursed via his affiliation links and get rightfully paid rather than just plagiarized by other proxy blogs - https://github.com/niespodd/browser-fingerprinting
-
Appwrite
Appwrite - The Open Source Firebase alternative introduces iOS support . Appwrite is an open source backend server that helps you build native iOS applications much faster with realtime APIs for authentication, databases, files storage, cloud functions and much more!
-
work_crawler
Download comics novels 小说漫画下载工具 小説漫画のダウンローダ 小說漫畫下載:腾讯漫画 大角虫漫画 有妖气 咪咕 SF漫画 哦漫画 看漫画 漫画柜 汗汗酷漫 動漫伊甸園 快看漫画 微博动漫 733动漫网 大古漫画网 漫画DB 無限動漫 動漫狂 卡推漫画 动漫之家 动漫屋 古风漫画网 36漫画网 亲亲漫画网 乙女漫画 webtoons 咚漫 ニコニコ静画 ComicWalker ヤングエースUP モアイ pixivコミック サイコミ;アルファポリス カクヨム ハーメルン 小説家になろう 起点中文网 八一中文网 顶点小说 落霞小说网 努努书坊 笔趣阁→epub.
-
Also, you can use a complete third-party Google Play Store App scraping solution google-play-scraper. Third-party solutions are usually used to break the quota limit.
-
fakebrowser
🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.
-
-
-
Sonar
Write Clean JavaScript Code. Always.. Sonar helps you commit clean code every time. With over 300 unique rules to find JavaScript bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
th-music-video-generator
Touhou Project random music video generator/player, crawling image and video from websites to generate MV.
Project mention: Touhou Project Music Video Generator/Player (Update!) | reddit.com/r/coolgithubprojects | 2022-05-17Preview GIF here!
-
Project mention: Any typographers or font creators here? I need help with a project! | reddit.com/r/Winnipeg | 2023-03-08
As you may or may not know from the last year or so I recreated the old weather channel that Shaw/Videon had in Winnipeg back in the 80s/90s and beyond. The project is fully open source but is missing one key component. An accurate recreation of the font.
-
-
scrapper
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
Project mention: Powerful and free scraper with a headless browser under the hood and Readability for parsing | reddit.com/r/webscraping | 2023-03-18 -
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-03-18.
JavaScript Crawler related posts
- FAQs on my side project
- See all new apps in Play Store
- Touhou Project Music Video Generator/Player (Update!)
- DuckDuckGo for Mac in Beta (With Waitlist)
- Screenshots. Trying to grab a whole site.
- Need some motivation, new to developing
- The Henry George Program - podcast about georgism
-
A note from our sponsor - InfluxDB
www.influxdata.com | 27 Mar 2023
Index
What are some of the best open-source Crawler projects in JavaScript? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | node-crawler | 6,393 |
| 2 | browser-fingerprinting | 3,382 |
| 3 | work_crawler | 2,299 |
| 4 | google-play-scraper | 1,920 |
| 5 | fakebrowser | 707 |
| 6 | JSSoup | 341 |
| 7 | sitemap-generator | 341 |
| 8 | th-music-video-generator | 181 |
| 9 | retro-env-can-weather-chan | 16 |
| 10 | airbnb-scraper | 8 |
| 11 | scrapper | 8 |
| 12 | tumblweed | 6 |
Access the most powerful time series database as a service
Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
www.influxdata.com