secret-agent
fingerprint-suite
| secret-agent | fingerprint-suite | |
|---|---|---|
| 1 | 5 | |
| 633 | 696 | |
| 0.0% | 4.6% | |
| 0.0 | 8.9 | |
| about 1 year ago | 7 days ago | |
| TypeScript | TypeScript | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
secret-agent
-
Way to scrape any dynamic data from any site / Server for scaping
Automated Browser under hood is SecretAgent, thats masking alot bot stuff and bypass huge amount of anti-bot systems (also be patient to your proxy quality)
fingerprint-suite
-
Crawlee · Build reliable crawlers. Fast. | Crawlee
The fingerprinting system Crawlee uses is published here https://github.com/apify/fingerprint-suite
-
Show HN: Crawlee – The web scraping and browser automation library for Node.js
Hey! Crawlee uses the libraries from our fingerprint suite internally. https://github.com/apify/fingerprint-suite#performance
It has an A rating in the BotD (fingerprint.js) detection. Now we're working on improving the CreepJS detection. That one is really tough though. Not even sure if anybody would use it in production environments as it must throw a lot of false positives.
It will always be free and maintained, because we're using it internally in all of our projects. We thought about adding a commercial license like Docker. Open source, but paid if you have more than $10mil revenue or more than 250 employees. But in the end we decided that we won't do even that and it's just free and always be free.
- Browser fingerprinting tools for anonymizing your scrapers
What are some alternatives?
Recorder - A browser extension that generates Cypress, Playwright and Puppeteer test scripts from your interactions 🖱 ⌨
Broprint.js - The world's easiest, smallest and powerful visitor identifier for browsers.
headless-task-server - A headless browser task/job queue & runner based on Hero (Chrome)
fingerprintjs - Browser fingerprinting library. Accuracy of this version is 40-60%, accuracy of the commercial Fingerprint Identification is 99.5%. V4 of this library is BSL licensed.
root-cause - 🔍 [DEPRECATED] Root Cause is a tool for troubleshooting Puppeteer and Playwright tests. 🔎
Playwright - Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
adobe-uxp-types-crawler - Crawls the Adobe UXP documentation and generates Typescript declaration files
qawolf - 🐺 Create browser tests 10x faster
astral - A high-level puppeteer/playwright-like library for Deno
crawlee - Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.