fingerprint-suite
secret-agent
Our great sponsors
| fingerprint-suite | secret-agent | |
|---|---|---|
| 5 | 1 | |
| 696 | 633 | |
| 10.2% | 0.0% | |
| 8.9 | 0.0 | |
| 5 days ago | about 1 year ago | |
| TypeScript | TypeScript | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fingerprint-suite
-
Crawlee · Build reliable crawlers. Fast. | Crawlee
The fingerprinting system Crawlee uses is published here https://github.com/apify/fingerprint-suite
-
Show HN: Crawlee – The web scraping and browser automation library for Node.js
Hey! Crawlee uses the libraries from our fingerprint suite internally. https://github.com/apify/fingerprint-suite#performance
It has an A rating in the BotD (fingerprint.js) detection. Now we're working on improving the CreepJS detection. That one is really tough though. Not even sure if anybody would use it in production environments as it must throw a lot of false positives.
It will always be free and maintained, because we're using it internally in all of our projects. We thought about adding a commercial license like Docker. Open source, but paid if you have more than $10mil revenue or more than 250 employees. But in the end we decided that we won't do even that and it's just free and always be free.
- Browser fingerprinting tools for anonymizing your scrapers
secret-agent
-
Way to scrape any dynamic data from any site / Server for scaping
Automated Browser under hood is SecretAgent, thats masking alot bot stuff and bypass huge amount of anti-bot systems (also be patient to your proxy quality)
What are some alternatives?
Broprint.js - The world's easiest, smallest and powerful visitor identifier for browsers.
Recorder - A browser extension that generates Cypress, Playwright and Puppeteer test scripts from your interactions 🖱 ⌨
fingerprintjs - Browser fingerprinting library. Accuracy of this version is 40-60%, accuracy of the commercial Fingerprint Identification is 99.5%. V4 of this library is BSL licensed.
headless-task-server - A headless browser task/job queue & runner based on Hero (Chrome)
root-cause - 🔍 [DEPRECATED] Root Cause is a tool for troubleshooting Puppeteer and Playwright tests. 🔎
adobe-uxp-types-crawler - Crawls the Adobe UXP documentation and generates Typescript declaration files
Playwright - Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
astral - A high-level puppeteer/playwright-like library for Deno
qawolf - 🐺 Create browser tests 10x faster
crawlee - Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.