adobe-uxp-types-crawler
fingerprint-suite
| adobe-uxp-types-crawler | fingerprint-suite | |
|---|---|---|
| 1 | 5 | |
| 15 | 704 | |
| - | 5.7% | |
| 0.0 | 8.9 | |
| about 2 years ago | 5 days ago | |
| TypeScript | TypeScript | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
adobe-uxp-types-crawler
fingerprint-suite
-
Crawlee · Build reliable crawlers. Fast. | Crawlee
The fingerprinting system Crawlee uses is published here https://github.com/apify/fingerprint-suite
-
Show HN: Crawlee – The web scraping and browser automation library for Node.js
Hey! Crawlee uses the libraries from our fingerprint suite internally. https://github.com/apify/fingerprint-suite#performance
It has an A rating in the BotD (fingerprint.js) detection. Now we're working on improving the CreepJS detection. That one is really tough though. Not even sure if anybody would use it in production environments as it must throw a lot of false positives.
It will always be free and maintained, because we're using it internally in all of our projects. We thought about adding a commercial license like Docker. Open source, but paid if you have more than $10mil revenue or more than 250 employees. But in the end we decided that we won't do even that and it's just free and always be free.
- Browser fingerprinting tools for anonymizing your scrapers
What are some alternatives?
Twitch-Drops-Bot - A Node.js bot that will automatically watch Twitch streams and claim drop rewards.
Broprint.js - The world's easiest, smallest and powerful visitor identifier for browsers.
pwa-asset-generator - Automates PWA asset generation and image declaration. Automatically generates icon and splash screen images, favicons and mstile images. Updates manifest.json and index.html files with the generated images according to Web App Manifest specs and Apple Human Interface guidelines.
fingerprintjs - Browser fingerprinting library. Accuracy of this version is 40-60%, accuracy of the commercial Fingerprint Identification is 99.5%. V4 of this library is BSL licensed.
qawolf - 🐺 Create browser tests 10x faster
headless-task-server - A headless browser task/job queue & runner based on Hero (Chrome)
scraper - Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
secret-agent - The web scraper that's nearly impossible to block - now called @ulixee/hero
timetable-grabber-sit - Timetable Grabber - SIT is a tool that allows you to grab and export your trimester's timetable to the .ics format where you can import it to your favourite calendar.
astral - A high-level puppeteer/playwright-like library for Deno
crawlee - Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.