puppeteer-extra
headless-recorder
Our great sponsors
| puppeteer-extra | headless-recorder | |
|---|---|---|
| 28 | 11 | |
| 6,056 | 14,643 | |
| - | - | |
| 0.0 | 5.4 | |
| 6 days ago | over 1 year ago | |
| JavaScript | JavaScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
puppeteer-extra
-
What are your favorite Data Scraping tools?
You could use https://github.com/berstend/puppeteer-extra/tree/master/packages/puppeteer-extra-plugin-stealth A plugin to escape anti bot detection
-
how can i bypasd 403 forbidden?
There is a good chance that the website is using Cloudflare to block web scrapers, which will require you to use a fortified headless browser to solve the JS challenges. Your options include the Puppeteer stealth plugin and Selenium undetected-chromedriver.
-
New headless Chrome has been released and has a near-perfect browser fingerprint
There are even Puppeteer plugins that will do it for you. [^1]
The best detection I've come across so far (i.e. before this release) has just required I run headless Chrome in headed mode. Granted, I don't do a ton of scraping -- mostly just pulling data out of websites so that I can play with it in aggregate using more civilized tools.
[1]: https://github.com/berstend/puppeteer-extra/tree/master/pack...
-
Proposed solution to twitter's ridiculous API pricing
You didn't know? https://github.com/berstend/puppeteer-extra/wiki/Block-resources-without-request-interception
- Using selenium with proxy still hit bot detection
-
Getting detected by Cloudflare for no apparent reason.
As for solutions, you are on point. Running a headless browser or using a web scraping API that does that for you (I work at one: https://scrapfly.io hi) is the easiest way to do it. Note that because of javascript fingerprinting you still need to fortify your headless browsers with various scripts like puppeteer-stealth.
-
100s of Spam Leads but not showing up in Google Analytics (UA) or Google Ads
Unfortunately, it's now trivial to bypass recaptcha: https://github.com/berstend/puppeteer-extra/tree/master/packages/puppeteer-extra-plugin-recaptcha
-
Perimeter X bypass help
Use a fortified headless browser like the stealth plugin for puppeteer.
- Spam on Unbounce Landers
- Puppeteer-extra-plugin-stealth – plugin for puppeteer-extra to prevent detection
headless-recorder
- Ask HN: What was an interesting project you started and finished over a weekend?
-
GPL vs MIT.
Or when the maintainer of this project whined and cried because Amazon forked it and offered it as a service. Amazon pointed at the MIT license and shrugged.
-
I built an open source Chrome/Firefox extension that generates Playwright/Puppeteer scripts straight from your browser interactions using React/Shadow DOM
interesting! possible competitor of headless-recorder? https://github.com/checkly/headless-recorder
- Headless recorder is a Chrome extension that records your browser interactions and generates a Playwright or Puppeteer script.
-
Headless Recorder V1 is out! Record Puppeteer & Playwright JS scripts for E2E website testing, scraping and monitoring
Not at the moment, but this has been requested in the past. Would you mind upvoting the relevant issue on the official repo? https://github.com/checkly/headless-recorder/issues/89
-
Finally released Headless Recorder V1! Record Puppeteer & Playwright JS scripts
The newest version (1.0) of Headless Recorder has just been released! Headless Recorder is a popular open-source Chrome extension that makes writing Playwright/Puppeteer scripts way easier: it records your browser interactions and auto-generates the code.
-
Launch HN: Axiom (YC W21) – No-code browser automation a.k.a. RPA for everyone
Check out Headless Recorder. It records browser interactions and generates Puppeteer and Playwright scripts.
https://github.com/checkly/headless-recorder
What are some alternatives?
puppeteer - Node.js API for Chrome
SingleFile - Web Extension for saving a faithful copy of a complete web page in a single HTML file
dark-knowledge - 😈📚 A curated library of research papers and presentations for counter-detection and web privacy enthusiasts.
wocabee-bot - This extension will automatically solve (almost) any task WocaBee throws at you at lightning speeds
fakebrowser - 🤖 Fake fingerprints to bypass anti-bot systems. Simulate mouse and keyboard operations to make behavior like a real person.
ViewFinderJS - :camera: ViewFinder - Remote isolated browser API for security, automation visibility and interactivity. RBI. CBII. Remote browser isolation, embeddable BrowserView, secure chrome-as-a-service. Managed, variable bandwidth and co-browsing options available in Pro versions. Like S2, WebGap, Bromium, Authentic8, Menlo Security and Broadcom, but free and open-source. Integrated secure document viewing with CDR from https://github.com/dosyago/p2%2e [Moved to: https://github.com/i5ik/ViewFinder]
electron-store - Simple data persistence for your Electron app or module - Save and load user preferences, app state, cache, etc
jest-puppeteer - Run tests using Jest & Puppeteer 🎪✨
puppeteer-instagram - Instagram automation driven by headless chrome.
page-ruler-redux - An awesome page ruler extension for google chrome
url-to-pdf-api - Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.
roam-research-private-api - Private API to enable API access for Roam Research. Now you can connect Roam to your other projects.