Our great sponsors
-
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
What kind of scale are we talking about here? 20 pages or 2000? If 20, I'd recommend setting a capturing proxy along with something like Firefox where you can install the MITM cert without drama, then just visit those pages and the capturing proxy will do the rest.
If it's closer to 2000, then I'd guess roughly the same trick but using puppeteer, although placing the burden upon yourself to not get stuck in a crawling loop
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
- Show HN: Quetta – A privacy-first web browser with enhanced ad blocker inside
- How To Enable Hardware Acceleration on Chrome, Chromium & Puppeteer on AWS in Headless mode
- The 5 Node.js PDF Libraries Every Developer Must Know
- A question about web-scraping
- Can a puppetry major survive a flagship’s financial crisis? Should it?