Powerful document editing and collaboration in your app or environment. Ultimate security, API and 30+ ready connectors, SaaS or on-premises Learn more →
A high-level browser automation library.Project mention: Web Scraping Google With Node JS | dev.to | 2022-09-24
Nightmare JS is a web automation library designed for websites that don’t own APIs and want to automate browsing tasks. Nightmare JS is mostly used by developers for UI testing and crawling. It can also help mimic user actions(like goto, type, and click) with an API that feels synchronous for each block of scripting.
💯 Teach puppeteer new tricks through plugins.Project mention: how can i bypasd 403 forbidden? | reddit.com/r/webscraping | 2023-03-09
There is a good chance that the website is using Cloudflare to block web scrapers, which will require you to use a fortified headless browser to solve the JS challenges. Your options include the Puppeteer stealth plugin and Selenium undetected-chromedriver.
Appwrite - The Open Source Firebase alternative introduces iOS support . Appwrite is an open source backend server that helps you build native iOS applications much faster with realtime APIs for authentication, databases, files storage, cloud functions and much more!
A node.js library for testing modern web applicationsProject mention: Challenges in User Interface Automation: New Approaches | dev.to | 2022-10-17
The Open Source library Taiko can detect elements based on relation.
🌐 Run headless Chrome/Chromium on AWS LambdaProject mention: Is it possible to use functions requiring a GPU in a serverless google cloud function? | reddit.com/r/googlecloud | 2022-06-14
Please see this thread on some similar implementations to what I'm doing if you are curious: https://github.com/adieuadieu/serverless-chrome/issues/108
🤖 A Node queue API for generating PDFs using headless Chrome. Comes with a CLI, S3 storage and webhooks for notifying subscribers about generated PDFsProject mention: Automate Printing/Saving News Articles? | reddit.com/r/Piracy | 2022-12-09
Maybe this one: https://github.com/esbenp/pdf-bot
Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.Project mention: Thoughts on Go headless browser tools for testing and scraping? | reddit.com/r/golang | 2022-10-14
It looks like https://github.com/chromedp/chromedp is the most popular option. There's also https://github.com/playwright-community/playwright-go. Any thoughts or advice about using these tools?
Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.
AWS Cloud-aware infrastructure-from-code toolbox [NEW]. Build cloud backends with Infrastructure-from-Code (IfC), a revolutionary technique for generating and updating cloud infrastructure. Try IfC with AWS and Klotho now (Now open-source)
Puppeteer as a service
HTML/CSS/JS in, PDF out, via Chrome
☕️ TDD with Browserify, Mocha, Headless Chrome and WebDriver
Instagram automation driven by headless chrome.
Screenshot as a service: take screenshot of the given URL (by as-a-service)
Node.JS: Script for scraping Strava authorization cookies
1-click anon protonvpn account
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
Proposed solution to twitter's ridiculous API pricing
1 project | reddit.com/r/ProgrammerHumor | 8 Feb 2023
Using selenium with proxy still hit bot detection
2 projects | reddit.com/r/webscraping | 16 Jan 2023
Getting detected by Cloudflare for no apparent reason.
1 project | reddit.com/r/webscraping | 12 Jan 2023
serving pdf from express backend to client
2 projects | reddit.com/r/node | 3 Dec 2022
How Project Wallace extracts all CSS from any webpage
3 projects | dev.to | 1 Dec 2022
100s of Spam Leads but not showing up in Google Analytics (UA) or Google Ads
1 project | reddit.com/r/PPC | 16 Nov 2022
Perimeter X bypass help
1 project | reddit.com/r/webscraping | 30 Oct 2022
A note from our sponsor - ONLYOFFICE
www.onlyoffice.com | 1 Jun 2023