proxy-chain
pyppeteer
Our great sponsors
proxy-chain | pyppeteer | |
---|---|---|
2 | 1 | |
784 | 3,410 | |
2.3% | - | |
4.1 | 0.2 | |
4 months ago | almost 4 years ago | |
JavaScript | Python | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
proxy-chain
-
How to create a simple forward proxy
take a look at https://www.npmjs.com/package/proxy-chain - I think it is much closer to what you are trying to do.
-
How to use rotating proxies with Puppeteer
To spin up proxy rotation server you may use the handy library proxy-chain and ScrapingAnt free proxies list:
pyppeteer
-
How to use rotating proxies with Puppeteer
Puppeteer is a high-level API to control headless Chrome. Most things that you can do manually in the browser can be done using Puppeteer, so it quickly became one of the most popular web scraping tool in Node.js and Python. Many developers use it for single-page applications (SPA) data extraction as it allows executing client-side Javascript. In this article, we are going to show how to set up a proxy in Puppeteer and how to spin up your own rotating proxy server.
What are some alternatives?
http-proxy - A full-featured http proxy for node.js
playwright-go - Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.
proxy-login-automator - A single node.js script to automatically inject user/password to http proxy server via a local forwarder
headless-chrome-github-action - Github action to run test cases using Selenium
url-to-pdf-api - Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.
Nightmare - A high-level browser automation library.
Puppeteer-sharp-extra - Plugin framework for PuppeteerSharp
taiko - A node.js library for testing modern web applications
insta_delete - Selenium powered script to delete old instagram posts, upload images, like posts in feed.
uzen - Website crawler with YARA detection
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)