pyppeteer
proxy-chain
pyppeteer | proxy-chain | |
---|---|---|
1 | 2 | |
3,410 | 792 | |
- | 2.3% | |
0.2 | 3.7 | |
about 4 years ago | 9 days ago | |
Python | JavaScript | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pyppeteer
-
How to use rotating proxies with Puppeteer
Puppeteer is a high-level API to control headless Chrome. Most things that you can do manually in the browser can be done using Puppeteer, so it quickly became one of the most popular web scraping tool in Node.js and Python. Many developers use it for single-page applications (SPA) data extraction as it allows executing client-side Javascript. In this article, we are going to show how to set up a proxy in Puppeteer and how to spin up your own rotating proxy server.
proxy-chain
-
How to create a simple forward proxy
take a look at https://www.npmjs.com/package/proxy-chain - I think it is much closer to what you are trying to do.
-
How to use rotating proxies with Puppeteer
To spin up proxy rotation server you may use the handy library proxy-chain and ScrapingAnt free proxies list:
What are some alternatives?
playwright-go - Playwright for Go a browser automation library to control Chromium, Firefox and WebKit with a single API.
http-proxy - A full-featured http proxy for node.js
headless-chrome-github-action - Github action to run test cases using Selenium
proxy-login-automator - A single node.js script to automatically inject user/password to http proxy server via a local forwarder
url-to-pdf-api - Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.
Puppeteer-sharp-extra - Plugin framework for PuppeteerSharp
Nightmare - A high-level browser automation library.
insta_delete - Selenium powered script to delete old instagram posts, upload images, like posts in feed.
taiko - A node.js library for testing modern web applications
uzen - Website crawler with YARA detection
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)