forward-proxy-manager

Request distributor for web scraping (by jkelin)
Add to my DEV experience Proxy proxy-server Scraper Webscraping
Source Code
Suggest alternative
Edit details
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Forward-proxy-manager Alternatives

Similar projects and alternatives to forward-proxy-manager

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better forward-proxy-manager alternative or higher similarity.
Suggest an alternative to forward-proxy-manager

forward-proxy-manager reviews and mentions

Posts with mentions or reviews of forward-proxy-manager. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-20.
  • Web Scraping in Python – The Complete Guide
    11 projects | news.ycombinator.com | 20 Feb 2024
    I've found myself writing the same session/proxy/rate limiting/header faking management code over and over for my scrapers. I've extracted it into it's own service that runs in docker and acts as a MITM proxy between you and target. It is client language agnostic, so you can write scrapers in python, node or whatever and still have great performance.

    Highly recommend this approach, it allows you to separate infrastructure code, that gets highly complex as you need more requests, from actual spider/parser code that is usually pretty straightforward and project specific.

    https://github.com/jkelin/forward-proxy-manager

Stats

Basic forward-proxy-manager repo stats
1
6
4.6
8 months ago

The primary programming language of forward-proxy-manager is Go.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com