awesome-web-scraping
proxy-list
Our great sponsors
| awesome-web-scraping | proxy-list | |
|---|---|---|
| 6 | 5 | |
| 5,974 | 2,135 | |
| - | - | |
| 0.0 | 0.0 | |
| about 1 month ago | 6 months ago | |
| Makefile | ||
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-web-scraping
-
Russian Flag in Readme
E.g. how would a Ukrainian dev feel having his project showcased in this list, under the Russian flag?
[0] https://github.com/lorien/awesome-web-scraping/issues/136
proxy-list
- Proxylist Sources
-
Help scraping StockX / Goat / eBay
There is a daily update list here https://github.com/clarketm/proxy-list/blob/master/proxy-list-raw.txt
-
Is it normal that NOT EVEN ONE proxy from github or other sites ... work ??
def filterOut_workingProxies(proxies): #FILTER OUT WORKING PROXIES workingProxies = [] #for i in range(10): for i in range(len(proxies)): p = proxies[i] print(f"testing: {p}...") proxy = { 'http' : 'http://'+p, #ERK:::https://stackoverflow.com/a/61466680 'https' : 'https://'+p} try: resp = requests.get("https://www.google.com", proxies=proxy, timeout=3) print(resp.status_code) if resp.status_code == 200 or str(resp.status_code)[0]=='2': print("+++++ WROKING\n") workingProxies.append(proxy) except: pass return workingProxies [...] #DAILY UPDATING PROXY LINKS: #CONST urls_github = ["https://github.com/ShiftyTR/Proxy-List/blob/master/proxy.txt", "https://github.com/clarketm/proxy-list/blob/master/proxy-list-raw.txt"] url_fplNet = "https://free-proxy-list.net"
What are some alternatives?
mubeng - An incredibly fast proxy checker & IP rotator with ease.
fresh-proxies - fresh-proxies
Proxy-List - Free proxy list UPDATED HOURLY! -- for api visit
Awesome-Warez - All your base are belong to us!
proxy-list - A list of free, public, forward proxy servers. UPDATED DAILY!
proxy-list - Automatically updated list of free proxies
proxy-list - 🚀 High anonymous free proxy list. CONTINUOUSLY UPDATING!!!
Sneaks-API - A StockX, FlightClub, Goat, and Stadium Goods API all in one. This sneaker API allows users to search sneakers and track and compare prices while providing additional info such as product links and images
Proxyman - Modern. Native. Delightful Web Debugging Proxy for macOS, iOS, and Android ⚡️
socks5_list - Auto-updated SOCKS5 proxy list + proxies for Telegram
free-proxy-list - 🔥Free proxy servers list / Updated hourly!