cloudproxy
proxy.py
cloudproxy | proxy.py | |
---|---|---|
7 | 5 | |
1,356 | 2,861 | |
- | - | |
2.2 | 6.8 | |
11 months ago | 3 days ago | |
Python | Python | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cloudproxy
- Hide your scrapers IP behind the cloud. Provision proxy servers across different cloud providers to improve your scraping success.
- Cloudproxy - hide your scrapers IP behind the cloud
-
Hacker News top posts: Jun 26, 2021
Cloudproxy – hide your scrapers IP behind the cloud\ (38 comments)
- Cloudproxy – hide your scrapers IP behind the cloud
-
Create a pool of proxies in the cloud for scraping, using CloudProxy
Source code: https://github.com/claffin/cloudproxy
proxy.py
-
Show HN: Proxy.py
[Not my project]
A very well features proxy server (Forward & Reverse + lots of other features).
https://github.com/abhinavsingh/proxy.py
-
How to Choose the Right Python Concurrency API
The article gives a good summary of the quite complex landscape of concurrency in python. There's more to it, for example gil-free c-extensions, subprocesses and cross-machine (plus IPC) communication.
But I'm particularly bothered by the fact that many articles and tutorials look at concurrency as if it's only about factoring primes or writing a web server with many (perhaps even idempotent) parallel requests.
In reality, people will often want and need to combine multiple of these approaches, and then it gets VERY messy. I.e. try to combine a multiprocessing executor with multiple asyncio loops and boom you're in some very deep waters.
One project that does this (async loops inside multiple processes) is proxy.py - very enlightening to read its code base [1].
But I really, really wish python would do more to provide simple and robust abstractions for these kinds of tasks. My dream would be a robust actor system similar to erlang, but we'll probably never get that.
[1] https://github.com/abhinavsingh/proxy.py
- PSA: Blogsport.de und Blogsport.eu sind in den letzten Atemzügen
-
Comodo Firewall
Setup a VM with Hyper-V and restrict the internet access or disable it.(best way), or build yourself a proxy: https://github.com/abhinavsingh/proxy.py
-
Handling 30,000 requests/sec with `proxy.py`
See `proxy.py` examples for some inspiration :) https://github.com/abhinavsingh/proxy.py/tree/develop/examples
What are some alternatives?
FlareSolverr - Proxy server to bypass Cloudflare protection
one-ring - CSP on top of AsyncIO
asyncio-socks-server - A SOCKS proxy server implemented with the powerful python cooperative concurrency framework asyncio.
mitm - 👨🏼💻 A customizable man-in-the-middle TCP intercepting proxy.
Neotron-Pico - A Neotron powered by the Raspberry Pi Pico
mitm-omegle - Watch strangers talk on Omegle (man in the middle attack explained for kids)
Open-Proxy-Project - Web App with all proxies updated regularly! [GET https://api.github.com/repos/midhunvnadh/Open-Proxy-Project: 403 - Repository access blocked]
lokinet-exit-provider - lokinet exit node webapp
cloudfire - A proxy server to bypass cloudflare I am under attack mode using playwright, written in python
benchmark-proxypy
spike - :mega: A fast reverse proxy written in PHP that helps to expose local services to the internet
hass-weatherflow2mqtt - WeatherFlow to MQTT for Home Assistant. Use UDP to get local weather data in to Home Assistant using MQTT Discovery