webcrystal
proxy.py
webcrystal | proxy.py | |
---|---|---|
3 | 5 | |
24 | 2,887 | |
- | - | |
10.0 | 6.8 | |
over 1 year ago | 7 days ago | |
Python | Python | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
webcrystal
-
SearXNG is a free internet metasearch engine
While it lacks a search feature last I checked there's always https://github.com/davidfstr/webcrystal
One .py file. Only one dependency (urllib3).n with a little love the concept could become a full transparent proxy.
-
Offpunk 2.0
From the the project page it says:
> The offline content is stored in ~/.cache/offpunk/ as plain .gmi/.html files. The structure of the Gemini-space is tentatively recreated. One key element of the design is to avoid any database. The cache can thus be modified by hand, content can be removed, used or added by software other than offpunk.
One ambition I have it to setup
https://github.com/davidfstr/webcrystal
> An archiving HTTP proxy and on-disk archival format for websites.
so that all my regular web browsing is auto archived at some level.
It would sure be neat if the archive formats could be compatible. It would allow for a setup where everything I’ve seen with my eyes is then immediately accessible programmatically or in a terminal. I feel that could open some significant productive advantages, especially in the age of LLMs also in the terminal.
-
Auto-scraping web browser?
Webcrystal?
proxy.py
-
Show HN: Proxy.py
[Not my project]
A very well features proxy server (Forward & Reverse + lots of other features).
https://github.com/abhinavsingh/proxy.py
-
How to Choose the Right Python Concurrency API
The article gives a good summary of the quite complex landscape of concurrency in python. There's more to it, for example gil-free c-extensions, subprocesses and cross-machine (plus IPC) communication.
But I'm particularly bothered by the fact that many articles and tutorials look at concurrency as if it's only about factoring primes or writing a web server with many (perhaps even idempotent) parallel requests.
In reality, people will often want and need to combine multiple of these approaches, and then it gets VERY messy. I.e. try to combine a multiprocessing executor with multiple asyncio loops and boom you're in some very deep waters.
One project that does this (async loops inside multiple processes) is proxy.py - very enlightening to read its code base [1].
But I really, really wish python would do more to provide simple and robust abstractions for these kinds of tasks. My dream would be a robust actor system similar to erlang, but we'll probably never get that.
[1] https://github.com/abhinavsingh/proxy.py
- PSA: Blogsport.de und Blogsport.eu sind in den letzten Atemzügen
-
Comodo Firewall
Setup a VM with Hyper-V and restrict the internet access or disable it.(best way), or build yourself a proxy: https://github.com/abhinavsingh/proxy.py
-
Handling 30,000 requests/sec with `proxy.py`
See `proxy.py` examples for some inspiration :) https://github.com/abhinavsingh/proxy.py/tree/develop/examples
What are some alternatives?
wikiteam - Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2023, WikiTeam has preserved more than 350,000 wikis.
one-ring - CSP on top of AsyncIO
diskimageprocessor - Tool for automated processing of disk images in BitCurator
mitm - 👨🏼💻 A customizable man-in-the-middle TCP intercepting proxy.
warcprox - WARC writing MITM HTTP/S proxy
mitm-omegle - Watch strangers talk on Omegle (man in the middle attack explained for kids)
tor-proxy - Run your any python service over tor using tor-proxy
lokinet-exit-provider - lokinet exit node webapp
http-proxy-list - It is a lightweight project that, every 10 minutes, scrapes lots of free-proxy sites, validates if it works, and serves a clean proxy list. [GET https://api.github.com/repos/mertguvencli/http-proxy-list: 403 - Repository access blocked]
benchmark-proxypy
spike - :mega: A fast reverse proxy written in PHP that helps to expose local services to the internet
hass-weatherflow2mqtt - WeatherFlow to MQTT for Home Assistant. Use UDP to get local weather data in to Home Assistant using MQTT Discovery