pytorctl
har2requests
| pytorctl | har2requests | |
|---|---|---|
| 1 | 2 | |
| 57 | 98 | |
| - | - | |
| 0.0 | 3.2 | |
| 6 months ago | over 2 years ago | |
| Python | Python | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pytorctl
-
Scrapism
Hi Sam,
It might be worth adding a section on distributed anonymous scrapers that use some form of messaging middleware to distribute the URLs to scrape. Regarding the anonymous aspect (independent of job distribution, of course), you could walk them through using https://github.com/aaronsw/pytorctl or even a rotating tor proxy. This is how I scraped all those Instagram locations + metadata we discussed about five years ago. Hope you’re doing well!
har2requests
- Scrapism
-
Show HN: Mitmproxy2swagger – Automagically reverse-engineer REST APIs
Very nice!
On the same note, I wrote a program to generate Python code (requests) from a HAR capture: https://github.com/louisabraham/har2requests
I think using HAR captures is simpler for the end user than spawning mitmproxy as they don't require any installation and are extracted from the network tab of the browser devtools. Is there a reason why you didn't use them?
What are some alternatives?
Shirt-without-Stripes - State of AI
mitmproxy2swagger - Automagically reverse-engineer REST APIs via capturing traffic
httpx - A next generation HTTP client for Python. 🦋
ideas - :rocket: Ideas for everyone under a CC licence. Feel free to use. I'll send you a postcard if you build anything on this list.
har2openapi - Generate openapi spec api documentation from captured har files
currency-api - Free Currency Exchange Rates API with 150+ Currencies & No Rate Limits
mitmproxy - An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers.
openapi-to-fastapi - OpenAPI 3.0 to FastAPI route generator
cats - CATS is a REST API Fuzzer and negative testing tool for OpenAPI endpoints. CATS automatically generates, runs and reports tests with minimum configuration and no coding effort. Tests are self-healing and do not require maintenance.
apiclarity - An API security tool to capture and analyze API traffic, test API endpoints, reconstruct Open API specification, and identify API security risks.Â