public-roadmap VS mitmproxy

> The google search function is also limited. For comparison, SerpAPI masterfully scrapes Google Search using a proxy network and very intelligent parsing. In experiments using SerpAPI in combination with Microsoft’s guidance module, I got much farther than AutoGPT.

Thanks for your kind words. We are working on SerpApi integration for Auto-GPT: https://github.com/serpapi/public-roadmap/issues/905

Add a Feature Request💫 or a Bug🐞

The long-term plan of this project is to combine API and non-API solutions as SerpApi started developing support for Google Hotels so later users can choose the desired backend to work with (free with limitations or paid without limitations). SerpApi's backend could be also useful for people who don't know how to use it, for example, SerpApi pagination which could be enabled with a simple function argument pagination=True.

Try in the Playground | Documentation | Public Roadmap Issue

I was debugging the Bing Image Search to help implementing our new Bing Reverse Image Search API. Initially, I've used mitmproxy because Ctrl+Shift+F in the browser dev tools haven't found the request. Then I've figured out how to filter network requests in the browser dev tools, examined the response, and made a draft data adapter.

If there is a difference in one of the keys, an automated bot reports a possible issue in SerpApi Public Roadmap.

You can check our public roadmap to track the progress for this API: [New API] Brave Search

Add a Feature Request💫 or a Bug🐞

🗺️ [New API] Add Google Ngram Viewer API

Try in the Playground | Documentation | Public Roadmap Issue

This statement gives a false sense of security. You can use a transparent proxy, like mitmproxy, to view HTTPS traffic - https://mitmproxy.org/. https://reedmideke.github.io/networking/2021/01/04/mitmproxy-openwrt.html

You'll need to install mitmproxy and set it up on your computer and iOS. I won't go into too much detail here on how to do this, but there are plenty of guides available. This is a pretty good one: https://nadav.ca/2021/02/26/inspecting-an-iphone-s-https-traffic/

TIL this goes back to 2006, how cool! We nowadays have a much simpler version as a mitmproxy example: https://github.com/mitmproxy/mitmproxy/blob/main/examples/ad.... Although it obviously does not work as well anymore with everything being HTTPS nowadays (unless you trust the cert of course). :)

Perhaps you could have your device use a proxy that can do the HTTPS unwrap for you? https://mitmproxy.org/ maybe?

A great way to test the effectiveness of a pinning implementation is by simulating an MITM attack. Tools like Mitmproxy or Wireshack allow us to create a test environment to monitor, intercept, and proxy network requests for a test host.