CORSflare VS cloudflare-cors-anywhere

Try out some queries from your browser history and see if anything beats google. Other engines are more likely to beat google for queries that google has failed at.

Majority of engines were found at below link. Surprisingly many engines use the same indices, for example duckduckgo is mostly just privacy-protected bing. Big thanks to Rohan Kumar.

https://seirdy.one/2021/03/10/search-engines-with-own-indexe...

A proxy is needed to bypass iframe restrictions for most websites. I used this x-frame-bypass client js code [https://github.com/niutech/x-frame-bypass] which (previously?) used proxy.megatunger.com . That free proxy could be recording your queries, who knows, so use caution.

If (when actually) that proxy goes down I think I'll set up something like CORSflare to have a more reliable and trustworthy alternative. [https://github.com/Darkseal/CORSflare]

I hacked this together over about one workday in total so it's likely to have significant issues. You can comment them here or (preferably) file an issue on the repo: [https://github.com/qpwo/searchall/]

There's also a demo video on the repo if the site goes down but you wanted to see how it looks. Feel free to file feature requests on the repo as well. If you'd rather copy it and make your own version then that's fine too.

I'll try to reply to all comments here.

Otherwise, if it is on a server, when you make the request, add a header like “Origin”: “https://(sitename).com/“ where sitename would be the URL (not yours, in this case Pipedream’s) to avoid CORS. If worse comes to worse though, you could make your own proxy using Cloudflare Workers. There’s also Cloudflare CORS-Anywhere and CORSFlare

Yes, unfortunately if the "foreign" sources don't support CORS, you'd have to use a CORS proxy... If you want to self-host, there's one at https://github.com/Zibri/cloudflare-cors-anywhere that can be deployed to CloudFlare Workers (the code is a bit messy though).

GitHub supports CORS for raw data for example, that's why I put it in the sample queries.

here’s the one I use

You could probably add cloudflare workers as an option. There's an example CORS friendly proxy here: https://github.com/Zibri/cloudflare-cors-anywhere

Guessing normal use would fit in their free plan.

You should be able to do this with a third party service such as https://fixtur.es/en/team/philadelphia-union

I route my remote calendars through Cloudflare workers for a modicum of privacy from random third party services. It's as simple as running a basic open source relay: https://github.com/Zibri/cloudflare-cors-anywhere

Otherwise, if it is on a server, when you make the request, add a header like “Origin”: “https://(sitename).com/“ where sitename would be the URL (not yours, in this case Pipedream’s) to avoid CORS. If worse comes to worse though, you could make your own proxy using Cloudflare Workers. There’s also Cloudflare CORS-Anywhere and CORSFlare

Wait I found this repo for doing what I want, I’ll see if it works