okapi VS cloudscraper

It's inspired by others in the space that you might check out: paperclip, okapi, and others.

okapi: supports rocket

okapi looks decent as well. Has codegen for Rocket: https://github.com/GREsau/okapi

I have used it the other way around. I created the Rust code and using that to generate the documentation. https://github.com/GREsau/okapi this worked very good. Here is the generated documentation: https://docs.dfstoryteller.com/rapidoc/ This uses the Rust Doc comments to populate the documentation.

Oh Rocket, you playful muse. I've watched you ascend from my early Rust days; yet each time I reach for you my heart sinks more. This research project of mine led me to okapi, an extension for OpenAPI documentation. And yet, I have to pass once again. While most of the Rust ecosystem blazes toward async, you inch toward it too slowly. Perhaps next time I search for a web framework our paths will align, but until then, I must follow a different orbit.

Try https://github.com/yifeikong/curl_cffi or https://github.com/VeNoMouS/cloudscraper , I believe you should be able to bypass this.

But scraping has definitely gotten tougher with services like cloudflare that even the popular cloudscraper gave up years ago and never made a comeback.

If you're scraping with Python, try cloudscraper—among other things(!), it supports JS rendering (basically the bare-minimum check cloudflare does), without needing to run a full browser in the background. It's built on requests, so integration (for me, anyway) was pretty easy.

https://github.com/venomous/cloudscraper

I've tried using Cloudscraper here https://github.com/VeNoMouS/cloudscraper but I get the following error:

No amount of googling turns up anything. There are others with the same problem - but no real solution. In the gitlab README it explains that to solve CAPTCHAs with cloudscraper you need an API key, which would explain the error that it's not available in the free version. But for the life of me, I can't find where to get a key or any other solution.

cloudscraper

Anyone with a stake in bypassing anti-bot measures isn't going to share their tactics, since sharing it will lead to such workaround being patched or mitigated, requiring them to research for more bot detection workarounds.

Projects like cloudscraper[0] are often linked to point and say "look! they broke Cloudflare!" but CF and the rest of the industry has detections for tools like this, and instead of rolling out blocks for these tools, they give website owners tools like bot score[1] to manage their own risk level on a per-page basis.

0: https://github.com/VeNoMouS/cloudscraper

1: https://developers.cloudflare.com/bots/concepts/bot-score/

This is being used: https://github.com/VeNoMouS/cloudscraper