nginx-ultimate-bad-bot-blo VS Cryptomator

I manage a network of several hundred websites. About 2 years ago we started blocking bot/crawler user-agents. Some websites see thousands of these requests every day, skewing analytics and eating bandwidth.

Tools like this help: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...

Use nginx anti-bot[1] or product such as Fastly or Cloudflare anti-bot feature, which blocks content scrapping and only allows specific bots using rules or AI. Another option is to block VPN, cloud and hosting companies' ASNs. There is no benefit for you allowing someone to scrap your content apart from Bing and Google. The rest of the bots can die, or you will lose your content to scrappers. So finally, put it behind a paywall if possible. Of course, the paywall only works if you have good content or buying ads to promote it. Good luck, mate.

[1]https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...

I used the ultimate Nginx bad bot blocker on a couple of my side projects, and it is a pretty good project https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... . Apart from the Cloudflare offers UA blocking and AI driven bot management too. Most of these bots are for content scrapping and then creating search spam results. I am a one-person show, and it hurts both financial and resources wise on severs. So I block them.

Same experience here, one spammer DOSing my site, always with similar patterns. I'm already behind Cloudflare and use https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... but I still have to identify and block them manually, which is annoying and a waste of time. Some IP-range blocks affected users so it's not fine grained enough. I wish I could identify, expose and sue them into oblivion.

the best way to do this is with https://cryptomator.org

Before putting anything on a cloud service I would recommend 3rd party tools, like Cryptomator, to encrypt folders and such, then upload to a cloud service.

I use Cryptomator - https://cryptomator.org

I've used countless encryption "schemes" over the years, from True/Vera-Crypt to encrypted sparse bundles/images, and none have ever really felt right.

These days i tend to use Cryptomator[0] instead. It accomplishes what none of the others could do, which is transparent encryption across devices.

With Cryptomator, i simply create a vault somewhere in the cloud, stuff data in it, and i can access it from my laptop, phone or tablet, and not think much about it. It integrates into the normal file browsing APIs, and doesn't get in the way.

Because it does "per file" encryption, it also doesn't need to download a 20-100MB chunk from the cloud before decrypting, so it's rather fast (depending on file size of course).

[0]: https://cryptomator.org/

Cryptomator's arguably the most popular encryption software for cloud storage (you can give yourself zero-knowledge encryption by using them) - it's actually what they specialize & focus on (cloud encryption). It's 100% open source and Free to use on computers. On phones I believe it's just a 1-time fee of a few bucks ($13-14, then you have it forever) - note: their iOS offering is still new, so may be a bit unpolished at the moment.

This is the solution: https://cryptomator.org/

Cryptomator. It is made for uploading files securely to cloud storage, but works locally, is easy to use, and completely free for your use case.