nginx-ultimate-bad-bot-blocker
nginx-ultimate-bad-bot-blo
Our great sponsors
| nginx-ultimate-bad-bot-blocker | nginx-ultimate-bad-bot-blo | |
|---|---|---|
| 11 | 4 | |
| 3,657 | - | |
| - | - | |
| 9.8 | - | |
| 5 days ago | - | |
| Shell | ||
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nginx-ultimate-bad-bot-blocker
- Nginx Bad Bot and User-Agent Blocker
-
Bad Bots Account for 73% of Internet Traffic: Analysis
I manage a network of several hundred websites. About 2 years ago we started blocking bot/crawler user-agents. Some websites see thousands of these requests every day, skewing analytics and eating bandwidth.
Tools like this help: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...
-
Rack::Attack
I generally prefer to go up a level. We install ultimate bad bot blocker at the nginx level for apps running on servers or in K8S. For Heroku you can do this with foremen or docker. The advantage of this is that the ‘no’ happens faster than it does when making it all the way down to rack. RackAttack might let a door to door salesperson say “hi,I’m here to talk to you about solar” before slamming the door. Nginx let’s the same salesperson barely say “hi ..” before slamming the door in their face.
-
Are there any solid and straightforward guides on Installing Nextcloud with NGINX & PHP8.1? I could really use a hand, I've been at this for 2 days now.
the subdomain example nginx config from NextCloud with a few changes like TLSv1.3 only, geoblocking and some bot blocking from here and a few other security tweaks. The nginx file is basically a server block as an include separate from the main nginx.conf. The configuration gets an A+ in security from NextCloud's checker and others.
-
Ask HN: Any way to ban GPT-4 and others from harvesting my content and data?
Use nginx anti-bot[1] or product such as Fastly or Cloudflare anti-bot feature, which blocks content scrapping and only allows specific bots using rules or AI. Another option is to block VPN, cloud and hosting companies' ASNs. There is no benefit for you allowing someone to scrap your content apart from Bing and Google. The rest of the bots can die, or you will lose your content to scrappers. So finally, put it behind a paywall if possible. Of course, the paywall only works if you have good content or buying ads to promote it. Good luck, mate.
[1]https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...
-
Blocking bots? Do you bother?
If you want to go full-shield mode you can use this solution on the server https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker and/or Cloudflare rules. Keep in mind that having both of this tools at the same time will require some deep tech work from you and will not save you from all bots.
-
Videolan.org Robots.txt
I used the ultimate Nginx bad bot blocker on a couple of my side projects, and it is a pretty good project https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... . Apart from the Cloudflare offers UA blocking and AI driven bot management too. Most of these bots are for content scrapping and then creating search spam results. I am a one-person show, and it hurts both financial and resources wise on severs. So I block them.
-
Is this a attempt to hack my website?
I recommend https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker to block unwanted bots
-
Google Drive may restrict files identified as violating ToS
Same experience here, one spammer DOSing my site, always with similar patterns. I'm already behind Cloudflare and use https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... but I still have to identify and block them manually, which is annoying and a waste of time. Some IP-range blocks affected users so it's not fine grained enough. I wish I could identify, expose and sue them into oblivion.
- website with ad code?
nginx-ultimate-bad-bot-blo
-
Bad Bots Account for 73% of Internet Traffic: Analysis
I manage a network of several hundred websites. About 2 years ago we started blocking bot/crawler user-agents. Some websites see thousands of these requests every day, skewing analytics and eating bandwidth.
Tools like this help: https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...
-
Ask HN: Any way to ban GPT-4 and others from harvesting my content and data?
Use nginx anti-bot[1] or product such as Fastly or Cloudflare anti-bot feature, which blocks content scrapping and only allows specific bots using rules or AI. Another option is to block VPN, cloud and hosting companies' ASNs. There is no benefit for you allowing someone to scrap your content apart from Bing and Google. The rest of the bots can die, or you will lose your content to scrappers. So finally, put it behind a paywall if possible. Of course, the paywall only works if you have good content or buying ads to promote it. Good luck, mate.
[1]https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo...
-
Videolan.org Robots.txt
I used the ultimate Nginx bad bot blocker on a couple of my side projects, and it is a pretty good project https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... . Apart from the Cloudflare offers UA blocking and AI driven bot management too. Most of these bots are for content scrapping and then creating search spam results. I am a one-person show, and it hurts both financial and resources wise on severs. So I block them.
-
Google Drive may restrict files identified as violating ToS
Same experience here, one spammer DOSing my site, always with similar patterns. I'm already behind Cloudflare and use https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blo... but I still have to identify and block them manually, which is annoying and a waste of time. Some IP-range blocks affected users so it's not fine grained enough. I wish I could identify, expose and sue them into oblivion.
What are some alternatives?
blocklist-ipsets - ipsets dynamically updated with firehol's update-ipsets.sh script
Cryptomator - Multi-platform transparent client-side encryption of your files in the cloud
Horus-Eye - Just Simple Code To Play With Android Payloads (;
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Ultimate.Hosts.Blacklist - The Ultimate Unified Hosts file for protecting your network, computer, smartphones and Wi-Fi devices against millions of bad web sites. Protect your children and family from gaining access to bad web sites and protect your devices and pc from being infected with Malware or Ransomware.
block - Let's make an annoyance free, better open internet, altogether!
spamscanner - Spam Scanner is a Node.js anti-spam, email filtering, and phishing prevention tool and service. Built for @ladjs, @forwardemail, @cabinjs, @breejs, and @lassjs.
spam-words - List of spam words in different languages
apache-ultimate-bad-bot-blocker - Apache Block Bad Bots, (Referer) Spam Referrer Blocker, Vulnerability Scanners, Malware, Adware, Ransomware, Malicious Sites, Wordpress Theme Detectors and Fail2Ban Jail for Repeat Offenders
1Hosts - World's most advanced DNS filter-/blocklists!
hosts - 🔒 Consolidating and extending hosts files from several well-curated sources. Optionally pick extensions for porn, social media, and other categories.
Global-List-Facebook-Groups-Keyword-Moderation-Alerts - The Global List of Facebook Groups Keywords for Moderation Alerts