apache-ultimate-bad-bot-blocker
apache-ultimate-bad-bot-bl
| apache-ultimate-bad-bot-blocker | apache-ultimate-bad-bot-bl | |
|---|---|---|
| 3 | 1 | |
| 747 | - | |
| - | - | |
| 9.5 | - | |
| 6 days ago | - | |
| C | ||
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
apache-ultimate-bad-bot-blocker
-
Ahrefs Saved US$400M in 3 Years by Not Going to the Cloud
I found Ahrefs a bit too aggressive. Thankfully they seem to honor Robots.txt so it's not much of a problem, but across the wide range of sites I'm responsible for, the Ahrefs bots really stood out as being a problem. Out of curiosity, I just double checked and the only hits from them in the logs are "GET /robots.txt" which is what I would expect.
I recently found a regularly update place for bot stuff:
https://github.com/mitchellkrogza/apache-ultimate-bad-bot-bl...
I don't think I'd call Ahrefs a "Bad Bot" but they are on that list. I'd call any bot ignoring robots.txt bad though.
- My VM gets thousands of hits from vulnerability crawlers (bots) each day. Is that normal?
-
Added a Google Recaptcha to the Checkout page due to bot-fraud attempts, now it hinders legitimate customers
Most malicious bots are well known and blocking them is often simple. Use the popular Bad Bot Blocker software https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker
apache-ultimate-bad-bot-bl
-
Ahrefs Saved US$400M in 3 Years by Not Going to the Cloud
I found Ahrefs a bit too aggressive. Thankfully they seem to honor Robots.txt so it's not much of a problem, but across the wide range of sites I'm responsible for, the Ahrefs bots really stood out as being a problem. Out of curiosity, I just double checked and the only hits from them in the logs are "GET /robots.txt" which is what I would expect.
I recently found a regularly update place for bot stuff:
https://github.com/mitchellkrogza/apache-ultimate-bad-bot-bl...
I don't think I'd call Ahrefs a "Bad Bot" but they are on that list. I'd call any bot ignoring robots.txt bad though.
What are some alternatives?
nginx-ultimate-bad-bot-blocker - Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti-DDOS, Wordpress Theme Detector Blocking and Fail2Ban Jail for Repeat Offenders
infinite-fake-website - Lure SEO spammers down a hole with no bottom
htpw - htpw is a project to increase the security of your WordPress!