How to prohibit the configuration method of web crawler acquisition by Apache

Apache ban web crawler, in fact, very simple, as long as the following code configuration to the Apache httpd.conf file in the location, it can be.

<location/>
Setenvifnocase user-agent "Spider" Bad_bot
Browsermatchnocase Bingbot Bad_bot
Browsermatchnocase Googlebot Bad_bot
Order Deny,allow
#下面是禁止soso的爬虫
Deny from 124.115.4. 124.115.0.64.69.34.135 216.240.136.125 218.15.197.69 155.69.160.99 58.60.13. 121.14.96.58.60.14. 58.61.164.202.108.7.209
Deny from Env=bad_bot
</Location>


This is forbidden for all reptiles containing spider characters.

If you want to specifically prohibit the crawler, change to the exact matching reptile string, if bingbot, Googlebot, etc.