Apache No crawler

Apache
①, by modifying the. htaccess file
to modify the. htaccess in the Site directory, add the following code

Rewriteengine on

Rewritecond%{http_user_agent} (^$| feeddemon| jikespider| Indy) [NC]
rewriterule ^ (. *) $-[F]

②, by modifying the httpd.conf configuration file
find a similar location below, add/modify according to the following code, then restart Apache:
documentroot/home/wwwroot/xxx
<directory "/home/wwwroot/xxx" >
         setenvifnocase user-agent ". * (feeddemon| jikespider| Indy) "Badbot
         Order Allow,deny
         allow from all
         deny from Env=badbot
</Directory>

Apache-Forbidden crawler