How do I configure. htaccess and 403 to set why only the homepage is valid? I tried to block this spider and used the following rules to find that only the homepage is valid and the internal page is still crawling. is it not comprehensive in writing? How to modify it? & Nbsp; RewriteCond & nbsp; % {HTTP_USER_AGENT} & nbsp; ^ MJ12bot $ & nbsp; RewriteRule & nbsp; ^. * & nbsp;-& nbsp; [F, L] how to configure. why is the homepage valid only when htaccess and 403 are set?
I tried to block this spider and used the following rules to find that only the homepage is valid and the internal page is still crawling. is it not comprehensive in writing? How to modify it?
RewriteCond % {HTTP_USER_AGENT} ^ MJ12bot $
RewriteRule ^. *-[F, L]
Previously, because I changed the new domain name www.tvtv.hk and made a 301 jump to the old domain name, I encountered the same problem with modifying. htaccess. The homepage can be successfully executed, but the inner page won't work.
------ Solution --------------------
Check whether there are other rewrite effects before this statement is correct.