Google crawler in the crawl to see the soft 404 error
Friends who often use Google Webmaster tools may find some soft 404 errors in the crawl error in the fault diagnosis, which is mentioned in the previous "404 error impact on the site" in the article.
Under normal circumstances, when the requested page error, there will be two kinds of error code information, one is that we often say 404, the other is soft 404.
According to normal thinking, when a Web page does not exist, will return a 404 code to indicate that soft 404 is that these non-existent pages return not a normal 404 error code, but 200 code (log code).
Why would there be soft 404
The soft 404 code appears roughly as follows:
Server configuration error;
Web site programs or templates error;
The website was caused by malicious attack;
Site administrator error caused.
Most of the time webmasters have some minor mistakes, such as:
Mistakes caused by soft 404 error
8630.html "> sometimes due to misoperation or program problems, for non-existent Web pages, return directly to the home page."
Soft 404 have those effects?
Soft 404 code will make ordinary users confused, see a very interesting link, but not what they want to click on the search engine spider program, will spend a lot of time crawling on the site and index those do not exist, and often repeat the URL. Will result in a relatively low site collection (because the spider program spent a lot of time crawling some non-existent pages, resulting in a part of the page contains unique content may not be found in time).
How to deal with soft 404?
For soft 404, the best way is to return 404 code, so that users can find the relevant page based on the 404 error page, the crawler will be good to handle 404 errors, in addition to the above mentioned the resulting soft 404 of several possibilities to check the Web page, thus fixing the error.
But sometimes the reality is not so ideal, At this time we can use robots.txt file or nofollow to prevent the crawler program, in the ordinary user, soft 404 will inevitably lead to a page jump rate is too high, then, in order to achieve a better user experience, we can appropriately modify the soft 404 error prompt page instead of returning to the system default page or even the homepage.
This article comes from He Qingyong http://www.7714.org
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.