Snapshot crawl exception, only URL Untitled description resolution process

Source: Internet
Author: User

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

When it comes to Baidu snapshots, webmasters are aware of his importance, is one of the important factors of Baidu weight, but also the exchange of links, measuring the important standards of the site. Timely snapshot update directly indicates that the site was spider crawl frequency, by spiders like degree. Gossip does not say, today will give you share my Site home snapshot crawl exception, only the URL untitled description, the snapshot stop resolution process.

Say My site China textile Talent Network always snapshot update is more timely, occasionally fall behind a few days, but the recovery is also very fast, but some time ago, enter the main keyword time, out of the snapshot is September 12, has not been described, only a Web site and name, strange, what is the situation? Even have been some of the ICO label also have no, this beauty is second, this situation directly affect the customer trust on the site Ah, I began to pay attention to this problem.

First the website has the question, must first use the tool to check, I through the Chinaz webmaster tools to inquire about the death of the site link, friendship links, these two are our weekly maintenance, with tools are checked, but also with webmaster tools to see the index and crawl anomalies, and do not find any great fluctuations. These indicators have not changed significantly, that is the site what is the problem? said that this has to recommend Google Administrator Tools, I believe that a lot of webmaster are useful to this tool, their crawl error prompts faster, what the problem is basically can be timely notice.

Google Administrator tool analysis, found that our site has a lot of 404 pages, many of the previous changes in the path left over the problem, but also because of the recent server problems are more, access to the situation is unstable. Google administrator tools have a benefit, tell you 404 pages, there are links to the page's domain name, can then quickly find and deal with the problem, 404 of the impact of the whole station naturally do not need me to say, is and cancer, less time nothing, broke up is suddenly right down.

So, I think it's basically part of the deal, after 2 days, when I entered in Baidu, I think he can be good, but think that the reality is always more bone, the situation is worse, the direct web site to check the snapshot is also September 12, this I panic, is there any problem?

Next is to download the IIS access log, about IIS log this piece, I also have been looking at a relatively few, but the site has a problem, will not look also have to see Ah, after all, the log is the spider situation the most direct feedback. Download good log, I first use light years log tool analysis, learn to see each directory access, said log this piece of each webmaster have their own habits of tools, nothing more than the analysis of each directory below the return code, our main do Baidu, the nature of the main analysis of Baidu Spider visit.

The first is 304 pages, analysis of the site found many 304 of the return code, 30,400 degrees, is a page request not update the situation, more than 304, spiders for a long time not to eat new things, will cause the site snapshot update is not timely situation. Another code, the manager found, he used is not the tools to directly view the release of the source, this time found that the index directory is also the textile talent net home a large number of 200 0 64, about 200 0 64 online, I also asked a lot of people on the group, some say is normal, also said the abnormal, More of the argument is crawling incomplete, that is, spiders came to the page, caught information but in the process of taking away the problem, that is, no return information. In the combination of their own site situation, this is the problem, the page does not update, spiders crawl abnormalities.

The problem comes out, the next is to solve the problem, analysis of our textile talent net home, the daily update of the plate is really very little, after all, customers on those customers, there is an increase will not be added daily to the home page. But the homepage problem still has to solve, how to do, adds the new plate, adds one can 8206.html "the content which the real time updates, then the plan effect also produces the content on-line, then goes to the Baidu snapshot complaint, in after a few days, looked that the snapshot restores gradually, so far basically normal."

Summing up this experience, how to say it? Baidu Snapshot is not normal, there are a variety of reasons, sometimes it may just be Baidu's own problems, but if the snapshot more than 3 days above the exception, you have to start to consider whether the site internal problems. At the same time in the examination of the problem, must be considered in many ways, the possible problems are examined. And the problem, must look at the log, because the log than all of your tools can reflect the real situation, a variety of comprehensive, there is always the same can really solve the problem

The author of this article: China textile Talent Network www.texhr.cn A5 First, reprint please keep the copyright information.

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.