Shark: How to log Analysis search engine spider tracking

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Today to casually pull, how to pass the log, analysis of search engine spider on the site's collection and ranking situation.

As we all know, the most important thing to look at the log is to look at the status code of HTTP, to see if there are no 404, 304, 200. Analyzing the structure of a Web site through the status code is there a problem? is the server stable? Do you want to block dead links or just use a 404 page?

Second, look at spiders crawl every day the situation, is not very stable, there is no ups and downs? If the occurrence of ups and downs of the situation you should pay attention to the chatter, is not your chain quantity is not controlled, or because of your soft text of a large number of reproduced and caused it? The unstable growth of the outer chain is especially important for a new station, My own blog-zero07.cn, originally also did not prepare to do rankings, recently want to do a test, in the home page hung a jinhua SEO label, see how much time can be done through the chain, so in ADMIN5 sent a few soft wen, but because it is a new station, in this before doing less links. A sudden increase in the chain, you guess what happened. Baidu's ranking is lost, but Google's ranking is still possible. Spider tracking through the log to find, Baidu Spider from the previous day 10 times, one more than 100 times. This is a very bad phenomenon.

Third, the spider on each page of the crawl, is not more evenly, or a page to crawl the special diligent. If you catch a certain page of special diligence, is not because you have to do a lot of links to this page, or the page of the article is a large number of reprinted. If not, it's a problem.

Its four, the spider crawls the time distribution of the page, is the overall comparison average, or concentrates in a certain time period? If 90% time visits are in a time period, you have to consider, you are not a regular daily update of the article and the outside chain. It is a good habit to update articles regularly. But regular hair outside the chain, it is likely to find that the search engine to use the software and so on, there may be down right.

This article address: http://zero07.cn/archives_116.html, reprint please keep. A5 Starter