How to know the spider's crawling traces in close proximity

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Everyone good, because the time relationship has not written a soft article, today's little hero for everyone to bring IIS Log analysis, and HTTP status of the basic explanation, as an SEO operator, he must be a data analyst, why so said, because through the analysis of these data, We can very clearly know our website exactly there is a problem, and then through these data analysis, summed up the solution to the problem, then today, Xiao Jie I teach you how to analyze IIS log.

The purpose of the IIS log

The use of IIS logs, in fact, is able to observe the search engine spiders to our site crawl situation, you can more closely analyze and contact the spider. Crawl times, crawl time points, climb the peak, crawl the reaction of the HTTP status code, to bring us a clear analysis convenience.

II. Analysis of IIS logs

We can read the spider crawling through the image above.

1, 123.125.71.113 (a visitor's IP)

2, [28/sep/2010:07:15:11-0700] (Time and port)

3, get/wangzhan-youhua/maowenben.html (visited the page)

4 12864 (HTTP status Code 200, page download 12864 bytes)

5, "baiduspider+ (+http://www.baidu.com/search/spider.htm)" (Baidu Spider)

HTTP Basic Status Code

200: The request has been completed, Spider access page normal

301: Moved, permanent redirect

302: Temporary redirection

304: Spider crawl after found that the page has not been modified

305: Using the agent

400: Request Error

404: Page Not Found

So we can get a complete word through the above analysis, there is an IP from 123.125.71.113 visitors, is Baiduspider, on September 28, 2010 7:15 11 seconds, through 0700 ports, successfully visited the Wangzhan-youhua /maowenben.html this page, Access downloaded 12,864 bytes.

This is my SEO operation in some of the experience, and share with you, Hangzhou seo (www.gdwzjs.com) More SEO operation methods to share, reprint please keep this link! Contact Us qq:595976867