Instance parsing how server logs are parsed

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Web server log analysis for a site has a relatively important role, through the analysis of the log, we can know the search engine crawling record, which is conducive to our search engine habits to exchange. So, today we take the SEO tutorial network as an example, tell you how to analyze the website log:

1. Where are we going to find the server log?

Generally we use the virtual machine will have server logs, mostly in the logs folder, if your space is not, then please contact your space service provider, he will solve for you.

Instance screenshot:

2, check the server log yourself

For the log is not large enough, we can see through the general text editor, because the log is so big, but, for some large sites, search engine crawling very frequent site, its log is very large, we have to use the software to view the back.

We use text to open the server log, then we will see a lot of records, here, I explain how to understand these "astronomy"!

Examples: 66.249.68.143–-[29/jun/2011:00:30:29 +0800] "get/seoshichang/http/1.1″200 7926"-"" mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html) "

The first item of information is the address of the remote host.

The second item in the log record is the time of the request. The last example log record indicates that the request was 00:30:29 June 29, 2011. The last "+0800″" of the time information indicates that the time zone in which the server is located is 8 hours after UTC.

The third item of logging is the most useful information in the entire log, which tells us what kind of request the server received, and in the example above, the visitor requests access to the "/seoshichang/" page.

In the example above, method is get, other frequently possible method is post and head, and there are many possible legal method, but this is mainly the three kinds.

Kyoto is usually HTTP, followed by the version number.

The fourth item in the log record is the status code, and if 200 indicates the request succeeds, and if the 300 start is a redirection, reality 400 indicates an error.

Item fifth of the log record represents the total number of bytes sent to the client.

The sixth item in the log record is your page visitor, in the example of Google Spider, and of course, Baidu Spider and Yahoo Spider and so on.

This line means June 29, 2011 Zero 30 minutes 29, IP for 66.249.68.143 google search engine spider (Googlebot) visited the/seoshichang/page, access results for browsing success.

3, view the server log through the software

Here, I recommend that I use the card home spider crawling Log analyzer, look at the effect:

The software to Baidu Antecedents, Google antecedents, Yahoo antecedents and so did a classification, and can see the normal, error, cache, 301 redirect data, efficiency than manual view is obviously much higher, but also accurate a lot, is not very good?

Hope that the text to the vast number of SEO friends can help, this article from the SEO Tutorial network, the original address: http://www.seoker.org/fu-wu-qi-ri-zhi/

Welcome reprint, Reprint please keep the link, thank you!