Web logs can be a good record of visitors and spiders visit, through the site log can be a good understanding of some of the situation of the site, which is why many SEO will go to analyze the reasons for the site log, but the analysis of the site log people do not necessarily fully understand the site log, below I will talk about the secret of the website log.
Analysis of the Web log of course, the Site Log Analyzer, of course, many people use the free Web Log analyzer, but the site Log Analyzer to analyze the things are very limited, so many site information has been hidden, I will be the kind of paid Web Log Analyzer to explain.
Everyone through the ordinary Log analyzer is usually to see if there are no spiders, what spiders, access times, access to what the page, the number of visits and the status of the return code, as shown in Figure 1, and more professional log analyzer to know how many times the spider, but also know the total length of the spider stay, the total amount of capture, as shown in Figure 2,
Through the formula to get the spider each time to crawl the number of pages = total catch amount/spider to the times, in order to know the depth of spiders crawl, is not the site structure is too deep, crawl depth is not high, will cause many layers of very deep pages will not be crawled to, as well as a few pages are repeatedly in the crawl, wasting the time of the reptile. In this way, many sites want to be included in Baidu is a problem.
Through the formula to get spider per page dwell time = Spider total stay time/Total crawl amount, thus know the page load speed and is the server response speed about what situation, is not to optimize the page code and optimize hardware facilities. We all know that Web page loading speed is also related to the site rankings.
Also told everyone a secret, some spiders to visit the site is not with user-agent, like the Emperor Kangxi Incognito, the purpose is what, we think of it, but how to judge the IP is the spider, we can tracertip address to know what is the spider.
Okay, today is the end of it, hope can help everyone, this article by the http://www.hzht007.com Webmaster, reproduced please keep, do not like yesterday's article "from the website traffic statistics caused by the promotion of reflection" was reproduced n many, and changed the connection, be sure to please respect the copyright.