Analysis of QQ space robot file on small details big article

I believe that the QQ space robot file impression is to stay in its shielding Baidu search, Baidu can not crawl the content of QQ space. And recently has an article "Analysis QQ space can do Baidu keyword ranking?" , the article said that the current QQ space content can also be indexed crawl, the reason is Tencent QQ space has been lifted for the search engine robot shielding, this article changed the author of the QQ space robot file views. The author of this interest, so the QQ space of the robot to observe, found the QQ space robot set some small details, as shown in the following figure.

　　

In the above figure we can indeed see the current QQ space has been lifted for the search engine shielding. At present, all search engine spiders can crawl to the QQ space. And in the last line of robot file I found a small detail, the author found that more than one line: Sitemao:http://xxx.xml. Obviously this is a map file. So why QQ space in the last line to write the site map? To know why first we need to learn more about the robot file.

As seoer we should all be very clear the role of the robot file is to tell the search engine spider our site What page is can crawl what page is prohibited to enter. When the search engine spiders enter our site, understand this information, it can be based on information to focus on the page we allow crawling, improve the crawling efficiency of the page. And in this process we have forgotten the key point, that is, the search engine into our site the first contact with the file is what? Yes, Robot file. To this we can at this point on our robot to make the search engine spiders more efficient crawling our site, enhance the site's crawling rate.

We can be very certain that QQ space in the robot file at the end of the site to write the map file is to enhance the search engine for the site crawling rate. When the search engine spiders into the QQ space, first look for robot files, when the robot file can directly find the site map files. So as to promote spiders through the map file on our site for a deeper and extensive crawling and indexing.

For this small detail the author has been in a state of neglect, and as a QQ space such a large site to let this small detail, our site needs more attention, often these small details can create large articles. I hope this article is helpful for everyone.

This article by the giant Towel gourd Water website http://www.siguashui.cc/Original, reprint please retain the source.