Robots.txt Block index 15 days after the performance of each search engine

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Last October when I did a women's website, because the income is not good, so decided to scrap used to do a blog diary, by the way to do an experiment to see the performance of the mainstream search engines. The main purpose of this article is to look at the long-standing dispute of the robots protocol in the major search engine weight, the right to entertainment. The concrete operation process is this, the revision day begins to add the following statement in Robots.txt:

User: *

Disallow:/

The revision did not replace the program, ASP language Zblog program, just replaced a set of templates, home, category, article page layout has a big difference, new several new categories, and then delete the server static article directory. After is to maintain a pure original frequency update content, after 15 days, through the site command query to get the performance of the search engines, as follows:

1. Google search engine

Here are some of the information I've observed:

Included in the page changes are particularly slow, more than 3,000 included, there are more than 1600. Home address also, but does not display description information, only prompts "because of the robots.txt of this site, the system does not provide a description of the results." No new content included.

2, Baidu search engine

Here are some of the information I've observed:

Baidu response is also relatively slow. Originally included 40 pages, now there are 10 pages, the home has gone, the snapshot is gone. No new content is included.

3, 360 Comprehensive search

Here are some of the information I've observed:

No changes within the page, included has been maintained in more than 500 pages, only the first snapshot of the updated timely, keep the next day snapshot, no new content included.

4, Sogou Search

Here are some of the information I've observed:

Included in the page has been deleted, only one home. The snapshot update is slow and the title is not updated. No inner pages included.

5, Soso Search

Here are some of the information I've observed:

Included no big changes, home snapshot update timely, and a small amount of included in the page. Combined with the above information, the performance of the search engines are very different.

Google, Baidu two big giants although said to comply with the robots.txt agreement, but in the deletion has included content is still relatively slow, can be said to be slow. The new content is no longer included according to the robots agreement. 360 Comprehensive search and Soso search is a little bird what the protocol, the old included did not delete, snapshots or so updated timely, occasionally also included points new content. Sogou incredibly reacted strongly, deleted the inside page, stopped the snapshot, seems to most comply with robots.txt agreement, a little funny.

This article by [has goods street] original, address: http://www.yohojie.com/post/312.html. Welcome to the Exchange