Robots.txt's detailed writing of the WordPress blog (i)

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Review the recent collection of results, found that the search engine is still included in the March in the test article, and the new page, whether original or false original is not included, a careful check found that the background of the Sitemap plugin has set up problems, has been modified. Then suddenly found that their robots.txt writing seems to have problems.

User: *

Disallow:sitemap:http://www.isongxia.com/sitemap.xml.gz

Use WordPress built blog, use robots.txt file limit search engine crawl part of the directory and files, online such learning post very much. @ The old music of the writing I think is quite good.

The simplest and most rigorous wording

User: *

Disallow:/wp-*

#Allow:/wp-content/uploads/

Disallow:/*.php$

Disallow:/*.inc$

Disallow:/*.js$

Disallow:/*.css$

Disallow:/?s=

Allow all spiders to access, limit the directories and files that start with "WP", restrict crawl. php files,. inc files,. js files,. css files, restrict crawl search results. Disallow:/wp-* will be together with the attachment directory to limit the crawl, if you want to let the search engine crawl the contents of the attachment, the third line of the # Note to remove. Allow is not supported by all search engines.

@ Tangut

User: *

Disallow:/wp-admin

Disallow:/wp-content/plugins

Disallow:/wp-content/themes

Disallow:/wp-includes

Disallow:/?s=

Sitemap:http://www.isongxia.com/sitemap.xml.gz

Allow all search engines to crawl, enumerate the directories that need to be restricted, and limit crawl search results. Contains the Sitemap.xml address (this Viki has a specific description, but the Google Administrator tool prompts you to ' detect an invalid Sitemap reference ' and the validity is disputed).

Robots.txt's detailed writing of the WordPress blog (ii): http://www.isongxia.com/robots-txt-2.html

"Tangut Network Promotion Growth Blog" This article Address: http://www.isongxia.com/robots-txt-1.html (reprint please keep)