Robots.txt's detailed writing of the WordPress blog (i)

Source: Internet
Author: User
Keywords WordPress

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Review the recent collection of results, found that the search engine is still included in the March in the test article, and the new page, whether original or false original is not included, a careful check found that the background of the Sitemap plugin has set up problems, has been modified. Then suddenly found that their robots.txt writing seems to have problems.

User: *

Disallow:sitemap:http://www.isongxia.com/sitemap.xml.gz

Use WordPress built blog, use robots.txt file limit search engine crawl part of the directory and files, online such learning post very much. @ The old music of the writing I think is quite good.

The simplest and most rigorous wording

User: *

Disallow:/wp-*

#Allow:/wp-content/uploads/

Disallow:/*.php$

Disallow:/*.inc$

Disallow:/*.js$

Disallow:/*.css$

Disallow:/?s=

Allow all spiders to access, limit the directories and files that start with "WP", restrict crawl. php files,. inc files,. js files,. css files, restrict crawl search results. Disallow:/wp-* will be together with the attachment directory to limit the crawl, if you want to let the search engine crawl the contents of the attachment, the third line of the # Note to remove. Allow is not supported by all search engines.

@ Tangut

User: *

Disallow:/wp-admin

Disallow:/wp-content/plugins

Disallow:/wp-content/themes

Disallow:/wp-includes

Disallow:/?s=

Sitemap:http://www.isongxia.com/sitemap.xml.gz

Allow all search engines to crawl, enumerate the directories that need to be restricted, and limit crawl search results. Contains the Sitemap.xml address (this Viki has a specific description, but the Google Administrator tool prompts you to ' detect an invalid Sitemap reference ' and the validity is disputed).

Robots.txt's detailed writing of the WordPress blog (ii): http://www.isongxia.com/robots-txt-2.html

"Tangut Network Promotion Growth Blog" This article Address: http://www.isongxia.com/robots-txt-1.html (reprint please keep)

Related Article

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.