"Er mao seo Tutorial" sixth lesson: SEO Concepts-404 pages, sitemap, 301 redirect Role and considerations

robots.txt the concept, characteristics and wording of the document

1. concept:robots.txt is one of the simplest. txt files that tell the search engine which pages/folders can be indexed and which are not allowed to be included (crawling).

tip:/admin/ refuses to recommend

Search engine The first step to see is the site of the robots.txt

where to put the file: FTP Server-Web site root directory

Interspersed with small doubts: the site is particularly poor, why poor? The reason is unknown!

Recommended Solution: Site Map +robots.txt combined use.

Recommended reading:http://blog.csdn.net/yzdzhouxiong/article/details/45602173

2. robots.txt notation:

User name: *

1 ) User-agent: * --wildcard character (for all search engines)

disallow:/ --Negative prefix

User-agent: *

Allow:/

2 ) User-agent:baiduspider --Spider name (website log)

Disallow:/

User-agent:googlebot --Spider name

Disallow:/

3 ) user-agent: * AB

Allow :  / Catalog 1/ directory 2.html (Allow access to the page in Directory 2)

Disallow:  / Table of Contents 1/

4 ) user-agent: * A invite B to a home to play

Disallow:/a/ Offend B

Allow :/ Catalog 1/ directory 2.html (Allow access to the page in Directory 2)

Disallow:/?* not to crawl? The beginning of a page or a folder

Disallow:/*?* do not crawl dynamic pages within the site

Baidu Official guide inside, has been explained, dynamic and static pages, are the same included.

Recommended format:

User-agent: *

Disallow:/ Catalogue 1/1.html

Disallow:/ Table of Contents 3/

Disallow:/ Table of Contents 5/

Sitemap:/sitemap.xml ( recommended map)

Sitemap:/sitemap.html ( recommended map)

again: Allow crawling what, please be sure to put in robots.txt before the file.

3. Robots.txt Features:

1 robots.txt file is therefore a TXT file that exists in plain text format.

2 robots.txt must be placed in the root directory of the Web site.

such as: Http://www.domain.com/robots.txt

3 ) uppercase and lowercase. A space number is required after the colon.

4 do not like to be included in what, like included anything can pass this recommendation.

Other basic concepts:

1 , website PV value IP

PV : Refers to the number of pages that a user visits to your site, each time they visit.

IP : Number of independent visitors

2 , search engine bounce rate

Bounce Rate: Users come to your site and only browse a page to leave the percentage.

Thinking: What are the impact on site rankings? The principle of fast-line technology.

3 , where is the site navigation? What role does it have?

Example:http://www.wycszx.com/ Hefei registered company Hefei Company Registration Hefei Company in Hefei Agent Company Registration Promotion keyword Density blend use

http://www.tuniu.com/ Weight 7 The category page promotes weights.

Thinking: How to properly arrange the sub-navigation, can the maximum help the ranking of the site?

Copyright NOTICE: This article for Bo Master original article, without Bo Master permission not reproduced.

"Er mao seo Tutorial" sixth lesson: SEO Concepts-404 pages, sitemap, 301 redirect Role and considerations