How much the impact of robots.txt on a website

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Hello everyone, I am jrasy, just have an article accurate introduction I engaged in SEO industry for 4 years of all the experience, Finally, a special mention of a question about robots.txt, no matter how much the impact of this document on a website, I personally feel that I need to first tell the person interested in this file, how to write this document.

Robots.txt is very simple and very simple. Some people do not understand what the robots are, what is the use?

Robots is a must be placed in the site root directory, let search spiders read TXT file, filename must be lowercase "robots.txt". Through the robots.txt can control se included content, tell spiders which files and directories can be included, which cannot be included.

In this note, if you add this file to the site directory, the search engine will think you are a more formal standard station.

Search engines will make a good impression on you, my forum has a robots file, there is a senior once told me that the Web site will have an impact on the keywords, the specific also did not say too clearly, such as I give my students to do a tutorial with a website, the file is the program is the original, Also did not find any problems, let alone what impact on the key words, cut into the whole, how to write a document!

Use a few of the most common cases to illustrate directly:

1. Allow all se to be included in this site: robots.txt is empty, do not write anything.

2. To prohibit certain catalogues of all SE included websites:

User: *

Disallow:/directory Name 1/

Disallow:/directory Name 2/

Disallow:/directory Name 3/

3. Prohibit a certain SE included in this site, such as the prohibition of Baidu:

User-agent:baiduspider

Disallow:/

4. Prohibit all SE included in this site:

User: *

Disallow:/

5. Add Sitemap.xml path.

How big is the potential of a robots? Jrasy have time to talk to you again,

Reprint Please specify, this question is transferred from the Red Guest Home forum www.52hack.com