How to make and use Sitemap.xml, robots.txt

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Disclaimer: This article only for the rookie level just entered the SEO, Big Bird please fly over. First we look at how spiders crawl to our site. The general spider to our site, it will first see if there is no sitmap.xml this file, and then see if there is no robots.txt this file. If there is a sitemap.xml, then look at robots.txt this file gives those crawling permission, and then along the map of the route to crawl. If neither of the two texts, the spider will be aimlessly disorderly dozen, see these two files for search engine is how important.

So what is the site map? What is the role, why do you want to do site map? This may be the biggest problem that bothers seoer just into the SEO industry. First of all, we look at the site map, the site map as the name suggests is a map, its role and our usual map is the same, but this map is to search engines to see, with the site map search engine spiders will not be in your site rambling crawl, is conducive to the search engine's collection.

About the production of site map is actually very simple, here is an online generated URL http://www.xml-sitemaps.com can generate 500 free URLs, if you want to generate a complete, need to pay, for a small station, first included 500 pages is also a good idea, The build speed is a bit slow, you have to wait patiently. can also be used online to generate Yahoo's urllist.txt, but Yahoo is also a sitemap member, so personally feel that there is a sitemap.xml file is enough. Of course there are other online generation tools, and offline generation tools that can be searched online.

When an. xml file is generated online, it is then downloaded and submitted to the Google sitemap site as: https://www.google.com/webmasters/sitemaps/. But you need to have a Google account, you can register a, you can also submit after a period of time to check if there are errors.

Download online generated urllist.txt file submitted to Yahoo, the Web site is: http://submit.search.yahoo.com/free/request convenient Yahoo included your site, of course, you also need to have Yahoo account.

In addition, there is a sitemap, you need to have a robots.txt to the door. So what's robots.txt? This is a file that assigns permissions to spiders crawling along sitemap sites. Tell spiders those who can crawl, those who can not crawl. In addition Baidu can not directly support Sitemap How to do? Then we will tell Baidu Spider in robots.txt, where is your sitemap. Add such a code to the robots.txt. sitemap:http://www.xxxxxx.com/root directory/sitemap.xml. This sentence is tantamount to telling Baidu Spider my sitemap file in the root directory of the site.

Another point is that Sitemap.xml and robots.txt these two files should be placed in the root directory, and the robots this file can only be a plain text file, the suffix is. txt. If reproduced, please retain the author and source, thank you! qq:32092216 welcome exchanges and study together!