The influence of site map on search engine crawler

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Like many people, I always fall into some good or bad habits. In the Web site for a customer to do promotion, I habitually created a site map and submitted to the search engine, and then I think: whether the site map can really affect the search engine crawler?

I created a blog for me with WordPress and through the "Google XML Sitemaps Generator" site Map Plug-ins, and Tracking server traffic records allow. Here you may not know Google site map to create Plug-ins, it is actually when you early WordPress Create or modify the article when it can help you build a site map and submit to the search engine.

My clients posted a lot of new articles on their blogs, usually 2 to 3 a week. By observing the records, I found that submitting sitemap to Google and Yahoo could reduce the time of Google Crawler's login and index pages. The structure is amazing! When a sitemap is submitted to a search engine, Google's crawler evaluates the new article page 14 minutes after the average time, and Yahoo has reassessed it after an average of 245 minutes. When Sitemap is not submitted, search engine crawler crawls to new article Google takes 1375 minutes and Yahoo needs 1773 minutes. This average time calculation comes from my 12 newly published articles, 6 of which are submitted by site maps and 6 are not submitted for monitoring.

By data calculation, I think I made a mistake. So I went back to my site and quickly set up a site map for the latest post to be submitted to Google and Yahoo. I checked log discovery: 30 minutes later, Google's crawler has arrived and indexed the newly published article. Yahoo is a little slower than Google.

And for the site without site map crawler tracking, I found the structure of the site and cause the search engine crawler can not quickly find new articles. When I checked the site and tracked the crawlability of other pages, I found no problem. But I found that when the link pointed to the new article page, the crawler was estimated, but there was no index rebuild at the end.

To that end, I worked hard to find the answers and finally found the "My Advice on Google sitemaps-verify" published by Rand ' s, but Don ' t submit[my advice on Google's Sitemap: "Certification but don't submit]", which makes us very embarrassed. When I reread this article, I found he was more concerned with the search engine crawler. Using WordPress and making my Site structure more crawlable, why not submit a sitemap?

Through this experiment we know that the site does not have a natural crawler problem, so I suggest the webmaster to search engine your site map (sitemap), because it can guide the search engine and accelerate the crawler's follow-up and build the speed of indexing. However, if your site has structural integrity issues, do not guarantee that your link structure is correct, I suggest you do not submit sitemap. This will help you decide whether to submit the question. For those with a huge link structure, why not create a site map submitted to Google or Yahoo to help search engines faster and better to include your site?

This article is translated from: Http://www.seomoz.org/blog/do-sitemaps-effect-crawlers

First release: http://www.wegoing.cn [had] a limited level, but also please reprint please specify the source!