How to attract search engine spiders crawl our site

Intermediary transaction SEO diagnosis Taobao guest Cloud host technology Hall

We do SEO optimization work to understand that a website want to get a good ranking in search engines, must be spiders (spider) crawled to collect our web page. Search engine spiders put crawled code into their own database, so we can search the search engine above our site.

Network odd SEO training that SEO optimization of our site to achieve the first step is to attract spiders to crawl our site, search engine spiders crawl to our site, will have traces, will have their own agent name, you webmaster can be in the log file to distinguish which search engine is the spider.

The more common search engine spiders are:

baiduspider+ (+baidu/search/spider.htm:baidu/search/spider.htm)

On behalf of Baidu Spider crawled traces

mozilla/5.0 (compatible; Yahoo! Slurp; http://misc.yahoo.com.cn/help.html)

The traces of Yahoo Chinese spider crawled

mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Traces of Google spiders crawling through

sogou+web+robot+ (+http://www.sogou.com/docs/help/webmasters.htm#07)

Sogou Spider crawled through traces

sosospider+ (+http://help.soso.com/webspider.htm)

Search for traces of spiders crawled

mozilla/5.0 (compatible; yodaobot/1.0; http://www.yodao.com/help/webmaster/spider/; )

There are traces of spiders crawling

You webmaster if you want to attract spiders to crawl we do SEO optimization of the site, it must be to do some work, because spiders can not crawl all the Web site, in fact, the largest search engine has only crawled a collection of small part of the Internet.

If the SEO optimization staff want to own the site more by the search engine, then the network odd SEO training think must have the idea to try to attract the spiders to crawl. Search engines generally crawl the more important pages, we need to meet the requirements of spiders crawl the importance of the rules to satisfy several conditions:

1. Website weight problem, the higher the weight of the Web site spiders will crawl more in-depth, almost every page will crawl, there will be more pages included.

2. The website updates the frequency, the spider will each crawl the website to store up, convenient second crawl, if the second crawl to your optimized site, found that the page has updated, spiders will crawl to your new content, if updated every day, then the spider will also develop habits, every day to crawl your site.

3. Website content quality, high quality, readability of the page, search engine crawl to more easily included, thus included, to our page weight will also be improved. Next time will continue to crawl our site, because search engines like valuable pages, readable pages, statements logical pages.

4. Import links, this is divided into external links and internal links, if the spider to crawl a page, then this page must have to import links, otherwise spiders simply can not know the existence of this page, so high-quality import links, can be a good guide spiders crawl our page.

5. The page has a link on the homepage, in general, we update our website, update the link is best to appear in the home page, because the first page is the highest weight, spiders visit the most, the most frequent is also our home page, if the homepage has updated links, can let the spider faster and better crawl to our updated page, So as to better collect our page.

These 5 points are related to the site you optimize the collection of problems, directly affect your site's SEO optimization effect, so the site SEO training mind everyone is best to do this, and some webmaster said, in the log files found spiders, but the page has not been included.

The reason is very simple, if spiders crawl your site, found that your site has been crawled before the content is too similar, will think that your site is copying or copying other people's content, it is likely will not continue to crawl your site, resulting in spiders, but not your page.

Author: net odd Seo© final revision

From: http://www.seoduan.com/seo-watch/798.html

Reprint please retain the author's source in the above form