The first lesson of website optimization understand how spiders work

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

As a website optimization practitioners, unexpectedly do not understand how spiders work, such optimization, is certainly less than the effort, understanding spiders should be the site to optimize the practitioner's first class.

At the weekend, at a company invitation, to give them to do search engine optimization (SEO) related training, as well as the improvement of skill effect. That is the last thing I want to see, their SEO staff work on a daily basis also stay in the false original and hair outside the chain two stages. I looked at their optimization effect, domain-related fields reached more than 10,000, but the final effect is very unsatisfactory. After I read it, I thought it was too expensive to do.

Here a lot of SEO experts know the chain and content. These are not used to share with us, today only talk about spiders. Because, this is I to give their company training when found a very serious problem: they have heard of spiders, know what spiders are, but do not know how spiders work.

A, spider's antecedents have what, it is how to your website

In general, spiders can reach your site in three ways, respectively, are mainly submitted to the site, through the connection to other sites to your site, there are certain rules of free action.

Many people have said that spiders are very intelligent now do not have to submit the site, in fact, is wrong, because you posted on other sites outside the chain of spiders. Both of these forms are operable, the last of which is special, and we usually think that spiders will scan the domain name in the same way as 1-0,a-z and then go to the Web site.

Second, the greatest degree of use of your robots, this is the Web portal

According to conventional parlance, the robots file is to limit the spider's activities in your site, better protect the rights and privacy of the site owner. This is the first thing to do when a spider arrives at a website, and if a Web site doesn't have the file, the spider thinks that all of the content can be mined.

In a robots file, only the Prohibition (Disallow) is generally used. In fact, you can also use the recommended permission (Allow). A site has a lot of dark corner spiders can not crawl to, at this time, you can use Allow to guide the spider, you can do some more map pages, let spiders in the above activities.

Also some people say, why use allow, direct use Sitemap is not OK. We all know, in fact, we value the Sitemap, Google is completely no problem, and Baidu Spiders understand that there is a certain problem, not very good play his role.

Third, the spider in a Web site (domain) activity mode

I believe we have seen Baidu gave the "Search Engine Optimization Guide," The Zhengzhou network technology recommendations did not see the SEO are looking to see, he mentioned above his more recommended URL way, tree-shaped and flat. All you know is that it helps optimize, but you don't know why.

Spiders follow two principles, breadth and depth in a particular domain. In which we think breadth first, spiders generally do not crawl in a particular domain in depth too much. The spider will be in a page to complete the time to enter the next information rich in the chain of pages. Makes the channel page and the list page, can let the spider to crawl a website more smoothly.

In fact, not necessarily to make a website domain/url_a/this form, it can be domain/url_a.html as long as your page richness and the same as the previous line. The richness here is not the content, but the inner chain.

The spider's authority in a website equates to an ordinary unregistered member

This simple mention, the spider is equivalent to a website of unregistered members, his permission is this, if your site is not registered members open, or set the privacy permissions, only for members of friends, or anything else, then spiders can not crawl to your content.

This is also, outside the chain release to achieve diversity is one of the important reasons for spiders from more different angles to understand your site. This article by the Zhengzhou Network Science and Technology website Construction Department (http://www.ezhiqi.com/?list-1169.html) original, reprint please reserve, Zhengzhou Intellectual Kai Network technology hopes to help more enterprises and individuals in Zhengzhou to understand the Internet, using the Internet, on the Internet to grow and develop.