Familiar with spiders two crawl ways to adjust the layout of the site

The recent period of time Baidu on the implementation of anti-spam page is increasing this makes many site rankings are subject to large fluctuations, of course, the author station is no exception, But the fish always understand a little bit. Search engine constantly adjusts the algorithm itself is to conform to the user experience this also shows that as long as we stand in the user's point of view to run their own station then the site's ranking is naturally not bad. Today, the author for the site included this piece to share the familiar spiders crawl two ways to change the layout of the site structure.

Site collection for many friends has been a question, in addition to what we usually say the Sitemap production there is a point is not small but that is the level of the site layout, why say so? The following author on the Spider's two ways to crawl for you one by one said:

Usually we see the Baidu Spider and Google robots are through the depth of priority and width first way to crawl, here in order to make it easier for everyone to understand the author's small station to illustrate.

　　First, depth priority all over the crawl

Depth first crawl is similar to my road-sweeper station, Home > Products > Road Sweeper Series, the preferred crawl is in such a way to crawl, wait until the capture of these columns, in the grasp of the "Road Sweeper Series" column under the article, this is the depth of priority strategy, similar to family relations. The eldest son, the second son, and then grandson such relations.

　Second, is the width of priority over the crawl

This way of crawling, the depth is constantly increasing. Similar to this "Home > Company profile > Product > Product price > Company profile ..." Crawler to your site, will follow a column level down crawl, and so this "company profile" under the column is crawled, in the next column. Such a width crawl is a certain reason, based on the site layout problem, is often important page distance from the seed site (the seed site is the beginning of crawling crawler) is relatively close, so in line with the habit.

So, you can see a large portal site, the easiest thing to see is some real news, which is the closer you get to a seed site, the more important it is; second, the depth of the Chinese web is not as deep as we thought, and reaching a Web page path is more than just one, so the crawler always finds the nearest path to the current page. , according to the relevant data to show the depth of the Chinese web 17; There is another point, the cooperative strategy of multiple reptiles, based on this rule most of the crawl of the starting page for the station, gradually will turn to the outside of the link, grasping the closeness is relatively strong.

Based on the two methods mentioned above, it is not difficult to see Web site to as much as possible to save crawler crawl time, because the crawler to your site time is certain, shorten its single page crawl time will improve your site's crawl volume, which will affect your site's collection, and ultimately can affect your site's SEO traffic. According to the above two ways, to reasonable layout of the content of your site, so that reptiles can easily crawl to what you want to be crawled, so reasonable layout of the content, so that the site's SEO traffic has a breakthrough bottleneck of the upgrade. This article by Hubei Cheng Li Group http://www.clczzc.com original release, reprint please specify the source!