Four factors affecting spider crawling content

Source: Internet
Author: User
Keywords Impact crawl

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

The site is good or not with spider crawling frequent times, crawling page about is well-known, but for spiders crawl which pages we do not know, then we can only rely on spiders crawl through the log of access to analysis. From the log we can analyze a lot of data, then today the author mainly to explain the impact of spider crawling factors and crawling time, do not underestimate this log, it can help you know that the site for spiders, is not meant to be friendly state, spiders like their own station, if crawling a large number of words, Then you can simply get the Web site is very close to the appetite of spiders, if spiders do not come for a few days, then we have to check, is not the site is not the spider like "food", the following is said to affect the grasp of the relevant points:

Spider crawl factor One, whether there is a site map

Site map for spiders is a crawling 17895.html "> Road map, when the spider has this road map, then crawling on the Web site will not be so hard, and there will be no time to turn to the feeling of dizziness." The site map is specifically for spiders, the goal is to reduce the spider crawl time, speed up the spider crawling speed, after all, if your site does not match the map, like to go to a strange place, there is no map, we must rely on blind looking for, this will take more time, I do not know. So, the same reason, site map for spiders are also important, the province does not save the map, he is the preparation of the pre-war, the direction of war, the postwar summary.

Influence spider crawl factor two, whether set 404 page

A lot of sites for this does not mean, in fact, according to the author's actual combat experience, this is a dead chain of the site has a very important significance, because he can help the site to tell spiders, when it climbed to a corner, give him a way out of the road, 404 pages is to avoid spiders into a dead end out of the prepared, Who dares to guarantee that their website will not have a dead chain of appearance, dead chain for a site's impact is very important, if the site's death chain too much, and the lack of 404 pages, then use webmaster Tools query Analysis, you will find that many of the pages are crawling errors, this on the one hand, the Web site on the friendliness of spiders is not enough, Let spiders have the mentality of rejection. Therefore, 404 pages must give the site to a previous, anyway, does not occupy much space, why not do it?

Spider crawl factor Three, whether or not to export too many links

A site too many export links to the site's weight concentration has a great impact, for the duration of the spider's stay there is a great urge, because when spiders crawl your site, generally are from the end of the climb, then the spider crawling is sometimes by the breadth of crawling method, sometimes according to the depth ranking method, when it according to breadth ranking method, Just climbed to the tail and has not entered the inner page, you will give him an export link, then the spider will also follow its export link out, so that you often see the spider came, but did not include any of the reasons for the page. So, the site does not set too many export links, he gives you the site without any interest.

Influence Spider crawl factor four, whether import chain take over less

Relative export links, the more the import links the better. Import links Follow two principles: extensive and quality. There is quality first, so, we build the import link, we should first pay attention to the quality of the import link, and then the pursuit of quantity. If you upside down, then not only can not let the site to the search best friend good, but also let the site in search for the eyes of the point of subtraction. Because of your pursuit of quantity, usually forget the quality, resulting in too much junk chain, invalid links. Therefore, the most exquisite import link is the quality and wide, only a good combination of both, in order to let the site ranking weight brush to rise.

Through the analysis of the site to search the friendly degree to sum up the above four points, these four points is the author's experience, hope can help you more or less to understand the site. Then make their own site included better, more weight, snapshot update, ranking more cattle. This article by http://www.yisoo.org (a search cinema) exclusive feeds, reprint please leave the link, thanks!

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.