The relationship between the crawling amount and the amount of spider robot in Baidu

We must all know, Baidu Spider robot to crawl your site number, far greater than the amount of collection, then what is the relationship between them, today we will talk about.

I. Preliminary period

At this point in my preliminary period, refers to the Web site opened to the one weeks after the submission of Baidu, in this one-week, Baidu Spider machine People's activities are such, first of all, Baidu robot will crawl to submit the homepage of the site, and then after a while, based on its analysis of the results, It may be a day or a few minutes after the time to crawl the other pages on your home page. Of course, at this stage, the robot Crawling home page number will be very few, there may be only a few times a day crawling home page, mainly because you have a lot of links on the site, it has to climb one one. The robot's crawling amount is much larger than the amount that Baidu puts out.

Two. Stable period

Baidu is crawling your site about the same time, we are called stable period, this depends on your site to determine, sometimes a new site may enter this stage in one weeks, sometimes one months. This stage, Baidu Spider Robot crawling home page number will have a significant increase, such as your site in the first phase of the robot crawling home number of 5 times a day, then at this stage may be 10--50 times. Why the number of crawling home page to increase, that is because you update the site, basically all the updated content will be reflected in the home page, of course, Baidu will be from the homepage entrance. At this stage, the robot crawl volume is generally more than 10 times times the amount of, of course, you have to subtract the number of crawling home calculation.

Three. Maturity

Baidu once put your site into maturity, your site want to include a large amount of changes, basically is impossible, because at this stage, the Baidu robot will crawl you update the page, for did not update the original page, basically is not crawling, the robot does not crawl, you think it will also have included. According to different websites, mature Baidu robot Crawl home page proportion, basically accounted for all the crawling amount of more than one-fifth, included the amount is basically to remove the first page crawl amount of more than one-sixth. So at this stage when we update the content of the site, we must let the updated content of the first page, updated a little more, so that every time spider robots have new content crawling.