An unexpected reason affected our station's collection

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Weak weak ask, why do I send articles can not change line? And a friend spent one months to do a health side of the station, after the online to find someone to add content, a week after Baidu and Google have submitted, the results of the next day are included. More than 100 Baidu, more than 1000 Google, everything is OK. But the next week to find the problem, see one weeks passed, Baidu no longer update snapshots, two weeks, or not update, the content of our daily add, add a lot, should be original. But Google has been updating and is fast. Outside the chain is also added, afraid of a sudden increase in the rate of two or three per day, although in the Baidu domain out of something not a few. In the days that followed, I tried to find out on the Internet why it was so, and there was no clear statement, most of which was that we might be cheating, but we didn't. In this period, I also look at the log of Apache, found that Baidu only came home and a few other simple inside pages, there is no continue to go inside. Let me say the rules of Baidu crawling our site:

1. Every one hours or so come once, almost only to climb the home page.

2. Every time I came, I climbed the robots.txt. The problem is in this robots.txt, because in the Web site one weeks after, that is, after Baidu included us, we did urlrewrite for the site, that is, added a. htaccess file. The site is PHP, with a framework, in the htaccess file, there is such a rule, that is, if found no files, redirect to a page we have written, the intention is friendly to prompt the user This page does not exist. However, the rules used in the robots.txt on the issue, Baidu tried to take robots.txt, not return the format he expected, but our error page. This is the root of the problem, Baidu must think we do not want him to crawl our site, so no longer climb down.

So, I went to Baidu downloaded a standard robots.txt file, placed in the root directory, tested for a moment can download, OK. Yes, it's already 12 o'clock in the evening. No matter, sleep. The next morning, site:www.***.com,o I Lady Ga ga, updated, and more to celebrate, in the next more than 20 hours, each site can receive a different number of, of course, not necessarily is increased, but the overall is increased, The highest time has more than 1000.

This is what I want to write this time, I hope everyone in the writing URL rewrite, do not ignore the robots.txt. You reader, you now site:www.shenghuo56.com has not so much, because there is an unexpected problem behind the collection and ranking of the decline, is also worth summing up, have time to write Kazakhstan.