I have a few sites since the replacement of a separate IP space, one of the stations Google included has changed, but the same IP and several other stations are also included in good. Check out the log of the station, there are several records about Google crawlers are as follows:
[30/apr/2013:11:10:42 +0800] "Get/robots.txt http/1.0" 404 208 "-" "mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html) "203.208.60.116
[30/apr/2013:11:10:42 +0800] "get/http/1.0" 51140 "-" "samsung-sgh-e250/1.0 profile/midp-2.0 configuration/cldc-1.1 up. Browser/6.2.3.3.c.1.101 (GUI) mmp/2.0 (compatible; googlebot-mobile/2.1; +http://www.google.com/bot.html) "188.40.120.19
[30/apr/2013:11:45:36 +0800] "get/http/1.0" 51140 "-" "docomo/2.0 n905i (c100; TB; W24H16) (compatible; googlebot-mobile/2.1; +http://www.google.com/bot.html) "123.125.71.57
[01/may/2013:14:03:10 +0800] "get/http/1.0" 51140 "-" "mozilla/5.0 (Windows NT 6.1; rv:6.0) gecko/20110814 firefox/6.0 Google (+https://developers.google.com/+/web/snippet/) "66.249.84.57
[01/may/2013:14:03:11 +0800] "Get/favicon.ico http/1.0" 404 209 "-" "mozilla/5.0 (Windows NT 6.1; rv:6.0) gecko/20110814 firefox/6.0 Google (+https://developers.google.com/+/web/snippet/) "118.183.211.245
[01/may/2013:15:48:35 +0800] "Get/robots.txt http/1.0" 404 208 "-" "mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html) "203.208.60.117
[01/may/2013:15:48:36 +0800] "get/http/1.0" 51140 "-" "mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html) "61.135.190.103
I ask Tongren, above the frequent occurrence of 200 51140 what is the meaning, is not caused by the reasons for not included, please click to pull out.
Reply to discussion (solution)
Also, ask, what is the response code of Google crawler?
Make a robots.txt and put it in the root directory
Specific format has not been studied, but many SEO articles have said this, not difficult to find
200 is the HTTP status code, which indicates normal return
51140 don't know, look at yourself. Description of the format of the server log (bytes?) ）
