Searching for spiders is silly.

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

Search spider is silly, you have to indulge it

Today a webmaster to the author to consult a question, "an old website, Baidu recently only updated home page, not included in the pages, how to do to let Baidu included?"

The author first asked a few webmaster the most easy to commit the problem, the webmaster said no. Then look at this person's site and find that the access speed is slow and the display is slow. Visit very slow probably because of the author network problem, I am lazy to engage in Web site access speed test, not necessary. And the display is very slow because the station put a lot of ads.

This slow reason for the inclusion of the impact is not very large, not included in the page. Look at the structure of the site, page design, content distribution, there is no problem.

Then, the author uses the specialized website analysis software, has analyzed under this website server to the visitor's response way. found that its connection shutdown status "Connection:close" was sent before the data was sent. The author Ping the station, this website actually forbid ping. In other words, the site's response to the search spider is inaccessible. I asked the webmaster, the webmaster said is a peer site webmaster told him, "a lot of hackers through Ping can get a lot of data, so to prohibit ping", so the webmaster is very obedient to set a ban on ping to respond. This webmaster is very "lucky", because it uses the server, rather than virtual space, so have special "privileges." More importantly, the site is still used to 1k1k 1.1 points to send data, increase the number of visitors and the server connection between the times, causing unnecessary burdens to all parties, really do not know who developed the spam site program.

The situation is clear. A web site that does not allow search spiders to visit, how could it be updated and included?

Site is included very simple, do a "six" can be: access speed, response standardization, program general, structure generalization, update regularization, the chain rich. Advice: Search spider is silly, it every day to eat a lot of omnivorous, take into account your special circumstances, so you have to learn to indulge in search spiders, you have to take care of the search spider. The author finally told the webmaster, you'd better 11518.html "> website off, unplug the network cable, so the safest."

The following is a way to prevent ping and the normal response.

No ping site response:

Sent: 433 bytes

Start accepting data

Received: 2048/2048 Bytes

Received: 2048/4096 Bytes

Received: 5152/9248 Bytes

Received: 1440/10688 Bytes

Received: 2880/13568 Bytes

Received: 1440/15008 Bytes

Received: 4923/19931 Bytes

Total Received: 19931 bytes

http/1.1 OK

Connection:close

Date:tue, June 2008 08:19:14 GMT

content-length:19662

Content-type:text/html

Last-modified:fri, June 2008 03:50:35 GMT

Accept-ranges:bytes

ETag: "4c9a8469e3c81:184e"

server:microsoft-iis/6.0

X-powered-by:asp. NET connection shutdown

Included in the normal Web site response:

Sent: 417 bytes

Start accepting data

Received: 41948/41948 Bytes

Total Received: 41948 bytes

http/1.1 OK

content-length:41676

Content-type:text/html

Last-modified:mon, June 2008 14:15:55 GMT

Accept-ranges:bytes

ETag: "14557221bce5c81:3a565"

server:microsoft-iis/6.0

X-powered-by:asp.net

Date:tue, June 2008 08:15:55 GMT

Connection:close Connection shutdown

Wealth third pole Number 1

Wang Jianjan

July 15, 2008