Arrogant personal webmaster: Say no to search engines

Intermediary transaction http://www.aliyun.com/zixun/aggregation/6858.html ">seo diagnose Taobao guest cloud host technology Hall

For search engines, very few pioneers on search engine spiders say no, this is the most familiar is "Taobao shielding Baidu Spider", there are some dating sites shielding search engine spiders, and personal webmaster, to search engine said is not difficult, more webmaster will serve as a guest, and I, a personal webmaster, IP less than 1000IP, why also so arrogant, unexpectedly to search engine say no, sirs reader, listen to me slowly way.

Today is a happy day, get up first thing, turn on the computer, on the 51yes.com view the website traffic, a look, extremely.

In the heart of this cool ah, flow surge ah, wait happy, flow up, I am sure to understand the flow from where, do not see do not know, a look startled.

At that time the heart is cold a section, this can be all garbage flow ah, for the use of space I, this is not a good thing, the only way: Seal! Garbage flow, I want to say no to you!

So immediately rewrite Robot.txt prohibit MSN Spider Access

Here, especially want to remind the masses seriously do station, pockets and not how much silver webmaster, must seriously look at the garbage flow, those will not bring you any benefits, will only give you additional burden, and then read the data Access report when the vanity!

With a common search engine spider name:

Google Spider: Googlebot

Baidu Spider: Baiduspider

Yahoo Spider: Yahoo slurp

MSN Spider: Msnbot

AltaVista Spider: Scooter

Lycos Spider: Lycos_spider_ (Rex)

AllTheWeb Spider: fast-webcrawler/

Inktomi Spider: slurp