How to identify Baiduspider

Last week, Baidu Webmaster platform received a webmaster help, said mistakenly banned baiduspider IP, asked if there is a way to get baiduspider all IP, intend to put white list to protect To prevent another false seal. In this to tell you webmaster , baiduspider IP Pool is constantly changing, we can not provide IP complete.

In addition, before the webmaster sent to question that Baiduspider patronize too often, has surpassed the server to withstand capacity. and Baidu Webmaster platform Trace found thatbaiduspider to the site crawl and no exception, the spider is very likely to be a Li ghost.

So, how can the webmaster through the IP to determine whether this spider is from Baidu search engine?

can be done by DNS Counter-check method to resolve this problem. Depending on the platform, different verification methods, such as Linux/windows/os three platforms under the verification method are as follows:

1, under the Linux platform, you can use the host IP command to reverse IP to determine whether the crawl from Baiduspider. The hostname of Baiduspider is named *.baidu.com or *.baidu.jp, and non-*.baidu.com or *.baidu.jp is impersonation.

2, under the Windows platform or IBM OS/2 platform, you can use the nslookup IP command to reverse the IP to determine whether the crawl from Baiduspider. Open command Processor Input nslookup xxx.xxx.xxx.xxx (IP address) can resolve IP, to determine whether from Baiduspider crawl, baiduspider hostname to *.baidu.com or *.baidu.jp The format is named, non-*.baidu.com or *.baidu.jp is impersonation.

3, under Mac OS platform, you can use the dig command to reverse IP to determine whether the crawl from Baiduspider. Open command Processor input dig xxx.xxx.xxx.xxx (IP address) can resolve IP, to determine whether from Baiduspider crawl, baiduspider hostname in *.baidu.com or *.baidu.jp format named , non-*.baidu.com or *.baidu.jp is impersonation.

How to identify Baiduspider