How to judge whether Baiduspider is true or false

Source: Internet
Author: User
Tags nslookup nslookup command

A small number of spider impersonates Baiduspider on the Chinese Internet to Capture webpages. At the madcon conference on Saturday, many people found that they did not know how to judge whether Baiduspider is true or false. I would like to explain it again:

On the Chinese Internet, the hostname of the Baiduspider ip address is named in * .baidu.com format. If not * .baidu.com, the hostname is impersonate. We recommend that you use DNS lookup to determine whether the source ip address belongs to Baidu.

For example, on linux, you can use the host ip command to reverse the ip address to determine whether the ip address is captured by Baiduspider.
$ Host 123.125.66.120
120.66.125.123.in-addr. arpa domain name pointer
Baiduspider-123-125-66-120.crawl.baidu.com.

On windows, you can use the nslookup command to reverse the ip address to determine whether the ip address is captured by Baiduspider.

Click "start"-"run"-"cmd"-"enter nslookup IP address"-"enter"
C: Documents and Settingswangtao> nslookup 123.125.66.120

Name: baiduspider-123-125-66-120.crawl.baidu.com
Address: 123.125.66.120

For details, see:
Http://www.baidu.com/search/spider_chinese.html

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.