What does a robots mean?

Source: Internet
Author: User

What do you mean by a robots?

Robot is an English word, to know more about English friends believe that, robots in the Chinese meaning is a robotic. What we usually mention is the robots protocol, which is also the international default convention of search engines.

Second, what is the protocol of the robots?

The robot protocol is often referred to as the Reptile Protocol, the robotics Protocol, mainly in the search engine, the essence of which is the Web site and search engine crawler communication methods, to guide the search engine to better crawl the content of the site, rather than as a search engine between the restrictions and unfair competition tools.

Why does Baidu say 360 violates the protocol of the robots? Mainly because Baidu believes that 360 of the search for their own production of competition, Baidu does not want its own post bar, library, know, Wikipedia and other Web products, was 360 collected by the element, and in the robots protocol labeled shielding 360 search element, and 360 directly bypassing the robots agreement to continue to collect Baidu's products website information, so was sued by Baidu.

Simply put, any Web site will not be allowed to include the content of the site as long as it includes a ban on search engine access in its protocol. And the importance of robots is that a site has the right to exist in the Internet, but not the designated search engine index into the search results, because the search engine on the internet is like a king, the site is everyone's home, and the protocol is the last weapon against the king, is called " The wind will enter the rain and the king cannot enter.

In the website, the Robots protocol is a Notepad file, we just place the Robots.txt file in the website and directory, which can be labeled, which site Directory does not want to be crawled by search engines, the format as shown below:

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.