Home > Others

Features and optimization of Robots Meta Tag tags

Source: Internet
Author: User
Developer on Alibaba Coud: Build your first app with APIs, SDKs, and tutorials on the Alibaba Cloud. Read more ＞

Robots META tag is used to tell a Web Robot whether a Web page can be indexed and whether it can trace links on its page. The markup element has become more and more important. Moreover, robot does not have the control permission on the robots.txt file under the server's top-level Directory. Some search engines currently fully follow the Robots Meta Tag, such as Inktomi. robots Meta Tag format: The Robots META tag is stored in The header area (HEAD area) of The background HTML source code.

Here is an example:

<HTML>
<HEAD>
<Meta name = "ROBOTS" CONTENT = "NOINDEX, NOFOLLOW">
<Meta name = "DESCRIPTION" CONTENT = "this page...">
<TITLE>... </TITLE>
</HEAD>
<BODY>
...

Robot Meta Tag options:

In a Robots Meta Tag, four commands can be used: INDEX, NOINDEX, FOLLOW, and NOFOLLOW, separated. Where:

INDEX command: indicates that the Robot can INDEX this page;

FOLLOW command: indicates that the Robot can track links on this page;

NOINDEX command: indicates that the Robot index on this page is rejected, but the link on this page can be tracked;

NOFOLLOW command: indicates that the Robot is denied from tracking the link on this page, but can index this page.

Instance:

<Meta name = "ROBOTS" CONTENT = "INDEX, FOLLOW">
<Meta name = "ROBOTS" CONTENT = "NOINDEX, FOLLOW">
<Meta name = "ROBOTS" CONTENT = "INDEX, NOFOLLOW">
<Meta name = "ROBOTS" CONTENT = "NOINDEX, NOFOLLOW">

As mentioned in some search engine articles about Robots Meta tags, the predefined default settings are INDEX and FOLLOW. However, this is not the case for Inktomi. The default values of Inktomi are INDEX and NOFOLLOW.

There are also two global commands: ALL and NONE.

ALL = INDEX, FOLLOW: indicates that the current page can be indexed and the link to this page can be tracked;

NONE = NOINDEX, NOFOLLOW: indicates that the current page cannot be indexed and the link to this page cannot be tracked.

 

This article is an English version of an article which is originally in the Chinese language on aliyun.com and is provided for information purposes only. This website makes no representation or warranty of any kind, either expressed or implied, as to the accuracy, completeness ownership or reliability of the article or any translations thereof. If you have any concerns or complaints relating to the article, please send an email, providing a detailed description of the concern or complaint, to info-contact@alibabacloud.com. A staff member will contact you within 5 working days. Once verified, infringing content will be removed immediately.

Related Keywords:
attributes of meta tag list of all meta tags purpose of meta tag in html use of meta tag in html what use of meta tag in html features of html5 and css3 geo meta tags

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

What's Trending
Top 10 Tags
datastax versions naming convention zookeeper client class definition md5 microsoft sql server 2005 data structures exception handling error handling
Top 10 Keywords
microsoft download center down wordpress address url site address url wordpress address url windows installer 4 0 download 302 not found web address url definition site address url wordpress db2 integer mac os installation step by step pdf abbreviation for return

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

Get Started for Free

  • Sales Support

    1 on 1 presale consultation

    Chat Contact Sales

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

    Open a Ticket

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.

    Learn More