Helper House (Bkjia.com) HTML tutorialToday, when I was sorting out a project, I encountered a problem about how a single web page blocked search engine indexing. Due to poor technology, I had to ask Daniel, the technology of helping customers. After modest and sincere inquiry, I will know the answer. Now I want to share it with you and hope it will help you.
Use the <META> tag to intercept or delete a webpage: add the <META> tag in the <HEAD> section of the webpage.
Intercept all search engines to include webpages:
<Meta name = "ROBOTS" CONTENT = "NOINDEX, NOFOLLOW">
Baidu only intercepts crawlers from webpages and allows other search engines to include them:
<Meta name = "baiduspider" CONTENT = "NOINDEX, NOFOLLOW">
Allow search engines to include your web pages, but prohibit them from tracking external links (for example, zh.wikipedia.org uses this example to prevent link flooding ):
<Meta name = "ROBOTS" CONTENT = "NOFOLLOW">
Allow a search engine to include your webpage, but prohibit it from indexing images on the webpage:
<Meta name = "ROBOTS" CONTENT = "NOIMAGEINDEX">
Note: If a webpage needs to be intercepted or deleted, add the <META> tag on that webpage. Other webpages will not be affected.
<META> tags target a specific webpage, not the entire website.