Try to get search engines crawling and indexing more content

SEO often headaches a problem, not included, index can not talk about rankings. In particular, to reach a certain scale of the site, so that the site is fully included is a very demanding SEO technology, when the page reached for example hundreds of thousands of, no matter how the structure of the site design, how to optimize, 100% included are impossible, can only try to increase the rate of collection. But sometimes how to stop the search engine included can also become a problem, recently more and more become a problem. Need to prevent the inclusion of the situation such as confidential information, copy content, advertising links and so on. In the past, the commonly used blocking methods include password protection, placing the contents behind the table, using Js/ajax, using Flash, and so on. Today, I saw Google Webmaster blog An article, these methods are not insurance.

　　Using Flash

Google has been trying to crawl flash content a few years ago, and simple textual content has been able to crawl. The links in Flash can also be tracked.

　　Form

Google spiders can also fill in the form and crawl the POST request page. This can be seen from the log long ago.

　Js/ajax

Use JS Link has been used as a search engine friendly method, so can prevent spiders crawling, but two or three years ago I saw the JS link can not stop Google Spiders crawl, not only the URL in the JS will be crawled, simple JS can also be executed to find more URLs.

A few days ago, some people found that the comments in the Facebook comment plugin used by many websites were crawled and included, and the plugin itself was Ajax. That's good news. One of my experiments E-commerce site product Comment function because of this cost a lot of thought, with the comments plug-ins with Facebook benefits big, specific what benefits later have time to say, the only problem is that the comments are AJAX implementation, can not be crawled, and product reviews are included as one of the purposes ( Produce original content). I thought for a long time also did not have the solution, had to first innocently both put on the Facebook comments plug-in and turned on the shopping cart itself the comment function. Now that the comments in the Facebook comments can be included, there's no need for two reviews.

　Robots file

The only way to ensure that content is not included is by banning files. But there is a disadvantage, will lose weight, although the content can not be included, but the page became only to accept the link weight, not out of the bottomless pit of weight.

　Nofollow

Nofollow is not guaranteed not to be included. Even if your site all point to the link to the page added NF, also can not guarantee that the site does not make a link to this page, search engines can still find this page.

How to make the page is not included is a question worth thinking, do not realize the seriousness of the child shoes can think of their own site on how many copies of content, low quality content, a variety of no search value (but users feel convenient, useful and can not be removed) classification, filter URL.

This article by http://www.74981.com collation, reprint please keep the source 74981.com game net!