Shielding spiders do optimization, will you?

After proper shielding optimization, the "spider" does not like the things and to promote http://www.aliyun.com/zixun/aggregation/8612.html "> The site rankings disadvantage all factors through ROBOTS.TXT to shield, the site's ranking naturally can be significantly improved.

Spiders, to patronize their own websites. But in fact, even if the "spider" attracted, and the site also SEO over, but also can not get a good ranking, this is why? Because "spider" is also rich in feelings, there are things he likes and do not want to see things. Appropriate shielding some of the directories and files, so that "spiders" crawl not to, that's OK! So how do you block out what these spiders don't want to see? Super P57 Optimizer analysis is as follows:

Privacy directory to shield the security of Web sites

You can imagine the following, join your background login directory or login address is crawled to, not only the weight of the site is not the slightest value, but also may be more than one of the channels of attack, so related to the security of the directory, such as database directories, Web site log directory and backup directory need to be screened

Second, shielding cache page

"Spiders" crawl to the site's cache contents of the content, which is bound to and the contents of the site is repeated, if there are too many repetitions, then Baidu's algorithm mechanism will think that your site cheating, and even enhance the weight of your site, to the site has a great impact, So it is necessary to screen the corresponding cache directory.

Third, the screen CSS directory

CSS directory for spiders is completely useless, crawl will affect the search engine algorithm to judge, so you can through the ROBOTS.TXT file to screen.

Four, screen dynamic page (two-page situation)

Site Static page is very easy to be indexed by search engines, usually spiders crawl and included is two different things, the site in addition to static pages, most of the site still exist dynamic pages, such as "/1.html and asp?id=1 these two refers to the same page, if not to screen, It's bound to cause two pages to be crawled by spiders, but to the search engine algorithm to judge the time, because found two of the same page, you will think that your site is suspected of cheating, so increase your site's investigation efforts, thus affecting the ranking of the site, so the right approach is to screen the dynamic page of the site!
Released by Super P57 (http://www.iajianfei.com).