Sharing: How to avoid spider traps

Source: Internet
Author: User
Keywords Trap

We know that the search engine to include our site first need to go through the spider this off, not conducive to spider crawling site is relatively not conducive to optimization, this blog will tell you what the practice is not conducive to spiders crawling, we should also how to avoid these spider traps. Firewall Web site Seoer analysis is as follows:

1. Jump

Except 301 turn, search engine is more sensitive to other forms of jump, such as 302 jump, JavaScript jump, http://www.aliyun.com/zixun/ Aggregation/12592.html ">flash jump, Meta refresh jump. Some site users will be automatically moved to a page in a directory when they visit the homepage. Most of these home shifts do not see any reason or purpose, and such a turn to search engines is extremely objectionable.

If you have to turn, 301 jump is recommended by the search engine, for Web site changes to the jump (in fact, this jump facilitates the search engine index calculation to avoid a large number of unnecessary indexes), you can transfer the weight of the page from the old site to the new URL. Other jumps are considered as search engine cheating and will be punished.

2.SESSION ID

Some Web sites use the session ID (conversation ID) to track user access, which means that each user who accesses the site produces a session ID, which is added to the URL. In other words, when the search engine spider every visit will also be treated as a new user, then the URL will add a different session ID, so that the search engine spiders each visit the same page but return is indeed different url,www.ytaiam.org then will be confused search engine. When the search engine encountered this situation will be common sense to determine whether the string is the session ID or the normal parameters, if you determine that it will be the sessions ID removed it, included the normal URL, but also sometimes not come out, such words will be included in a large number of repeated pages of different URLs, not conducive to optimization

recommends that you keep track of user access by using cookies without generating session IDs. or program to determine whether the visitor is a search engine spider or ordinary users, if it is a search engine spider, the session ID is not generated. Tracking search engine access is meaningless, spiders can neither fill out the form, nor put the goods into the shopping cart.

3Flash

Use a small amount of flash in a Web page to enhance the visual effects of the user experience is normal, such as advertising, icons and so on. Of course, these small flash and pictures are only a small part of the HTML code, there are other text-oriented content on the page, so the search engine crawl and includedNo effect. However, if the home page full of flash performance, such as a title animation fill the entire page, there is no text content, only one click into the homepage of the button, the rest without any entry page entry, such as the site search engine is unable to read the text content and link in the Flash file. And spiders can not enter the site through the page HTML version of the text page, natural search engine can not index any text information, not conducive to spiders crawling.

If the flash effect is required, then you need to add a link to the homepage outside of Flash, which must be placed in the HTML code other than the Flash file, which can be placed at the bottom, So search engine tracking this link can crawl the next HTML version of the page.

4. The dynamic URL

Dynamic URL refers to URLs generated by a database-driven Web site with greetings, equals, and parameters. In general, dynamic URLs are not conducive to search engine spiders crawling, because the current search engine technology is still not up to, that is, it is difficult to identify such URLs. According to Google engineers, the current Google for such URLs are still able to identify, other search engine technology has not yet reached.

5.Javascript Links

Because JavaScript creates a lot of compelling visuals, some sites like to use JavaScript scripts to generate navigation systems. This is a very bad way for spiders to crawl. Although search engines are trying to parse the JS script, of course we can't wait for it to fully interpret the JS script, so we need to avoid it as much as possible. A lot of stationmaster all said own column page did not include, a big factor is because the navigation uses the JS script to cause the search engine cannot parse.

According to my observation, although some search engines can technically get the links contained in JavaScript scripts, and can even execute scripts and track links, but for some of the lower weight of the site, search engines do not feel the need, do not bother with that effort. So the links on the site must use the simplest standard HTML links, especially the navigation system. Using CSS as a navigation system can achieve a lot of visual effects.

In fact, JavaScript has other uses, if the webmaster does not want the search engine to include this page, you can use JavaScript script to block the search engine crawling.

6. Require login

Some Web content is placed in a member area that requires a user to log in before it can be seen by a search engine. Spiders cannot fill in username, password, or register. The

is published by the Firewall (http://www.dcnetworks.com.cn). &NBSP

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.