Search engine strategy for Dynamic Web site

Intermediary transaction SEO diagnosis Taobao guest Cloud host technology Hall

Absrtact: Dynamic Web sites enrich the function of the site, but for search engines, the situation is different, dynamic page is the user "input" or "choose" when the dynamic generation, but search engine "search robot" can not "input" and "choice." In addition, the search engine avoids the "Search Robot Trap (spider traps)" script error.

The appearance and advantage of dynamic website

When the first Internet appeared, the content of the site is in the form of HTML static pages stored on the server, the visitors browse to the pages are these actual static pages. With the development of technology, especially the development of database and scripting technology Perl, ASP, PHP and JSP, more and more sites are starting to adopt dynamic page publishing methods. For example, we search for a content on the google.com, the resulting search results page file "itself" does not exist on the Google server, but through the program when we enter the search content to call the backend database generated in real time, that is, these results pages are dynamic.

Static page sites only involve file transfer issues, and dynamic site is much more complex, users and sites appear a lot of interaction, the site is no longer just content release, but become a "application (creator)", software industry to the Internet expansion, from the software perspective, Dynamic site is the separation of the logical application layer and the data layer, the database is responsible for the storage management of the site data, and ASP, PHP, JSP and so on to handle the logical application of the site. The advantage of this is that in addition to adding a lot of interactivity, it is more important to maintain, update, and upgrade the site. It can be said that there is no dynamic Web technology, the current Internet on these very large sites can not appear.

Second, the search engine crawls the dynamic website page to face the question

From the user's point of view, dynamic site is very good, enrich the site's function, but for search engines, the situation is different. (on the difference between search engines and categories, and how the search engine works, please?) "Understanding Search Engines")

The fundamental problem is "input" and "selection", dynamic pages are generated dynamically when the user "enters" or "chooses", but the search engine's "search robot" cannot "enter" and "select". For example, we should be in when the bookstore site to see Feng Yingjian's "Network Marketing Basics and Practice" book, Introduction page is dynamically generated, URL address is: http://www.dangdang.com/product_detail/product_detail.asp?product_id=493698
Here in "? "The product_id parameter value that we entered," Search robot "can find the http://www.dangdang.com/product_detail/product_detail.asp page through the link, but it cannot enter"? "After the product_id parameter value, so that the paging file cannot be crawled.

In addition, to reach this band via link "? "The page, the technical search engine can crawl, but generally the search engine chooses not to crawl, this is in order to avoid a kind call" search robot Trap (spider traps) "The script error, this kind of error can let the search robot carry on the infinite loop crawl, cannot exit and waste time.

Third, dynamic Web site search engine strategy

Dynamic Web site to be crawled by search engines, you can use content publishing system software will be dynamic site into static pages, this method for the page after the release of less change site is more appropriate, such as some news sites (such as Sina's News Center: http://news.sina.com.cn/).

The general Dynamic Web site can be used to capture search engines by:
First, do we want to have the URL address of the dynamic page not "?" To make the dynamic page look like a "static page." Look at the following page http://www.amazon.com/exec/obidos/tg/detail/-/043935806X/, this is obviously a dynamic page, but the URL address looks like "static page." For different dynamic technologies can be implemented using the following technology:

• For dynamic pages using ASP Technology Exception Digital Company provides a tool called xqasp (http://www.xde.net/products/product_xqasp.htm) can "? Replace with/.
• For sites using ColdFusion technology, you need to reconfigure the ColdFusion on the server, using "/" instead? "Transfer parameters to URL, see http://coldfusion.com/site for more details."
• For sites using the Apache server, you can use the rewrite module to convert the URL address with the parameter to the form of the search engine support, which is not installed by default in the Apache server, please see http://for detailed information mod_rewrite Httpd.apache.org/docs/mod/mod_rewrite.html.

Other dynamic technologies can also find corresponding ways to change the form of URLs.

Then, to create some static pages to point to these dynamic pages (with changed URL links).
As I said before, search engine robots do not "input" parameters, so the above dynamic pages to be crawled by search engines, we also need to tell the robot the address of these pages (that is, parameters). We can create some static pages, generally in the network marketing said? Gateway page, which has a large number of links to these dynamic pages.

The address of these portal pages to the search engine, these pages and linked to the dynamic page (changed URL form) can be crawled by the search engine.

Four, the search engine to the dynamic website support improvement

When we adjust the dynamic site to adapt to search engines, search engines are also developing. So far, the vast majority of search engines do not support dynamic page crawl, but Google, HotBot, and domestic Baidu began to try to crawl dynamic site pages (including?) "？ ", which is why we now have dynamic links in the results when we search these search engines."

When these search engines crawl dynamic pages, they only crawl dynamic pages that are linked from static pages (at least "seemingly" static pages), while dynamic pages linked from dynamic pages are no longer crawled.

So a dynamic site, if only for these search engines, can be described in the above section of the method based on simplification: only to create some portal pages, link a lot of dynamic pages, and then submit these portal pages to these search engines can be.

For direct use of dynamic URL addresses, please note:
• Do not have a session ID in the file URL, and do not use the ID as the parameter name (especially for Google);
• The fewer parameters the better, as far as possible not more than 2;
• Can not use the parameters in the URL as far as possible, some parameters to transfer to other places, this can increase the dynamic page is crawled depth and number.

search engine technology and trend


search engine Tracking


Search engine Usage Tips


Search engine technology development trend


Network search engine and intelligent agent technology


on the workflow of search engine


What is a search engine

Ten misunderstandings of
Chinese search engine


five most frequently asked questions about SEO writing