Uncover the mystery and analyze the search engine principles

On the vast Internet, especially on the Web (World Wide Web), the Internet is not accessible without searching. Are you familiar with search engines? How do they work? Which search engines do you use? Today, I will talk to you about the search engine.

I. Search engine classification

We can call it a search engine to obtain website webpage information, establish a database, and provide a query system. According to the working principle, they can be divided into two basic categories: full text Search Engine (FullText Search Engine) and classification Directory ).

Full-text search engine databases rely on software called "web robots" or "web crawlers, A large amount of web page information is automatically obtained through various links on the network, which is analyzed and organized according to specific rules. Google and Baidu are typical full-text search engine systems.

Classification directories are collected manually to form databases, such as the classification directories of Sohu, Sina, and NetEase in Yahoo China and China. In addition, some navigation sites on the Internet, can also belong to the original category directory, such as "home" (http://www.hao123.com /).

Full-text search engines and classification directories have different lengths. Because full-text search engines rely on software, the database capacity is very large, but its query results are often inaccurate. Classification directories rely on manual collection and sorting of websites, it can provide more accurate query results, but the collected content is very limited. To complement each other, many search engines now provide both types of queries. Generally, queries for full-text search engines are called searches for "All websites" or "All websites ", for example, Google's full-text search (http://www.google.com/intl/zh-CN/); the query of the classification directory is called the search "classification directory" or search "classification site", such as Sina search (http://dir.sina.com.cn /) and Yahoo China search (http://cn.search.yahoo.com/dirsrch ).

On the Internet, the integration of these two types of search engines also produces other search services. Here, we can also refer to them as search engines, mainly including:

META Search Engine ). Such search engines generally do not have their own network robots and databases, their search results are displayed on the same interface in a unified format by calling, controlling, and optimizing the search results of multiple other independent search engines. Although the meta-search engine does not have a "web robot" or "web spider", it does not have an independent index database. However, in terms of retrieval request submission, retrieval interface proxy, and retrieval result display, they all have their own special meta search technology. For example, "metaFisher meta search engine"
(Http://www.hsfz.net/fish/), it calls and integrates data from multiple search engines, such as Google, Yahoo, AlltheWeb, Baidu and OpenFind.

Integrated Search engine (All-in-One Search Page ). The integrated search engine uses network technology to link multiple independent search engines on a single webpage. When querying, you can click or specify a search engine. Multiple search engines can be queried at the same time, search results are displayed on different pages by search engines, such as the Internet Swiss Army knife (http://free.okey.net/%7Efree/search1.htm ).