The origins of search engines-search engine technology

The ancestors of all search engines were the Deutsch (Wheelan FAQ) invented by three students of McGill University (Alan Emtage, Peter Archie, Bill Archie) in 1990 by Montreal. Alan Emtage and so think of the development of a file can be used to find the system, so there is Archie. Archie is the first program to automatically index files on anonymous FTP Web sites on the Internet, but it's not really a search engine. Archie is a searchable list of FTP file names, the user must enter a precise file name search, and then Archie will tell the user which FTP address can download the file.
Inspired by the popularity of Archie, the Nevada System Computing Services University developed a Gopher (Gopher FAQ) Search Tool Veronica (Veronica FAQ) in 1993. Jughead is another Gopher search tool later.
Development (1):
The world's first spider program is the Matthew of the MIT wide Web Wanderer, which tracks the scale of internet development. At first it was used only to count the number of servers on the Internet, and later it was developed to capture URLs (URLs).
　
Search engines generally consist of the following three parts:
Crawler (robot, Spider)
Index Builder
Query Retriever
Development (2):
Excite's history can be traced back to February 1993, with 6 Stanford University (Stanford University) students thinking of analyzing word relationships to make more efficient retrieval of the vast amount of information on the Internet. By the year 1993, this was a complete investment project, and they also released a version of the search software for webmasters to use on their website, which was later called Excite for Web Servers. (Note: Excite was later known as the concept of search, May 2002, was InfoSpace acquired by the excite to stop their own search engine, instead of the meta search engine dogpile)
Development (3):
In April 1994, two PhD students from Stanford University, Chinese-American Jerry Yang and David Filo co-founded Yahoo. With the number of visits and links increased, the Yahoo directory began to support a simple database search. Because Yahoo! 's data is manually typed, it can't really be classified as a search engine, but it's actually just a searchable directory. Yahoo! included in the site, because all with the introduction of information, so the search efficiency significantly improved. (Note: After Yahoo, there are AltaVista, Inktomi, Google to provide search engine services)
Yahoo!---almost become synonymous with the the 1990s Internet.
Development (4):
1995, a new search engine form emerged--meta search engine (meta search Engine). Users only need to submit a search request, the meta-search engine is responsible for conversion processing to submit to a number of pre-selected independent search engines, and will be returned from the independent search engine all the results of the query, centralized processing and then returned to the user.