Build a powerful FTP search engine under Linux

Linux is doing its way, many friends believe that it has been used to set up a variety of services, what web, FTP, BBS and so on, and so on, this time, I would like to introduce another Linux run under the Server software----Noseyparker, a powerful FTP search engine, As long as some simple steps, a powerful search engine to build up a hand, you listen to me slowly.

Parker is an FTP server search engine that is based on Linux open source software. Mainly retrieves each FTP server above the file, then saves the directory information in the local file, if has the inquiry request, will retrieve the local data, will the related information (the file address) return to the requester. Many FTP sites in the Education network use this as a search engine, such as Tsinghua nine well.

Using the method is simple, if you are a Linux system, there should be no problem. If it is another unix-like system, can also be modeled as the corresponding treatment.

This article takes the Red Flag 2.0 Desktop Edition as an example to illustrate the entire architectural process. Because relatively speaking I personally think Red Flag Linux better operation, Chinese also do very well. His web Server (Apache) settings can be implemented through the Xwindow interface, which is more convenient for novice users.

First you have to get a piece of Parker's source code, recommended to this site search, you can find a dozen or more sites to provide the source code: http://e.pku.edu.cn, get the source code, we can start installation.

The basic installation method is as follows (refer to the readme operation under the Parker directory):

1, of course, the first thing is to boot into your Linux, and then you get to the Parker source code files (generally parker.2000-09-06.xxxx.tgz, which contains this Parker's modified date and modifier) to expand into a directory, Here we assume the/root/parker/.

2, is the text editor to edit/root/parker/src/makefile this file, mainly set parker_home for your Parker directory (/root/parker/)

3, in the Terminal window Input command make config to compile

Under your/root/parker/src/directory, execute make config. Make some similar to VC inside the project, you can batch processing some programs. All unix-like systems have make this program, otherwise, you are installing Linux without the support of the development environment. (Choose Custom Installation Friends will pay attention to, I first time when the red flag, choose Custom, not careful this make does not load up)

4, edit/root/parker/src/parker.h, set the server, Parkerserver, the specific method is to replace the "10.129.6.172" with your Parker's server address.

5, in the Terminal window Input command make to compile

6, after compiling, continue typing make install to compile processing

7, modify your parker_hosts (/root/parker/etc/parker_hosts) file, add the FTP server address that needs to be retrieved, a row an FTP server address.

8, will src/the following CGI program (CGI, Cgistatus,cgiswitch, these files only when you compile the above to produce) copy to your WWW server cgi-bin directory below. Place the file below/root/parker/html/under Doc Root on your WWW server so that it can be accessed by the user. For more information about Web server settings, refer to other literature, but relatively speaking, the Red Flag Linux Apache settings are relatively simple.

9. Edit your/etc/services and/etc/inetd.conf files and join Parker service. Specific modifications can refer to the example below in the/root/parker/conf/directory.

In the example/usr/networking/parker/bin/parkerd this directory refers to the directory where Parker is located, modifying it to/root/parker/bin/parkerd, of course, you must first complete make install, This will be the Parkerd file under your parker/bin/directory.

10, restart the inetd and WWW server program.

11, the regular execution/root/parker/bin/newdata this script file, may place it in your crontab, lets the system carry on regularly (generally is 1 days to 1 weeks).

The NewData script accesses the FTP server defined in/root/parker/parker_hosts, stores the retrieved data locally, and then processes the data accordingly.

www users can perform file query requests by visiting the Parker page.

After you have successfully executed make install, you will see the NewData file under your/root/parker/bin/directory, and note that you cannot run it directly in the directory where the script is located, otherwise there will be an error, no data to collect, You can perform parker/bin/newdata (note case) in the root directory (root).

So far, a powerful search engine has been built up. The simple interface is as follows (Concrete page display effect can modify/root/parker/html/the following file, but the search results page will need to modify the/root/parker/src/cgi.c file, and then recompile, the request has a certain HTML language foundation. ）