Clever Use of PHP functions to implement collectors

PHP has been developing for a long time and many users are familiar with PHP. Now we can use PHP functions to implement the collector program. What is a collector, usually known as a thief program, is mainly used to capture others' webpage content. It is not difficult to create a collector, that is, to remotely open the webpage to be collected, and then use a regular expression to match the required content, as long as there is a little basis for a regular expression, you can make your own collectors.

I developed a novel serialization program a few days ago. For fear of updating problems, I wrote a collector to collect 8-way Chinese network. The function is simple and cannot be customized, however, the general idea is in place, and custom rules can be expanded by themselves. Using php as the Collector mainly uses two PHP functions: file_get_contents () and preg_match_all (). The first one reads the webpage content remotely, but it can only be used in Versions later than php5, the latter is a regular function used to extract the required content. In one step. Because it is a collection of novels, we must first extract the title, author, and type. Other information can be extracted as needed.

This is not enough. You also need a PHP function to be cut:

 
 

  
  
Function cut ($ string, $ start, $ end ){
  
  
$Message=Explode($ Start, $ string );
  
  
$Message=Explode($ End, $ message [1]); return $ message [0];} where $ string is the content to be cut, $ start is the start, $ end indicates the end point. Retrieve the Classification Number:
  
  
 
  
  
$Start="Html/Book /";
  
  
$End
  
  
="List. shtm";
  
  
$Typeid=Cut($ Typeid [0] [0], $ start, $ end );
  
  
$Typeid=Explode("/", $ Typeid); [/php]
  
  
 
  
  
In this way, $ typeid [0] is the classification number we are looking. The method is as follows:
  
  
 
  
  
$Ustart=""";
  
  
$Uend
  
  
=""";
  
  
// T stands for title
  
  
$Tstart=">";
  
  
$Tend
  
  
="<";
  
  
// Obtain the path, for example, 123. shtm, 2342. shtm, 233. shtm.
  
  
Preg_match_all ("/" [0-9] {1,}. (shtm) "/is", $ chapterurl, $ url );
  
  
// Obtain the title, for example, Chapter 1 "9 ".
  
  
Preg_match_all ("/<A Href= "[0-9] {1,}. shtm "(.*?)</>/Is ", $ file, $ title );
  
  
$CountCountcount= Count ($ url [0]);
  
  
For ($I=0; $ I<= $ Count; $ I ++)
  
  
{
  
  
$U=Cut($ Url [0] [$ I], $ ustart, $ uend );
  
  
$T=Cut($ Title [0] [$ I], $ tstart, $ tend );
  
  
$ Array [$ u] = $ t;
  
  
}
 
 

$ Array is the address of all chapters. Here, the collector completes the process in half. The rest is to open the address of each chapter in a loop, read the address, and match the content. This is relatively simple and will not be described in detail here. Now, let's write this article first today. For the first time I write such a long article, there will inevitably be problems with language organization. Please forgive me!