Original link: http://coolshell.cn/articles/664.html
Reference Link: http://www.runoob.com/php/php-ref-curl.html
Using the PHP Curl Library, you can easily and effectively grab pages. You just need to run a script, then analyze the page you crawled, and then you can get the data you want in a program. Whether you want to take part of the data from a link, or take an XML file and import it into the database, the fear is simply to get the Web content, CURL is a powerful PHP library. This article mainly describes if you use this PHP library.
Enable CURL settings
First, we have to make sure that our PHP opens the library, and you can get this information by using the Php_info () function.
<? PHP Phpinfo ();? >
If you can see the following output on a webpage, it means that the Curl Library is turned on.
If you don't see it, then you need to set up your PHP and open the library.
If you are under the Windows platform, then very simple, you need to change the settings of your php.ini file, find Php_curl.dll, and cancel the previous semicolon comment on the line. As shown below:
// Cancel the comment under the
If you are under Linux, then you need to recompile your PHP, and when editing, you need to open the compile parameters--add "–with-curl" parameter to the Configure command.
A small example
<?PHP//Initialize a CURL object$curl=Curl_init (); //set the URL you need to crawlcurl_setopt ($curl, Curlopt_url, ' http://coolshell.cn '); //Set Headercurl_setopt ($curl, Curlopt_header, 1); //sets the curl parameter, which requires the result to be saved to a string or output to the screen. curl_setopt ($curl, Curlopt_returntransfer, 1); //Run Curl, request a Web page$data= Curl_exec ($curl); //Close URL RequestCurl_close ($curl); //show the data obtainedVar_dump($data);
How to post data
The above is the code to crawl the Web page, the following is the post data to a page.
Suppose we have a URL http://www.example.com/sendSMS.php that handles the form, which can accept two form fields, one is the phone number, and the other is the message content.
<?PHP$phoneNumber= ' 13912345678 '; $message= ' This message is generated by curl and PHP '; $curlPost= ' pnumber= '.UrlEncode($phoneNumber) . ' &message= '.UrlEncode($message) . ' &submit=send '; $ch=Curl_init (); curl_setopt ($ch, Curlopt_url, ' http://www.example.com/sendSMS.php '); curl_setopt ($ch, Curlopt_header, 1); curl_setopt ($ch, Curlopt_returntransfer, 1); curl_setopt ( $ch, Curlopt_post, 1); curl_setopt ($ch, Curlopt_postfields, $curlPost); $data=curl_exec (); Curl_close ($ch);?>
From the above program we can see that using Curlopt_post to set the HTTP protocol post method instead of the Get method, and then set the post data to Curlopt_postfields.
About proxy servers
The following is an example of how to use a proxy server. Please note that the highlighted code, the code is very simple, I will not have to say more.
<?PHP$ch=Curl_init (); curl_setopt ($ch, Curlopt_url, ' http://www.example.com '); curl_setopt ($ch, Curlopt_header, 1); curl_setopt ($ch, Curlopt_returntransfer, 1); curl_setopt ( $ch, Curlopt_httpproxytunnel, 1); curl_setopt ($ch, Curlopt_proxy, ' fakeproxy.com:1080 '); curl_setopt ($ch, curlopt_proxyuserpwd, ' User:password '); $data=curl_exec (); Curl_close ($ch);?>
about SSL and cookies
About SSL is the HTTPS protocol, you just need to curlopt_url the connection of http://Into https://. Of course, there is also a parameter called Curlopt_ssl_verifyhost that can be set to verify the site.
For cookies, you need to understand the following three parameters:
- Curlopt_cookie, set a COOKIE in the face of the conversation
- Curlopt_cookiejar, save a cookie when the session ends
- The Curlopt_cookiefile,cookie file.
HTTP Server Authentication
Finally, let's look at the HTTP server Authentication scenario.
<? PHP $ch = curl_init (); curl_setopt ($ch, Curlopt_url, ' http://www.example.com '); curl_setopt ($ch, Curlopt_returntransfer, 1); curl_setopt ($ch, Curlopt_httpauth, curlauth_basic); curl_setopt (curlopt_userpwd, ' [Username]:[password] ') $data = Curl_ exec (); Curl_close ($ch);? >
For more information, please refer to the relevant Curl Handbook.
PHP's Curl Library