PHP uses curl to reduce the time required to obtain third-party webpage content concurrently.

PHP uses curl to reduce the time required to obtain third-party webpage content concurrently.
Preface:


In our usual programs, it is inevitable that we access several interfaces at the same time. When we use curl for access, it is generally a single, sequential access. If there are three interfaces, every interface takes 500 milliseconds, so it takes 1500 milliseconds for the three interfaces. This problem is too headache and seriously affects the page access speed. Is there any possibility of concurrent access to increase the speed? Today, I would like to give you more instructions on using curl concurrency to speed up page access.

1. Old curl access methods and time consumption statistics

<? Phpfunction curl_fetch ($ url, $ timeout = 3) {$ ch = curl_init (); curl_setopt ($ ch, CURLOPT_URL, $ url); curl_setopt ($ ch, CURLOPT_TIMEOUT, $ timeout); curl_setopt ($ ch, CURLOPT_RETURNTRANSFER, 1); $ data = curl_exec ($ ch); $ errno = curl_errno ($ ch); if ($ errno> 0) {$ data = false;} curl_close ($ ch); return $ data;} function microtime_float () {list ($ usec, $ sec) = explode ("", microtime (); return (float) $ usec + ( Float) $ sec);} $ url_arr = array ("taobao" => "http://www.taobao.com", "sohu" => "http://www.sohu.com ", "lai18" => "http://www.lai18.com",); $ time_start = microtime_float (); $ data = array (); foreach ($ url_arr as $ key => $ val) {$ data [$ key] = curl_fetch ($ val);} $ time_end = microtime_float (); $ time = $ time_end-$ time_start; echo "time consumed: {$ time} ";?>

Duration: 0.614 seconds


2. curl concurrent access mode and time consumption statistics

<? Phpfunction curl_multi_fetch ($ urlarr = array () {$ result = $ res = $ ch = array (); $ nch = 0; $ mh = curl_multi_init (); foreach ($ urlarr as $ nk => $ url) {$ timeout = 2; $ ch [$ nch] = curl_init (); curl_setopt_array ($ ch [$ nch], array (CURLOPT_URL => $ url, CURLOPT_HEADER => false, response => true, CURLOPT_TIMEOUT => $ timeout,); curl_multi_add_handle ($ mh, $ ch [$ nch]); + + $ nch;}/* wait for faster Ming re Quest */do {$ mrc = curl_multi_exec ($ mh, $ running);} while (CURLM_CALL_MULTI_PERFORM = $ mrc); while ($ running & $ mrc = CURLM_ OK) {// wait for network if (curl_multi_select ($ mh, 0.5)>-1) {// pull in new data; do {$ mrc = curl_multi_exec ($ mh, $ running) ;}while (CURLM_CALL_MULTI_PERFORM ==$ mrc) ;}} if ($ mrc! = CURLM_ OK) {error_log ("CURL Data Error");}/* get data */$ nch = 0; foreach ($ urlarr as $ moudle => $ node) {if ($ err = curl_error ($ ch [$ nch]) = '') {$ res [$ nch] = curl_multi_getcontent ($ ch [$ nch]); $ result [$ moudle] = $ res [$ nch];} else {error_log ("curl error");} curl_multi_remove_handle ($ mh, $ ch [$ nch]); curl_close ($ ch [$ nch]); ++ $ nch;} curl_multi_close ($ mh); return $ result ;}$ url_arr = array ("taobao" => "Http://www.taobao.com", "sohu" => "http://www.sohu.com", "lai18" => "http://www.lai18.com",); function microtime_float () {list ($ usec, $ sec) = explode ("", microtime (); return (float) $ usec + (float) $ sec) ;}$ time_start = microtime_float (); $ data = curl_multi_fetch ($ url_arr); $ time_end = microtime_float (); $ time = $ time_end-$ time_start; echo "time consumed: {$ time}";?>

Time consumed: 0.316 seconds. The time spent on accessing the backend interface on the entire page is reduced by half.

CURL technical knowledge tutorial series technical articles favorites

Http://blog.csdn.net/hello_katty/article/details/45557423