Web crawler 2--php/curl Library (client URL Request Library)

Php/curl Library Features

multiple transport protocols . CURL (client URL request library), meaning "clients URL requests Libraries".

Unlike the PHP built-in network functions used in the previous article, Php/curl supports a variety of transport protocols, including FTP, FTPS, HTTP, HTTPS, Gopher, Telnet, and LDAP. Where HTTPS allows bots to download Web pages that are encrypted using the SSL (Secure Sockets Layer) protocol.

Form submission. Simulates the ability of a browser to submit a form to a server.

Basic authentication technology.

Cookies.

redirect.

Proxy name spoofing.

On-chain management, you can set the chain to any value.

Socket management to determine whether the network server responds to file requests.

Web crawler 2--php/curl Library (client URL Request Library)