Web crawler-PHP crawler recommendations

A search on GitHub, I feel PHP did not find a better crawler, like Python with a BS or good, do not know that PHP has wood like this kind of cool crooked reptile Library

Reply content:

A search on GitHub, I feel PHP did not find a better crawler, like Python with a BS or good, do not know that PHP has wood like this kind of cool crooked reptile Library

Https://github.com/hightman/pspider

Does the crawler refer to DOM operations? Is BS a beautifulsoup?

PHP contains more than two, one is phpquery, there is a simple HTML Dom Parser, the former based on the DOM, the latter based on the regular.

Https://github.com/guzzle/guzzle

PHP did not find a good reptile library, writing is also more cumbersome, or recommended Python scrapy

