Scrapy
Scrapy,python develops a fast, high-level screen capture and web crawling framework for crawling web sites and extracting structured data from the page. Scrapy is widely used for data mining, monitoring and automated testing
Scrapy Introductory tutorial, its installation Reference scrapy Installation Guide Beautiful Soup
Execute command pip install BEAUTIFULSOUP4, for Python2, Pyquery
Pyquery is a strict implementation of Python in the style of jQuery. Syntax is almost exactly the same as jQuery, so you don't have to bother remembering strange ways, execute the command pip install pyquery to install
Pyquery official website Pyspider
PHANTOMJS is a WebKit-based server-side JavaScript API. It fully supports the web without the need for browser support, its rapid, native support for a variety of Web standards: DOM processing, CSS selectors, JSON, Canvas, and SVG. PHANTOMJS can be used for page automation, network monitoring, web screen screenshots, and no interface testing. Perform command pip install Pyspider for installation
Pyspider official website
Resources
An overview of the reptile framework for Python reptiles
Python crawler advanced two Pyspider frame installation configuration
The use of the pyquery of Python crawler Six
The usage of the beautiful soup of Python reptilian weapon two
Python crawler Six crawl love ask the knowledge person questions and save to the database
