Objective
Recently there is a reptile demand, actually played a bit before, but all just stop at the extent of the tool will be used, and then prepare to delve into the system to learn Python crawler.
When it comes to Python crawlers, it is the famous Scrapy crawler frame. However, if you are just getting started, I suggest that there is no need to get into the frame class too early, and try to use some simple tool libraries that will help you understand the principles of crawlers.
Just my personal habits, after the installation of Python will have to install scrapy together, because I always feel that I will use it sooner or later, so the first to pretend.
Before the installation of Scrapy is all the way bumpy, not so easy, especially in Windows installed Scrapy is a variety of problems, but did not expect this is not how to encounter problems, probably found the right posture.
Installation steps
1. Install Python
Learning reptiles, it is best to start from the classic version 2.7, the installation process is very simple, do not repeat it.
Throw a link: https://www.python.org/downloads/release/python-2712/
2. Installing VCForPython27
Using scrapy under Windows requires VC2012 or 2010, but it's overkill to install such a huge thing for a scrapy, so you can choose a version for Python: VCForPython27
: https://www.microsoft.com/en-us/download/details.aspx?id=44266
Remember to restart the system after installation
3. Installing lxml
Installation tutorial See: http://blog.csdn.net/g1apassz/article/details/46574963
4. The final step
Pip install scrapy is done!
Install scrapy under Windows