Because Scrapy currently support the best Python2.7, Python3 may have problems, so it is still under the Python2.7 to install Scrapy module.
On the Mac with the Python2.7 environment installed Scrapy module, Bon voyage, direct Pip install-i http://pypi.douban.com/simple scrapy, automatically install the required modules, all OK.
But in the Windows environment Python2.7 installation Scrapy, a variety of problems, problems constantly, according to the error prompted to find solutions online, record some pits.
The first is PIP install scrapy such a way may not install, the reason is PyPI official website by the wall, alas. The solution is to install the module as described above using the PIP image.
There will be errors in the installation process, according to the error to find the Internet can generally find solutions, installed in the terminal run Scrapy command, there will be an error, if the hint is missing other dependent modules, on the one by one installation.
Note that the environment described herein is:
Windows 7 64-bit system, Python2.7.
The following is a method for installing the lxml module on Windows.
Install lxml under Windwos
From http://www.lfd.uci.edu/~gohlke/pythonlibs/This web site, find lxml, press Ctrl+f5 Quick Find, and then download the corresponding WHL file, such as download to D:\ LXML-3.4.4-CP27-NONE-WIN32.WHL. Then use the PIP install installation, as follows:
C:\users\administrator>pip Install D:\LXML-3.4.4-CP27-NONE-WIN32.WHL
Unpacking D:\LXML-3.4.4-CP27-NONE-WIN32.WHL
Installing collected Packages:lxml
Successfully installed lxml
Cleaning up ...
Pay special attention to a little,
download the WHL files do not change file name , otherwise there will be errors, because the filename is too long I changed the filename, installation is not successful.
In the terminal input scrapy, the appearance of this interface indicates that the Scrapy module was installed successfully.
Most of these are modules that install scrapy-dependent installations.
It was not discovered until the first Srapy program was written, and there were no modules installed.
Installing the Cryptography Module
Hint Error: Importerror:no module named cryptography.hazmat.bindings.openssl.binding
Pip Install-i http://pypi.douban.com/simple Cryptography
Installing the Pywin32 module
Hint Error: Exceptions. Importerror:no module named Win32API
Download installation file Address: Http://sourceforge.net/projects/pywin32/files/pywin32/Build 20219/