Scrapy Installation Guide (Windows)

Windows development, inevitably encounter a lot of pits, than the general development is much more difficult. First don't spit slot windows, we look directly at this Scrapy how to install.

First, there is a document, for example I use this:

Http://scrapy-chs.readthedocs.io/zh_CN/0.24/index.html.

Preferably according to their own scrapy version to find documents, Baidu Google a bit.

After the document is found, the documentation has the installation guide, which:

Http://scrapy-chs.readthedocs.io/zh_CN/0.24/intro/install.html#intro-install-platform-notes

Teach you to install Python, put a pip, basically nothing to use, oh ah.

Scrapy to say, there are many dependencies, your Python installed, direct pip install Scrapy, in Windows most error, first look at the most common errors:

If the word Visual C + + appears, this time need to understand why, because one of your Python package needs C + + to compile, the simplest you can directly find this package, download the compiled offline installation. You can also download the installation VC directly, the error will give an address, note vs version.

　　1. Lack of libxml2, or lack of lxml

This time, install Lxml:pip installed lxml.

Installation can only say you lucky, not installed very normal, no matter, offline installation: https://pypi.python.org/pypi/lxml/3.6.0 This URL, find their corresponding version, the platform must be correct, otherwise it is not installed, Confirm your own number of Windows, and your Python version, and make sure you are on which version of Python you are installing in multiple versions.

　　WHL Package Installation method pip Install + installation package full path. WHL

　　2. Missing Pyopenssl

Pip install is still installed, offline:

https://pypi.python.org/pypi/pyOpenSSL/16.1.0

　　3. Missing Win32API

Installing pywin32,:https://sourceforge.net/projects/pywin32/files/pywin32/

Download the EXE installation directly.

　　EXE package installation method Easy_install + installation package full path. exe

After the above steps are complete, install SCRAPY:PIP installed scrapy. If time-out, indicating that the network does not, recommended to change the network speed fast, it is not possible to set the time-out:

Pip--default-timeout=100 install-u pip

Scrapy Installation Guide (Windows)