Install python3.x+scrapy Tutorial in WINDOWS10 system _python

The website downloads is good, https://www.python.org/downloads/release/python-352/

With installer download more convenient, it directly to the environment variables are for you to match.

Of course, you can download http://www.jb51.net/softs/416037.html at this site

Upgrade Pip

After installation, execute in CMD.

python-m Pip Install-upgrade pip

Mention Pip to the latest version

Download lxml

lxml is used to parse Web pages, Scrapy relies on it, it is a third party library, where a Python third-party library site is recommended

Http://www.lfd.uci.edu/~gohlke/pythonlibs/, the inside is compiled well, the benefits of the Python user under Windows.

Ctrl+f Locate lxml

Note: Open the URL after ctrl+f, search lxml, select the corresponding version, is generally Win32, and do not choose win_arm64, even if the computer is Win64

After the download, cmd into the download directory, directly with the PIP installation

Pip Install LXML-3.6.4-CP35-CP35M-WIN_32.WHL

Install Scrapy

PIP installation is most convenient

Pip Install Scrapy

View version

Scrapy version

Output should be Scrapy 1.2.1, is also the latest version of the official website.

Problems that may be encountered

The following content summarizes the CSDN and StackOverflow sections

1. Python error:unable to find Vcvarsall.bat

Installation MinGW (measured)

1, download and install MinGW, download the address: Click to open the link

2, in the MinGW installation directory to find the Bin folder, find Mingw32-make.exe, copy a renamed to Make.exe

3, add the path of MINGW to environment variable path, for example, I install MinGW into D:\MinGW\, add D:\MinGW\bin to path;

4, in the <python installation directory >\distutils (need to ctrl+f in the Python installation directory distutils) Add File Distutils.cfg, in the file input

[Build] 
Compiler=mingw32  

Save

2. Error:command ' gcc ' failed:no such file or directory

The solution is to add the D:\MinGW\lib to the path again.

3, Valueerror:unknown MS Compiler version 1900

In cygwinccompiler.py

GET_MSVCR () function

In

elif Msc_ver = = ' 1600 ': 
  # VS2010/MSVC 10.0 return 
  [' msvcr100 '] 

Later, add the following

elif Msc_ver = = ' 1700 ': 
  # Visual Studio 2012/visual C + + 11.0 return 
  [' msvcr110 '] 
elif msc_ver = ' 1800 ': 
   # Visual Studio 2013/visual C + + 12.0 return 
  [' msvcr120 '] 
elif msc_ver = = ' 1900 ': 
  # Visual Studio 2015/ Visual C + + 14.0 
  # "Msvcr140.dll no longer exists" http://blogs.msdn.com/b/vcblog/archive/2014/06/03/ visual-studio-14-ctp.aspx return 
  [' vcruntime140 '] 

Then copy the python3.5 folder under vcruntime140.dll D:\MinGW\mingw32\lib

4. Typeerror:unorderable types:nonetype () >= str ()

Try restarting.

5. Error:the ' PYASN1 ' distribution was not found and is required by service-identity

setup.py try it on the run.

The above is the entire content of this article, I hope to learn Python can help.