Python third-party library scrapy Framework Installation

1. Confirm that Python and Pip are installed successfully

2. Installation Win32py provides win32api,:https://sourceforge.net/projects/pywin32/files/

3. Installing lxml lxml is a library written in Python that allows you to process XML quickly and flexibly. https://pypi.python.org/pypi/lxml/3.3.1, available pip download,

Download command: python-m pip install lxml

4. Error occurred: Microsoft Visual C + + 14.0 is required. Get it with "Microsoft Visual C + + Build Tools": http://landinghub.visualstudio.com/visual-cpp-build-tools, need to install twisted

Twisted installation Address: https://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted

• Twisted?17.9.0?cp27?cp27m?win32.whl
• Twisted?17.9.0?cp27?cp27m?win_amd64.whl
• Twisted?17.9.0?cp34?cp34m?win32.whl
• Twisted?17.9.0?cp34?cp34m?win_amd64.whl
• Twisted?17.9.0?cp35?cp35m?win32.whl
• Twisted?17.9.0?cp35?cp35m?win_amd64.whl
• Twisted?17.9.0?cp36?cp36m?win32.whl
• Twisted?17.9.0?cp36?cp36m?win_amd64.whl
• Twisted?17.9.0?cp37?cp37m?win32.whl
• Twisted?17.9.0?cp37?cp37m?win_amd64.whl
• Before installing twisted, first determine your pythonb version, such as my version is python3.6.4, then I should choose Cp36, if your computer is a 64-bit system, WIN_AMD64 installation failed, you can install Win32 test,
• Because my 64-bit system is the Win32 of the installation.

 pip install C:\users\cr\downloads\TWISTED-17.5.0-CP36-CP36M-WIN_AMD64.WHL

• 5. Installing Scrapy
• Pip Install Scrapy
• 6.Scrapy operation
• 
  Create a new Pycodes folder under the D drive, open cmd
  D:\pycodes>scrapy Startproject Python123demo
• 
  New scrapy project ' Python123demo ', using template directory ' c:\\users\\jing\\appdata\\local\\programs\\python\\ Python36-32\\lib\\site-packages\\scrapy\\templates\\project ', created in:
  D:\pycodes\python123demo
  
  You can start your first spider with:
  CD Python123demo
  Scrapy Genspider Example example.com
  
• Scrapy Installation Success

This article was reproduced in: 79036579

Python third-party library scrapy Framework Installation