Ubuntu Scrapy Development Environment Building

My version is 14.04.

1. Updating the system

# #如果系统没有换国内下载路径需要换下系统的更新下载路径

sudo apt-get update system

sudo apt-get upgrade

2. Install pip scrapy Some packages that need to be installed with pip command

1. sudo apt-get install python-pip 安装命令

2. pip -V 这是查看pip版本信息命令

3. Installing srapy Dependent

1.sudo apt-get Install Python-dev python-pip libxml2-dev libxslt1-dev zlib1g-dev libffi-dev Libssl-dev

2. If the PYTHON3 environment also wants to install scrapy then you need to execute the following command

　　　　sudo apt-get install python3 python3-dev

4. Installing Scrapy

sudo pip Install scrapy

Scrapy Environment Installation Complete

Check if Scrapy is installed successfully in console input: scrapy

If there is a hint that the corresponding version information is successful, do not need to look below

During the installation of the scrapy process, op_no_tlsv1_1 may appear, generally twisted version is higher than

1. The simplest way is to uninstall twisted and then reinstall the lower version, sudo pip install twisted==16.04 (here 16.04 is what we use now)

2/Another method, but no experiment, is to remove Pyopenssl again run sudo pip install scrapy