Centos6.5x64 Installation scrapy1.0.4 Successful

Recently in the self-study crawler frame scrapy, read the crossing Web document, can't wait to install. The results are all wrong and miserable. Online Search an article, (original link Http://www.tuicool.com/articles/URNVV3E).

First, introduce the following environment:

1, Centos6.5 x64 installed in the VMware virtual machine, because the later need to be ported, then chose compatible vm10.0.

# yum-y Update

Upgrade the System

2, Python2.7.9. The system comes with 2.6.6.

CD ~/download

Pipe network Download Source:

wget--no-check-certificate Https://www.python.org/ftp/python/2.7.9/Python-2.7.9.tar.xz

Tar xvf python-2.7.9.tar.xz

CD Python-2.7.9

./configure--with-ensurepip=install #其余保持默认

Make

sudo make install # if python2.7.9 is a sub-version, use made Altinstall

[[email protected] python-2.7.9]$ Python
Python 2.7.9 (default, Feb 1 2016, 21:30:54)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-16)] on linux2
Type "Help", "copyright", "credits" or "license" for more information.
>>>

Upgrade the next libffi-devel because of stepping on it too much, so directly and updated the next, this step to choose to do:

sudo yum install update libffi-devel

The environment is ready, the following is the Pit link O (╯-╰) o

Installation Failure Method:

Sudo/usr/local/bin/pip Install Scrapy

A lot of mistakes, the reference to the first link is still unresolved. The pit won't stick out, step on it slowly.

The main reason for so many pits is the dependency library problem of PIP installation software, especially: cryptography.

PIP installs the latest instead of the most stable version by default, and installs the latest version of cryptography (1.2.2 My installation time is early February 2016), so:

Sudo/usr/local/bin/pip Install cryptography==0.9

........ Ignoring warn

Successfully installed cryptography Idna pyasn1 six enum34 ipaddress cffi Pycparser
Cleaning up ...

It's more than half to get here, and then we'll take the lead:

Sudo/usr/local/bin/pip Install Scrapy
.........

successfully installed Scrapy pyopenssl queuelib service-identity lxml w3lib cssselect Twisted pyasn1-modules characteristic zope.interface
Cleaning up ...

[[email protected] ~]$ scrapy version
/usr/local/lib/python2.7/site-packages/cffi/model.py:526: Userwarning: ' point_conversion_form_t ' has no values explicitly defined; Next version would refuse to guess which integer type It's meant to be (unsigned/signed, Int/long)
 % self._ Get_c_name ())
Scrapy 1.0.4
continues to ignore the warning and has been frantic by these warnings.

$ scrapy Startproject Tutorial
/usr/local/lib/python2.7/site-packages/cffi/model.py:526:userwarning: ' point_conversion_form_t ' has no values explicitly defined; Next version would refuse to guess which integer type It's meant to be (unsigned/signed, Int/long)
% Self._get_c_name ())
New scrapy project ' tutorial ' created in:
/home/mikky/scrapy/tutorial

You can start your first spider with:
CD Tutorial
Scrapy Genspider Example example.com
[email protected] scrapy]$ LL
Total 4
Drwxrwxr-x. 3 Mikky mikky 4096 Feb 3 22:27 Tutorial

Installation is complete, I look for the cause of the error.

This article is from the "Devout Learning" blog, please be sure to keep this source http://chinghelp.blog.51cto.com/8639907/1741020

Centos6.5x64 Installation scrapy1.0.4 Successful