Centos6.5x64 Installation scrapy1.0.4 Successful

Source: Internet
Author: User

Recently in the self-study crawler frame scrapy, read the crossing Web document, can't wait to install. The results are all wrong and miserable. Online Search an article, (original link Http://www.tuicool.com/articles/URNVV3E).

First, introduce the following environment:

1, Centos6.5 x64 installed in the VMware virtual machine, because the later need to be ported, then chose compatible vm10.0.

# yum-y Update

Upgrade the System

2, Python2.7.9. The system comes with 2.6.6.

CD ~/download

Pipe network Download Source:

wget--no-check-certificate Https://www.python.org/ftp/python/2.7.9/Python-2.7.9.tar.xz

Tar xvf python-2.7.9.tar.xz

CD Python-2.7.9

./configure--with-ensurepip=install #其余保持默认


sudo make install # if python2.7.9 is a sub-version, use made Altinstall

[[email protected] python-2.7.9]$ Python
Python 2.7.9 (default, Feb 1 2016, 21:30:54)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-16)] on linux2
Type "Help", "copyright", "credits" or "license" for more information.

Upgrade the next libffi-devel because of stepping on it too much, so directly and updated the next, this step to choose to do:

sudo yum install update libffi-devel

The environment is ready, the following is the Pit link O (╯-╰) o

Installation Failure Method:

Sudo/usr/local/bin/pip Install Scrapy

A lot of mistakes, the reference to the first link is still unresolved. The pit won't stick out, step on it slowly.

The main reason for so many pits is the dependency library problem of PIP installation software, especially: cryptography.

PIP installs the latest instead of the most stable version by default, and installs the latest version of cryptography (1.2.2 My installation time is early February 2016), so:

Sudo/usr/local/bin/pip Install cryptography==0.9

........ Ignoring warn

Successfully installed cryptography Idna pyasn1 six enum34 ipaddress cffi Pycparser
Cleaning up ...

It's more than half to get here, and then we'll take the lead:

Sudo/usr/local/bin/pip Install Scrapy

successfully installed Scrapy pyopenssl queuelib service-identity lxml w3lib cssselect Twisted pyasn1-modules characteristic zope.interface
Cleaning up ...

[[email protected] ~]$ scrapy version
/usr/local/lib/python2.7/site-packages/cffi/model.py:526: Userwarning: ' point_conversion_form_t ' has no values explicitly defined; Next version would refuse to guess which integer type It's meant to be (unsigned/signed, Int/long)
 % self._ Get_c_name ())
Scrapy 1.0.4
continues to ignore the warning and has been frantic by these warnings.

$ scrapy Startproject Tutorial
/usr/local/lib/python2.7/site-packages/cffi/model.py:526:userwarning: ' point_conversion_form_t ' has no values explicitly defined; Next version would refuse to guess which integer type It's meant to be (unsigned/signed, Int/long)
% Self._get_c_name ())
New scrapy project ' tutorial ' created in:

You can start your first spider with:
CD Tutorial
Scrapy Genspider Example example.com
[email protected] scrapy]$ LL
Total 4
Drwxrwxr-x. 3 Mikky mikky 4096 Feb 3 22:27 Tutorial

Installation is complete, I look for the cause of the error.

This article is from the "Devout Learning" blog, please be sure to keep this source http://chinghelp.blog.51cto.com/8639907/1741020

Centos6.5x64 Installation scrapy1.0.4 Successful

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.