Scrapy Installation Scripts
#
###### install dependent package and development-lib ###### #yum -y install gcc zlib zlib-devel openssl openssl-devel bzip* libxml2* libxslt* libffi-devel libffi####### install python-2.7.7wget ' https:// Www.python.org/ftp/python/2.7.7/Python-2.7.7.tgz ' tar -zxvf python-2.7.7.tgzcd python-2.7.7./ Configuremake && make install####### modified yum for os-pythonsed -i s/python$/python2.6/ /usr/bin/yum####### modified os-python to python 2.7mv /usr/bin/python /usr/bin/python.bakln -s /usr/local/bin/python2.7 /usr/ bin/python####### install setuptools cdwget https://bitbucket.org/pypa/setuptools/raw/ bootstrap/ez_setup.pypython ez_setup.py####### install pip toolscdwget ' https:// bootstrap.pypa.io/get-pip.py ' Python get-pip.pypip -v####### install twistedcdwget https://pypi.python.org/packages/source/t/ twisted/twisted-14.0.0.tar.bz2#md5=9625c094e0a18da77faa4627b98c9815tar -jxf twisted-14.0.0.tar.bz2cd twisted-14.0.0python setup.py install####### install Scrapypip install scrapypip list
centos6.3 installing the Python crawler Framework Scrapy