整個pyspider打包環境下載地址如下 http://download.csdn.net/detail/zengraoli/9620540
首先確保你安裝的是python2.7(32位,因為64位使用pyspider有些bug)
然後安裝easy_install(不是必須)
下載地址:https://pypi.python.org/pypi/ez_setup解壓easy_install安裝包,進入檔案夾中,執行python ez_setup.py
同理安裝pip
下載地址:https://pypi.python.org/pypi/pip解壓pip安裝包,進入檔案夾中,執行python setup.py install
配置環境變數
指向:C:\Python27\Scripts
安裝lxml-2.2.8.win-amd64-py2.7
雙擊安裝即可
下載:https://pypi.python.org/pypi/lxml/2.2.8
如出現Python version 2.7 required, which was not found in the registry
裝需要拷貝如下內容到檔案register.py(建立到任意位置)中,使用python執行即可
## script to register Python 2.0 or later for use with win32all# and other extensions that require Python registry settings## written by Joakim Loew for Secret Labs AB / PythonWare## source:# http://www.pythonware.com/products/works/articles/regpy20.htm## modified by Valentine Gogichashvili as described in http://www.mail-archive.com/distutils-sig@python.org/msg10512.html import sys from _winreg import * # tweak as necessaryversion = sys.version[:3]installpath = sys.prefix regpath = "SOFTWARE\\Python\\Pythoncore\\%s\\" % (version)installkey = "InstallPath"pythonkey = "PythonPath"pythonpath = "%s;%s\\Lib\\;%s\\DLLs\\" % ( installpath, installpath, installpath) def RegisterPy(): try: reg = OpenKey(HKEY_CURRENT_USER, regpath) except EnvironmentError as e: try: reg = CreateKey(HKEY_CURRENT_USER, regpath) SetValue(reg, installkey, REG_SZ, installpath) SetValue(reg, pythonkey, REG_SZ, pythonpath) CloseKey(reg) except: print "*** Unable to register!" return print "--- Python", version, "is now registered!" return if (QueryValue(reg, installkey) == installpath and QueryValue(reg, pythonkey) == pythonpath): CloseKey(reg) print "=== Python", version, "is already registered!" return CloseKey(reg) print "*** Unable to register!" print "*** You probably have another Python installation!" if __name__ == "__main__": RegisterPy()
如不安裝,直接跳到下一步安裝pyspider會出現如下的問題:
配置phantomjs
把phantomjs.exe拷貝到Python27\Scripts中
安裝pyspider
pip install pyspider
啟動後台
pyspider all提示錯誤:
C:\Users\Administrator>pyspider allTraceback (most recent call last): File "C:\Python27\Scripts\pyspider-script.py", line 5, in <module> from pkg_resources import load_entry_point File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 2671, in <module> working_set.require(__requires__) File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 654, in require needed = self.resolve(parse_requirements(requirements)) File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 552, in resolve raise DistributionNotFound(req)pkg_resources.DistributionNotFound: six>=1.5.0
那是因為我們沒安裝distribute
pip install -U distribute
安裝之後可以看到如下資訊
在瀏覽器中配置和查看任務
http://localhost:5000/