windows win7配置pyspider

來源:互聯網
上載者:User
整個pyspider打包環境下載地址如下 http://download.csdn.net/detail/zengraoli/9620540

首先確保你安裝的是python2.7(32位,因為64位使用pyspider有些bug)

然後安裝easy_install(不是必須)

下載地址:https://pypi.python.org/pypi/ez_setup解壓easy_install安裝包,進入檔案夾中,執行python ez_setup.py


同理安裝pip

下載地址:https://pypi.python.org/pypi/pip解壓pip安裝包,進入檔案夾中,執行python setup.py install


配置環境變數

指向:C:\Python27\Scripts


安裝lxml-2.2.8.win-amd64-py2.7

雙擊安裝即可

下載:https://pypi.python.org/pypi/lxml/2.2.8

如出現Python version 2.7 required, which was not found in the registry

裝需要拷貝如下內容到檔案register.py(建立到任意位置)中,使用python執行即可

## script to register Python 2.0 or later for use with win32all# and other extensions that require Python registry settings## written by Joakim Loew for Secret Labs AB / PythonWare## source:# http://www.pythonware.com/products/works/articles/regpy20.htm## modified by Valentine Gogichashvili as described in http://www.mail-archive.com/distutils-sig@python.org/msg10512.html import sys from _winreg import * # tweak as necessaryversion = sys.version[:3]installpath = sys.prefix regpath = "SOFTWARE\\Python\\Pythoncore\\%s\\" % (version)installkey = "InstallPath"pythonkey = "PythonPath"pythonpath = "%s;%s\\Lib\\;%s\\DLLs\\" % (    installpath, installpath, installpath) def RegisterPy():    try:        reg = OpenKey(HKEY_CURRENT_USER, regpath)    except EnvironmentError as e:        try:            reg = CreateKey(HKEY_CURRENT_USER, regpath)            SetValue(reg, installkey, REG_SZ, installpath)            SetValue(reg, pythonkey, REG_SZ, pythonpath)            CloseKey(reg)        except:            print "*** Unable to register!"            return        print "--- Python", version, "is now registered!"        return    if (QueryValue(reg, installkey) == installpath and        QueryValue(reg, pythonkey) == pythonpath):        CloseKey(reg)        print "=== Python", version, "is already registered!"        return    CloseKey(reg)    print "*** Unable to register!"    print "*** You probably have another Python installation!" if __name__ == "__main__":    RegisterPy()

如不安裝,直接跳到下一步安裝pyspider會出現如下的問題:



配置phantomjs

把phantomjs.exe拷貝到Python27\Scripts中


安裝pyspider

pip install pyspider



啟動後台

pyspider all提示錯誤:

C:\Users\Administrator>pyspider allTraceback (most recent call last):  File "C:\Python27\Scripts\pyspider-script.py", line 5, in <module>    from pkg_resources import load_entry_point  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 2671, in <module>    working_set.require(__requires__)  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 654, in require    needed = self.resolve(parse_requirements(requirements))  File "C:\Python27\lib\site-packages\distribute-0.6.14-py2.7.egg\pkg_resources.py", line 552, in resolve    raise DistributionNotFound(req)pkg_resources.DistributionNotFound: six>=1.5.0

那是因為我們沒安裝distribute

pip install -U distribute

安裝之後可以看到如下資訊


在瀏覽器中配置和查看任務

http://localhost:5000/


相關文章

聯繫我們

該頁面正文內容均來源於網絡整理,並不代表阿里雲官方的觀點,該頁面所提到的產品和服務也與阿里云無關,如果該頁面內容對您造成了困擾,歡迎寫郵件給我們,收到郵件我們將在5個工作日內處理。

如果您發現本社區中有涉嫌抄襲的內容,歡迎發送郵件至: info-contact@alibabacloud.com 進行舉報並提供相關證據,工作人員會在 5 個工作天內聯絡您,一經查實,本站將立刻刪除涉嫌侵權內容。

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.