Python + Jquery, crawl Java Tutorials Resource URLs on the West East web

#!/usr/bin/env python#-*-coding:utf-8-*-#@Date: 2018-06-15 14:01:45#@Author: Chenjun ([email protected];)#@Link: http://example.org#@Version: $Id $ fromPyqueryImportPyquery as Pqurl='http://xidong.net/File001/File_25266.html'Lis= []defGet_resource_lis (URL): Doc= PQ (Url=url, encoding='Utf-8') #响应头部没有声明编码类型, manual instructions are required, otherwise the captured data will be garbled in Chinese datas= Doc ('TR') #通过网页检查发现资源放在表格的tr中 Resource_lis=Datas.items ()returnLisdefMain (): Resource_lis=Get_resource_lis (URL) forSourceinchResource_lis:Print(Source.find ('a'). attr ('href') #取到每个tr中的a标签的href属性值, which is the address I need
if __name__=='__main__': Main ()

#后续可以存储到非关系型数据库中

Python + Jquery, crawl Java Tutorials Resource URLs on the West East web