China A shares analysis system---core subject crawler

Crawl the content of a page first, and then gradually improve.

#Oriental Wealth A core theme crawler system 0.1#python version: 2.7#ImportUrllib2ImportUrllibImportRe#build a reptile class Hexin_spiderclassHexin_spider:def __init__(self):Pass    #SCODE is a stock code, considering whether to use tuples to pass in  defGetPage (self,scode): Myurl="http://f10.eastmoney.com/f10_v2/CoreConception.aspx?code="+Scode myreq=Urllib2. Request (myurl) myresponse=Urllib2.urlopen (myreq) MyPage=myresponse.read () unicodepage= Mypage.decode ("Utf-8") MyItems= Re.findall ('<div class= "Summary" > (. *?) </div>', Unicodepage)#returns the content of the captured core subject matter.     returnMyitems[0]

China A shares analysis system---core subject crawler