Python implements a simple crawler to get updated data for a web of knives

When I was bored last night, I tried to practice python, so I wrote a little reptile to get a knife. Update data in the entertainment network

[Python]View PlainCopy

2. #!/usr/bin/python
4. # Coding:utf-8
8. Import Urllib.request
10. Import re
12. #定义一个获取网页源码的子程序
14. Head = "www.xiaodao.la"
16. Def get ():
18. data = Urllib.request.urlopen (' http://www.xiaodao.la '). Read ()
20. #解码并去除无用文字
22. str = Data.decode ("GBK"). Replace (R"Font-weight:bold;", ""). Replace (R " ," "). Replace (" "," "). Replace (" "," "). Replace (" \ r \ n",""). Replace ("#FF0000 "," #000000 "). Strip ()
24. return Str[str.find ("good Card Sale"): Str.find ("20160303184868786878.gif")]#返回指定内容
26. #获取一次网页源码并赋值给str
28. str = GET ();
30. #print (str)
34. #定义正则表达式
36. #reg = R ' href= "(. *?)" style= "COLOR: #000000;" Title= "(. *?)" target= "_blank" > "
38. Reg = R' href= "(. *?)" style= "COLOR: #000000;" Title= "(. *?)" target= "_blank" > (. *?) </a></div></td><tdwidth=12.5%align=rightnowrap=nowrapstyle= "COLOR: #F00;" > (. *?) </td> '
42. TMP = Re.compile (reg); #创建正则表达式
44. List = Re.findall (TMP,STR); #正则表达式匹配
46. List = tuple (list)#转换类型
50. Print ("total matches%d"% (len (list))#输出匹配数量
52. #print (list)
56. For I in range (len (list)):
58. print ("current%d:"% (i+1))
60. print ("title:%s\n Address:%s Update time:%s\n"% (list[i][1],head + list[i][0],list[i][3]))

Python implements a simple crawler to get updated data for a web of knives