Python訪問google

搞了超過4個小時才搞定的，對web cookie訪問這塊不熟，發現增加【opener.addheaders = [('User-agent', 'Opera/9.23')] 】就可以正常訪問了。這裡記錄一下。

import urllib,urllib2,cookielib
cj = cookielib.CookieJar()
url = 'http://www.google.cn/search?hl=zh-CN&q=test&meta=&aq=f&oq='
opener=urllib2.build_opener(urllib2.HTTPCookieProcessor(cj))
opener.addheaders = [('User-agent', 'Opera/9.23')]
urllib2.install_opener(opener)
req=urllib2.Request(url)
response =urllib2.urlopen(req)
content = response.read().decode('utf-8')
print content