Simulate the browser -- Headers attribute and the headers attribute

Simulate the browser -- Headers attribute and the headers attribute

Method 1: Use build_opener () to modify the header

1 import urllib. request2 url = "https://www.cnblogs.com" 3 headers = (4 "User-Agent", 5 "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) chrome/64.0.3282.186 Safari/537.36 "6) 7 opener = urllib. request. build_opener () 8 opener. addheaders = [headers] 9 data = opener. open (url ). read ()

Method 2: Use add_header () to add a header

Import urllib. requesturl = "http://blog.csdn.net/column.html" req = urllib. request. Request (url) req. add_header (
"User-Agent", "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.186 Safari/537.36"
) Data = urllib. request. urlopen (req). read ()