Python Simple web crawler

Since python2.x and python3.x are very different, python2.x calls urllib with instruction Urllib.urlopen (),

Run times wrong: Attributeerror:module ' urllib ' has no attribute ' Urlopen '

The reason is that urllib.request should be used in python3.x.

After the download page is successful, call the Webbrowsser module and enter the instruction Webbrowsser

. Open_new_tab (' baidu.com.html ')

True

Open (' baidu.com.html ', ' W '). Write (HTML)

Writes the downloaded Web page to the specified directory, but the downloaded page is 0KB, opens the display blank, and then changes the code to

Open (' baidu.com.html ', ' WB '). Write (HTML)

You can open it.

ImportUrllib>>>Importurllib.request>>>defgethtml (URL): page=urllib.request.urlopen (URL) HTML=Page.read ()returnHTML>>>ImportWebBrowser>>> Webbrowser.open_new_tab ('baidu.com.html') True>>> Open ('baidu.com.html','WB'). Write (HTML)

Python Simple web crawler