Python uses get to search Baidu and saves the first page of search results

Python uses get to search Baidu and saves the first page of search results

Python uses get to search Baidu and saves the first page of search results

 

Author: vpoet

Date: about summer

Note: Do not worry about how I feel.

 

 

# Coding: utf-8import urllibimport urllib2import re "use GET to query on Baidu search engine this example shows how to generate GET string and request. "if _ name __= =" _ main _ ": url =" http://www.baidu.com/s "search = [('w', 'qq')] getString = url + "? "+ Urllib. urlencode (search) req = urllib2.Request (getString) fd = urllib2.urlopen (req) baiduResponse = "" while 1: data = fd. read (1024) if not len (data): break baiduResponse + = data fobj = open ("baidu.html", 'w') fobj. write (baiduResponse) fobj. close ()

 

The web page saved by searching QQ is:

Open and check:

Then compare it with Baidu's search QQ results:

Yes, it is the same. The webpage we saved has no images because the html structure of the webpage we saved has not downloaded the image link from the server.