Python processing Chinese coding and judgment coding sample _python

The following are all about python2.7.

Copy Code code as follows:

#coding: Utf-8
#chardet need to download the installation

Import Chardet
#抓取网页html
line = "Http://www.***.com"
Html_1 = Urllib2.urlopen (line,timeout=120). Read ()
#print Html_1
Encoding_dict = Chardet.detect (html_1)
#print encoding
web_encoding = encoding_dict[' encoding ']
if web_encoding = = ' Utf-8 ' or web_encoding = ' UTF-8 ':

HTML = Html_1
else:
html = Html_1.decode (' GBK ', ' ignore '). Encode (' Utf-8 ')

#有以上处理, the entire HTML will not be garbled.