Python File Write encoding problem

Today, writing files in Python, it is not easy to find the Chinese, any programming problems need to learn a more than the foreigner to deal with coding methods. Did you finish the JSP? Consider the problem of Chinese coding; The URL in the servlet, the text that is forwarded, is likely to be related to what gb2312,isoxxxx,utf-8,unicode,ascii. So, we often encounter running anomalies, will be "once bitten for ten years afraid of twice shy" like thinking "is not the result of coding."

In Python, coding is still a disgusting problem. Previously, in the context of the VS for Python IDE, the Chinese code has suffered, and it seems that the VS for Python source file does not support encoding formats other than ASCII, which directly causes the interpreter to run abnormally if I forcibly save it. It is not resolved until you go to Pydev for Eclipse.

Today, using Python to write files, which are automatically crawled from the Internet data, direct error "Unicodeencodeerror: ' ASCII ' codec can ' t encode characters in position 0-1: ordinal Not in range (128) ".

Why is the error "Unicodeencodeerror: ' ASCII ' codec can ' t encode characters in position 0-1: Ordinal not in range (128)"? This article is to study this problem.

The representation of a string inside Python is Unicode encoding, so in encoding conversion, it is usually necessary to use Unicode as the intermediate encoding, that is, decoding the other encoded string (decode) into Unicode first. From Unicode encoding (encode) to another encoding.

The role of Decode is to convert other encoded strings into Unicode encodings, such as Str1.decode (' gb2312 '), to convert gb2312 encoded string str1 into Unicode encoding.

The role of encode is to convert Unicode encoding into other encoded strings, such as Str2.encode (' gb2312 '), to convert Unicode encoded string str2 to gb2312 encoding.

Therefore, the transcoding must first understand, the string str is what encoding, and then decode into Unicode, and then encode into other encodings

The default encoding of the string in the code is consistent with the encoding of the code file itself.

such as: s= ' Chinese '

If it is in a UTF8 file, the string is UTF8 encoded, and if it is in a gb2312 file, it is encoded as gb2312. In this case, to encode the conversion, you need to first convert it to Unicode encoding using the Decode method, and then use the Encode method to convert it to another encoding. Typically, you create a code file by using the system default encoding when you do not specify a specific encoding method.

If the string is defined like this: S=u ' Chinese '

The encoding of the string is specified as Unicode, which is the internal encoding of Python, regardless of the encoding of the code file itself. Therefore, for this case to do the encoding conversion, only need to directly use the Encode method to convert it to the specified encoding.

If a string is already Unicode, then decoding will be an error, so it is common to determine whether it is encoded as Unicode:

Isinstance (S, Unicode) #用来判断是否为unicode

Encode with a non-Unicode encoded form of STR will error

How do I get the default encoding for my system?

#!/usr/bin/env python#coding=utf-8import sysprint sys.getdefaultencoding ()

The program is printed on the English windowsxp as: ASCII

In some Ides, the output of a string is always garbled, or even wrong, because the IDE's result output console itself cannot display the encoding of the string, rather than the problem of the program itself.

As in Ulipad, run the following code:

S=u "Chinese"

Print S

Prompt: Unicodeencodeerror: ' ASCII ' codec can ' t encode characters in position 0-1: Ordinal not in range (128). This is because ulipad on the English WindowsXP console information Output window is ASCII encoded output (the default encoding of the English system is ASCII), and the string in the above code is Unicode encoded, so the output generated an error.

Replace the last sentence with the following: Print S.encode (' gb2312 ')

Can correctly output "Chinese" two words.

If the last sentence should read: Print S.encode (' UTF8 ')

The output: \xe4\xb8\xad\xe6\x96\x87, which is the result of the Console Information Output window UTF8 encoded strings in ASCII encoded output.

Unicode (str, ' gb2312 ') is the same as Str.decode (' gb2312 '), which converts gb2312 encoded STR to Unicode encoding

Use str.__class__ to view the encoded form of STR

Principle said a half-day, the last to a package cure all ills it:)

Copy the code code as follows:

#!/usr/bin/env python #coding =utf-8 s= "Chinese" if isinstance (S, Unicode): #s =u "Chinese" Print s.encode (' gb2312 ') Else: #s = "Chinese" prin T S.decode (' utf-8 '). Encode (' gb2312 ')

--------------------------------------------------------------------------------------------------------------- --

I add the. Encode (' UTF8 ') after all the strings to be written.

Numbers can be directly used with STR ()

Of course the source file header is

#coding: utf-8#import sys #reload (SYS) # #sys. setdefaultencoding (' Utf-8 ')

Python File Write encoding problem