How to solve the problem of string encode and decode garbled

Why error "UnicodeEncodeError: & amp; 39; ascii & amp; 39; codeccan & amp; 39; tencodecharactersinposition0-1: ordinalnotinra why error" UnicodeEncodeError: 'ascii 'codec can't encode characters in position 0-1: ordinal not in range (128 )"? This article will focus on this issue.

The character string is unicode encoded in Python. Therefore, during encoding and conversion, unicode is usually used as the intermediate encoding, that is, the other encoded strings are decoded into unicode, then, convert the unicode encoding (encode) into another encoding.

The function of decode is to convert other encoded strings to unicode encoding, such as str1.decode ('gb2312'), which means to convert the string str1 encoded in gb2312 to unicode encoding.

Encode is used to convert unicode to other encoded strings, for example, str2.encode ('gb2312'), which means to convert the unicode encoded string str2 to gb2312 encoding.

Therefore, during transcoding, you must first understand the encoding of the str string, decode into unicode, and then encode into other encodings.

The default encoding of strings in the code is the same as that of the code file.

For example, s = 'Chinese'

If it is in the utf8 file, the string is UTF-8 encoded. if it is in the gb2312 file, it is encoded as gb2312. In this case, you must first use the decode method to convert the encoding to unicode encoding, and then use the encode method to convert it to other encoding. Generally, when no specific encoding method is specified, the system creates the code file by default encoding.

If the string is defined as follows: s = u'chinese'

Then the encoding of the string is specified as unicode, that is, the internal encoding of python, which is irrelevant to the encoding of the code file. Therefore, to perform encoding conversion in this case, you only need to directly use the encode method to convert it to the specified encoding.

If a string is unicode and then decoded, an error occurs. Therefore, you must determine whether the encoding method is unicode:

Isinstance (s, unicode) # used to determine whether it is unicode

Encode reports an error if str is not encoded in unicode format.

How do I obtain the default encoding of the system?

#!/usr/bin/env python#coding=utf-8import sysprint sys.getdefaultencoding()

The program output in this section is ascii on Windows XP.

In some IDEs, the output of strings is always garbled or even incorrect. In fact, the IDE result output console itself cannot display the encoding of strings, rather than the program itself.

For example, run the following code in UliPad:

S = u "Chinese" print s

The following message is displayed: UnicodeEncodeError: 'ascii 'codec can't encode characters in position 0-1: ordinal not in range (128 ). This is because the UliPad console information output window on Windows XP is output according to ascii encoding (the default English system encoding is ascii), and the strings in the above code are Unicode encoded, therefore, an error occurs during output.

Change the last sentence to print s. encode ('gb2312 ')

Then, the word "Chinese" can be correctly output.

If the last sentence is changed to print s. encode ('utf8 ')

The output is \ xe4 \ xb8 \ xad \ xe6 \ x96 \ x87. this is the result of utf8 encoded strings in the console information output window according to ascii encoding.

Unicode (str, 'gb2312') is the same as str. decode ('gb2312 ').

You can use str. class to view the str encoding format.

After talking about the principle for a long time, let's try to fix all the problems :)

The code is as follows:

#! /Usr/bin/env python # coding = UTF-8 s = "" if isinstance (s, unicode): # s = u "" print s. encode ('gb2312') else: # s = "Chinese" print s. decode ('utf-8 '). encode ('gb2312 ')

The above is the detailed description of how to solve the string's encode and decode garbled problem. For more information, see other related articles in the first PHP community!