The solution of Python transcoding problem _python

For example, to convert a string object s from GBK inner code to UTF-8, you can do the following
S.decode (' GBK '). Encode (' utf-8′)
However, in actual development, I have found that this approach often appears to be abnormal:
Unicodedecodeerror: ' GBK ' codec can ' t decode bytes in position 30664-30665:illegal multibyte
This is because the illegal characters are encountered--especially in some programs written in C/s + +, full-width spaces are often implemented in many different ways, such as \xa3\xa0, or \xa4\x57, which appear to be full-width spaces, but they are not "legitimate" full-width spaces (true full-width spaces are \XA1\XA1), so there was an exception in the process of transcoding.
This is a headache because as long as an illegal character appears in the string, the entire string--sometimes the entire article--cannot be transcoding.

Solution:
S.decode (' GBK ', ' ignore '). Encode (' utf-8′ ')
Because Decode's function prototype is decode ([encoding], [errors= ' strict ']), you can control the error-handling strategy with the second parameter, the default parameter is strict, and the exception is thrown when an illegal character is encountered;
If set to ignore, illegal characters are ignored;
If set to replace, the illegal character is replaced with the.
If set to Xmlcharrefreplace, the character reference of the XML is used.

Python documentation

Decode ([encoding[, errors]])
Decodes the string using the codec registered for encoding. Encoding defaults to the default string encoding. Errors May is given to set a different error handling scheme. The default is ' strict ', meaning that encoding errors raise unicodeerror. Other possible values are ' ignore ', ' replace ' and ', ' or ' other ' name registered via Codecs.register_error, and the section 4.8.1.