View the file encoding in Linux, convert the file or file name encoding format

If you need to operate files in Windows in Linux, you may frequently encounter file encoding conversion problems. In Windows, the default file format is GBK (gb2312), while Linux is generally a UTF-8. The following describes how to view the file encoding in Linux and how to convert the file encoding. 1. view the file encoding:
You can view the file encoding in Linux in the following ways:
1. You can directly view the file encoding in vim.
: Set fileencoding
The file encoding format is displayed.
If you only want to view files in other encoding formats or want to solve the problem of using Vim to View File garbled characters, you can
~ /. Add the following content to the vimrc file: set encoding = UTF-8 fileencodings = ucs-bom, UTF-8, cp936, vim can automatically identify the file encoding (can automatically identify the UTF-8 or GBK encoding files), in fact, according to the fileencodings provided by the encoding list to try, if not find the appropriate encoding, it is opened in Latin-1 (ASCII) encoding. 2. enca (if this command is not installed in your system, you can use sudo Yum install-y enca to install it) to view the file encoding.
$ Enca filename
Filename: Universal Transformation Format 8 bits; UTF-8
CRLF line Terminators
Note that enca does not recognize some GBK-encoded files very well:
Unrecognized Encoding
Ii. file encoding and conversion
1. Convert the file encoding directly in Vim. For example, convert a file to UTF-8 format.
: Sets fileencoding = UTF-8 2. iconv conversion. The iconv command format is as follows:
Iconv-F encoding-T encoding inputfile
For example, converting a UTF-8-encoded file into GBK Encoding
Iconv-f gbk-T UTF-8 file1-O file2 3. enconv conversion file encodingFor example, to convert a GBK encoded file into a UTF-8 code, the operation is as follows:
Enconv-l zh_cn-x UTF-8 filename Iii. File Name encoding conversion:When copying files from Linux to Windows or from windows to Linux, Chinese file names may be garbled. This problem occurs because the Chinese encoding of Windows file names is GBK by default, in Linux, the default file name encoding is utf8. Because the encoding is inconsistent, the file name is garbled. To solve this problem, you need to transcode the file name. A tool is provided in Linux. ConvmvTo convert the file name encoding, you can convert the file name from GBK to UTF-8 encoding, or from the UTF-8 to GBK. First, check whether convmv is installed on your system. If not, use:
Yum-y install convmv
Install. Next, let's take a look at the specific usage of convmv: convmv-f Source Code-t new encoding [Options] common parameters for file names:
-R recursive processing of subfolders
-Notest: the actual operation is not performed on the file by default, but is only a test.
-List: displays all supported codes.
-UNESCAP can be used as an escape, for example, % 20 is converted into a space.
For example, we have a utf8 encoded file name, converted to GBK encoding, the command is as follows: convmv-F UTF-8-t gbk-notest utf8 encoded file name
In this way, the "utf8 encoded file name" will be converted to GBK encoding (only the file name encoding conversion will not change the file content) Iv. Vim EncodingLike all popular text editors, VIM can well edit a variety of character encoding files, which of course include popular unicode encoding methods such as UCS-2 and UTF-8. Unfortunately, like a lot of software from the Linux world, you need to set it yourself. Vim has four options related to the character encoding method: encoding, fileencoding, fileencodings, and termencoding. for possible values of these options, see Vim online help: Help encoding-names ), their significance is as follows: * encoding: The character encoding method used inside vim, including the buffer (buffer), menu text, and Message Text of vim. By default, it is recommended to change the value of locale only in. vimrc in the user manual. In fact, it only makes sense to change the value in. vimrc. You can use another encoding method to edit and save files. For example, if your vim encoding is UTF-8, the edited file uses cp936 encoding, vim will automatically convert the Read File to UTF-8 (Vim can read), and when you write the file, it will automatically convert it back to cp936 (the file storage encoding ). * fileencoding: The character encoding method of the file currently edited in Vim. When saving the file, VIM also saves the file as this encoding method (whether new files are used or not ). * Fileencodings: Vim automatically detects the fileencoding sequence list. At startup, it detects the character encoding methods of the files to be opened one by one based on the character encoding methods listed in it, set fileencoding to the character encoding method that is finally detected. Therefore, it is best to put the Unicode encoding method at the beginning of this list, and put Latin1 in the latin1. * Termencoding: The character encoding method of the terminal (or Windows Console window) operated by VIM. If Vim is encoded in the same term as vim, you do not need to set it. Otherwise, you can use the termencoding option of VIM to automatically convert it to the term encoding. this option is invalid for gvim in common GUI mode in windows, but Vim in Console mode is the code page in Windows console, and we usually do not need to change it. 5. Vim multi-character encoding1. Start vim and set the encoding mode of the buffer, menu text, and message text based on the encoding value set in. vimrc. 2. Read the file to be edited and test the file encoding method one by one based on the character encoding methods listed in fileencodings. And set fileencoding to the detected character encoding method, which looks correct (note 1. 3. compare the values of fileencoding and encoding. If they are different, call iconv to convert the file content to the character encoding method described by encoding, and put the converted content in the buffer opened for this file, now we can edit this file. Note: To complete this step, you need to call the external iconv. dll (note 2). You need to ensure that this file exists in $ vimruntime or other columns in the PATH environment variable directory. 4. When saving the file after editing, compare the values of fileencoding and encoding again. If different, call iconv again to convert the text in the buffer to the character encoding method described by fileencoding, and save it to the specified file. Similarly, you need to call iconv. DLL because Unicode can contain characters in almost all languages, and the Unicode UTF-8 encoding method is a very cost-effective encoding method (less space consumption than UCS-2 ), therefore, we recommend that you set the encoding value to UTF-8. Another reason for doing so is that when encoding is set to UTF-8, VIM will automatically detect more accurate file encoding methods (maybe this is the main reason ;). For Files edited in Chinese Windows, to ensure compatibility with other software, the file encoding is set to gb2312/GBK. Therefore, fileencoding is recommended to be set to Chinese (Chinese is an alias, indicates gb2312 in UNIX, cp936 in windows, that is, the GBK code page ).