Solve the unicodeencodeerror problem during scrapy shell startup.

In Windows, the command line encoding is cp936, while the D: \ python27 \ scripts \ scrapy script encoding is Unicode. If you start the command line, the encoding problem may occur.

Solution: Modify the scrapy file under D: \ python27 \ scripts \. Add the following code to this file:

Import sys
Default_encoding = 'cp936'
If SYS. getdefaultencoding ()! = Default_encoding:
Reload (sys)
SYS. setdefaultencoding (default_encoding)

When scrapy runs a crawler, if uincodeencodeerror occurs, add the above Code to the program file to solve the encoding problem.