Share an example of setting up a Python scrapy IP proxy

In the Scrapy project, build a Python directory that is similar to the spider and add a py file with the contents below

# encoding:utf-8import Base64proxyserver = Proxy server address # #我的是 ': 9010 ' # Proxy tunneling authentication Information  This is the application on that website Proxyuser = Username Proxypass = password P Roxyauth = "Basic" + base64.b64encode (Proxyuser + ":" + Proxypass) class Proxymiddleware (object):    def process_request (Self, request, spider):        request.meta["proxy"] = ProxyServer        request.headers["proxy-authorization"] = Proxyauth added in the setting file

Downloader_middlewares = {    ' project name '. Spider sibling file name. Proxymiddleware ': 543,} code address