Python uses a proxy server when collecting data based on Scrapy _python

This article describes the way Python uses a proxy server when  based on scrapy. Share to everyone for your reference. Specifically as follows:

# to authenticate the proxy, 
#you must set the proxy-authorization header. 
#You *cannot* Use the form http://user:pass@proxy:port 
#in request.meta[' proxy ']
import base64
Proxy_ip_ Port = "123.456.789.10:8888"
proxy_user_pass = "Awesome:dude"
request = Request (URL, callback=self.parse) # Set The location of the proxy
request.meta[' proxy ' = ' http://%s '% proxy_ip_port
# Setup Basic Authentica tion for the proxy
encoded_user_pass=base64.encodestring (proxy_user_pass)
request.headers[' Proxy-authorization '] = ' Basic ' + encoded_user_pass

I hope this article will help you with your Python programming.