Installation of Python crawler modules

Installation of 1.Requests modules

1 PIP3 Install requests

1 # Call: 2 Import Requests 3 4 response = Requests.get ('https://www.baidu.com')5 6 Print (Response.url) 7 Print (Response.text)

View Code

2.selenium + webdriver Module

Installing Selenium

1 pip3 Install Selenium

View Code

Installation Webdriver (Chromedriver for example)

1. Click to download the corresponding version of course the local computer to install Google Chrome

2. Unzip and copy the. exe file to the script directory under the Python3 directory

3. Installation Complete

1 # called 2  from Import Webdriver 3 browser = webdriver. Chrome ()4 browser.get ('https://www.baidu.com')

View Code

Installation of Python crawler modules