Basic crawler exercises-python crawlers download Douban Pictures

Download the pictures of the girl on the specified website. here, only the pictures on the first 100 pages are captured. you can set the cat value of the number of pages to the image type as needed. you can change the cat value on your own, if you have any questions, please leave a message to me and I will answer the question. 2 = big breasts and sisters 3 = beauty leg control 4 = face filter value 5 = hodgedge 6 =... download the pictures of the girl on the specified website. here, only the pictures on the first 100 pages are captured. you can set the page number as needed.
The cat value is of the image type. you can change the cat value and leave a message to me.
2 = big girl
3 = beauty control
4 = face filter
5 = hodgedge
6 = small hips

Import requestsimport reimport timefrom bs4 import BeautifulSoupcat = '2' img = 'http: // www.dbmeinv.com/dbgroup/show.htm? Cid = '+ catend ='/dbgroup/show.htm? Cid = '+ cat +' & pager_offset = 100 'urls = [] def getURLs (mainURL): time. sleep (1) headers = {'user-Agent': 'mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_2) AppleWebKit/537.36 (KHTML, like Gecko) chrome/47.0.2526.80 Safari/537.36 '} html = requests. get (mainURL ). text soup = BeautifulSoup (html, 'HTML. parser ') picURL = re. findall ('
More basic crawler exercises-python crawlers download Douban.com related articles!