Python web crawlers capture images

Steps for capturing network images using python:

1. Obtain the webpage source code based on the given URL

2. Use regular expressions to filter out the image addresses in the source code

3. Download the network Image Based on the filtered image address

 

Import reimport urllibdef getHtml (url): page = urllib. urlopen (url) html = page. read () return htmldef getImg (html): reg = r'src = "(. +? \. Jpg) "pic_ext 'imgre = re. compile (reg) imglist = imgre. findall (html) x = 0 for imgurl in imglist: urllib.urlretrieve(imgurl,'{s.jpg '% x) x = x + 1 html = getHtml ("http://tieba.baidu.com/p/2460150866") getImg (html)