Python crawler Tutorials -25-Data Extraction-BEAUTIFULSOUP4 (iii)

Python crawler Tutorials -25-Data Extraction-BEAUTIFULSOUP4 (iii)

This article describes the CSS selectors in BeautifulSoup

CSS Selector

• Use Soup.select to return a list
• By tag name: Soup.select ("title")
• By class Name: Soup.select (". Centent")
• ID Lookup: Soup.select ("#name_id")
• Combination lookup: Soup.select ("div #input_content")
• Property Lookup: Soup.select ("img[class= ' photo ']")

• Get tag content: Tag.get_text

  Case
• Code 27bs5.py File: https://xpwi.github.io/py/py%E7%88%AC%E8%99%AB/py27bs5.py

# BeautifulSoup 的使用案例# css 选择器from urllib import requestfrom bs4 import BeautifulSoupurl = ‘http://www.baidu.com/‘rsp = request.urlopen(url)content = rsp.read()soup = BeautifulSoup(content, ‘lxml‘)# bs 自动解码content = soup.prettify()print("=="*12)titles = soup.select("title")print(titles[0])print("=="*12)meta = soup.select("meta[content=‘always‘]")print(meta[0])

Run results

-This note does not allow any person or organization to reprint

Python crawler Tutorials -25-Data Extraction-BEAUTIFULSOUP4 (iii)