Python crawler RP+BS4

Soup = BeautifulSoup (Html_doc)

Soup is BeautifulSoup processing the formatted string, Soup.title get the title tag, SOUP.P gets the first P tag in the document, to get all the tags, you have to use Find_all

Function.

The Find_all function returns a sequence that loops through it, and then gets the thought in turn.

Get_text () is the return text, which is the label of every BeautifulSoup processed object. You can try print soup.p.get_text ()

In fact, you can get other properties of the tag, such as I want to get the value of the href attribute of the A tag, can use print soup.a[' href ', similar to other properties, such as Class is also available (soup.a[' class ').

In particular, some special tags, such as head tags, can be obtained through soup.head, in fact, the front has already said.

Python crawler RP+BS4