Python Data Analysis 8-----Web page Text Processing

1, remove the label of the page, such as <br/>

 from Import beautifulrsoup predata=beautifulsoup (data,'html.parser'). Get_text ()

2. Remove punctuation, etc., with regular expressions.

Import RE
#表示将data中的除了大小写字母之外的符号换成空格preData=re.sub (R'[^a-za-z]',' , data)

3. Lowercase the words in the text and separate the data with a space

Words=data.lower (). Split ()

4. Remove discontinued words

# You can download the discontinued words yourself #   in Stopwords]

5. Connect all the words into one sentence

Sentence='. Join (words)

Python Data Analysis 8-----Web page Text Processing