[Learning Record] NLTK Common Operation One (go to the page mark, statistic word frequency, go to stop using words)

NLTK is a very popular NLP library in the Python environment, and this record mainly records some common operations of NLTK

1. Remove HTML markup for Web pages

We often get web information through crawlers, and then we need to remove HTML tags from our web pages. For this we can do this:

2. Statistical frequency

The tokens used here is the tokens in the image above.

3. Remove discontinued words

A stop word is a semantic word that is like the,a,of, and we can get the statistics out after we take it out.

4. Draw the word cloud

The use of the word cloud image is not clear, but to find a working formula

　　

[Learning Record] NLTK Common Operation One (go to the page mark, statistic word frequency, go to stop using words)