Python crawler crawls the watercress reading

Recently used Python to write a watercress reading reptile play, convenient to gather all kinds of meimei books, share to everyone

Implementation features:

1 can climb down all the books under the Watercress Book label

2 Store by rating rank

3 stored in Excel, you can easily filter, such as screening evaluation of the number of >1000 high-score books; Different themes can be stored to excel different sheet

4 using the user agent disguised as a browser crawl, and add a random delay to better mimic browser behavior, to avoid the crawler is blocked

Try to crawl seventy thousand or eighty thousand books, there are book_list.xlsx, the results are as follows:

Detailed code and some of the results of crawling can move to Github:https://github.com/lanbing510/doubanspider

Python crawler crawls the watercress reading