Python crawler DOTA ranking crawling instance (SHARE), pythondota

Python crawler DOTA ranking crawling instance (SHARE), pythondota

1. Analyze the website

Open the developer tool and we can see that the ranking data is not in the doc.

 

Doc

In Javascript, I can see the following code:

Ajax post method asynchronously requests data

In the XHR column, we find the requested data

Json-stored data

The request field is:

Post request field

2. disguise the browser and save the json data into the excel file.

Obtain information

Save data to excel

3. Result Display

The above Python crawler DOTA ranking crawling instance (SHARE) is all the content shared by the editor. I hope you can give us a reference and support the house of helping customers.