How to crawl all tweets of a user on twitter? -

Currently, there are two methods: 1. directly call the twitter API to read the tweets of a specific user, but the API parameters only have a limit on the number of returned entries, and there is no offset parameter. This means that only the "most recent" n tweets can be returned, rather than crawling all the tweets. 2. you can use an HTTP request to simulate the user's access behavior on the browser. You can read the last 20 tweets, but you do not know how to send an HTTP request to simulate the user drop-down operation to load earlier tweets. There are currently two methods:
1. directly call the twitter API to read the tweets of a specific user. However, the API parameter only has a limit on the number of returned items, and there is no offset parameter. This means that only the "most recent" n tweets can be returned, rather than crawling all the tweets.
2. you can use an HTTP request to simulate the user's access behavior on the browser. You can read the last 20 tweets, but you do not know how to send an HTTP request to simulate the user drop-down operation to load earlier tweets. Response: https://dev.twitter.com/docs/api/1.1/get/statuses/user_timeline

If there is a road, you may want to dig tunnels.


The API has no parameters, so please read the document carefully. In the browser, perform the pull-down and load operations. Use the packet capture software to capture packets and analyze the HTTP request parameters to track the ajax Event requests on the website of the other party. Then, based on the ajax request rules, try again, or simulate the pulling action, use the jq trigger.