Use phpcrawl to capture webpages. Some content on the webpage is displayed only after logon. Press F12 to find the URL of the ajax request. The URL format of the ajax request is www. *. comhelloworldajax. php? Id260 & amp; catkk & amp; time1442075455597 each need... use phpcrawl to capture webpages. Some content on the webpage is displayed only after logon. Press F12 to find the URL of the ajax request. The URL format of the ajax request is:
Http: // www.
*. Com/helloworld/ajax. php? Id = 260 & cat = kk & time = 1442075455597
Every page to be crawled has a request like this. How can this website be used?
Reply content:
Use phpcrawl to capture webpages. Some content on the webpage is displayed only after logon. Press F12 to find the URL of the ajax request. The URL format of the ajax request is:
Http: // www.*. Com/helloworld/ajax. php? Id = 260 & cat = kk & time = 1442075455597
Every page to be crawled has a request like this. How can this website be used?
The question mark is followed by the request field.
You can forge a request, set the header and cookie when sending the request, disguise your behavior as a browser, and then use crawlers to crawl the address.