Crawl to the page content is
The crawl program gets a status code of 200
Crawl the browser link with fiddler to discover that the status code is 302
The header has location:/(E24a2c455vo1xe45nlqfme55)/default2.aspx
Is it because Curl crawled to the JS page because it was timed 700 milliseconds to jump so curl thought no jump stopped? How does this work? Do you match it with regular?
Reply content:
Crawl to the page content is
The crawl program gets a status code of 200
Crawl the browser link with fiddler to discover that the status code is 302
The header has location:/(E24a2c455vo1xe45nlqfme55)/default2.aspx
Is it because Curl crawled to the JS page because it was timed 700 milliseconds to jump so curl thought no jump stopped? How does this work? Do you match it with regular?
In 2 steps, the first step to catch you this page, extract JS link. The second step is to grab the link corresponding page in JS.
You may want to be aware of synchronizing cookies on multiple pages. You can check the manual Curl Cookiejar cookiefile in detail.
Because the crawler is not a browser and does not execute code within the script