Questions about text crawling dead links of the snoopy class in php
Source: Internet
Author: User
About the text of php snoopy crawling dead links, when snoopy crawls dead links, the program will end. I want to make a crawler, however, the system fails to crawl a link that cannot be opened. if The spoony file fails to be linked for 30 seconds, it fails .. What can I do to make it jump to the next link after a dead link .... Please advise. Newbie, please don't worry. set your php timeout to 0. about the text of php snoopy crawling dead links
When snoopy crawls the dead link, it will end the program. I want to make a crawler, but it will fail after it crawls the link that cannot be opened, if the spoony file fails to be connected within 30 seconds .. What can I do to make it jump to the next link after a dead link .... Please advise. Newbie, please
------ Solution --------------------
You should not set your php timeout to 0.
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.
A Free Trial That Lets You Build Big!
Start building with 50+ products and up to 12 months usage for Elastic Compute Service
