How to collect data is not discovered. using curl to collect other websites will be captured by the webmaster tools of other websites .. I know that a link always visits him regularly .. Is there any way to collect data without leaving any trace? you have to look at people's anti-cheating policies. It is best to capture packets first to see if there are mouse tracks or session cookies. In addition, it may also be determined based on how the collection is not discovered.
Use curl to collect others' websites
It will be captured by other website Webmaster Tools ..
I know that a link always visits him regularly ..
Is there any way to collect data without leaving any trace ..
------ Solution --------------------
You have to look at people's anti-cheating strategies.
It is best to capture packets first to see if there are mouse tracks or session cookies. In addition, it may also be limited according to your ip address, so you need to use the proxy server to brush.
------ Solution --------------------
Search for the useragent of Baidu Spider. simulate it. if he wants to prevent Baidu from catching it, he will use software.
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.
A Free Trial That Lets You Build Big!
Start building with 50+ products and up to 12 months usage for Elastic Compute Service
