What about hero? what should I do if I collect data from blocked ip addresses?
Source: Internet
Author: User
Where are the heroes, what should I do when I collect data from the blocked ip address, what should I do when I collect data from the blocked ip address, and how can I determine which imitation collection programs are used on the website, we have also changed how to avoid these collection simulation programs. No way, you can install the customer to complain about them, sleep () do not use brute force data collection. we collect data once every second. Otherwise, it may not be good for everyone. what should we do if we are a hero? what should we do if we collect data from the blocked ip address,
Where are the heroes, what should I do when I collect data and get an ip address? how can I determine what kind of imitation collection programs are used by the website? how can I avoid these imitation collection programs?
------ Solution --------------------
No way, you can pretend to complain to customers,
------ Solution --------------------
Sleep () you should not collect too much brute force data. we are collecting data every second. Otherwise, it is not good for everyone. Is it because your concurrency is so high.
------ Solution --------------------
This... except for changing your IP address, finding a proxy server, and forging an IP address, there is no other good way...
When people see that your IP address is frequently accessed, it is very easy to directly drop your IP address on the iptables screen...
------ Solution --------------------
Feng is crazy! Why do we give you the materials that have worked so hard?
------ Solution --------------------
Crazy. now that you know the ip address, use other servers to collect ip addresses.
Reduces the frequency and takes a long time
------ Solution --------------------
Sleep (60 )? If I block your ip address
I collected an article every few minutes.
------ Solution --------------------
Every few minutes, will the collection speed be slow?
But it seems that there is no way. after all, it is something of others.
------ Solution --------------------
You can use CURL to impersonate an IP address.
$ Headers ['client-IP'] = $ headers ['X-FORWARDED-FOR '] = '192. 168.1.1'; // use the IP address of the request address
$ HeaderArr = array ();
Foreach ($ headers as $ n => $ v ){
$ HeaderArr [] = $ n. ':'. $ v;
}
$ Refer = $ _ SERVER ["HTTP_REFERER"]
Curl_setopt ($ ch, CURLOPT_HTTPHEADER, $ headerArr); // Construct an IP address
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.