How to conduct robot detection

There are three ways the robot can be detected by the server:

The first, using HTTP's user-agent header for inference, is the most normal inference, but this does not detect unfriendly requests, it can forge.

Another way to limit the frequency of requests. That is, flow control. It is impossible for an ordinary user to request multiple times within a certain time, so it can be detected.

But the requester is able to do it randomly. Time limit to request.

The Third Kind. According to the log analysis to detect robot, so that can detect slow robot.

Original: http://blog.csdn.net/hongchangfirst/article/details/24704869

Author: Hongchangfirst

Hongchangfirst's homepage: http://blog.csdn.net/hongchangfirst

How to conduct robot detection