How to view web crawler records on the apache server

Q: On the Apache server, how can I check which website crawlers have crawled on my website or which IP addresses have accessed our website?

A: Access Logging through the Apache server!

The access log name of the Apache server is named access_log by default in linux, and the access. log file is used in windows.

How to configure: configure the following two statements in the httpd. conf file:

LogFormat "% h % l % u % t \" % r \ "%> s % B" common
CustomLog/home/admin/work/hz-jean/com. jean. deploy/logs/access_log common

The first sentence defines the log format, and the second sentence defines the location where logs are stored.

Earlier versions (earlier than 2.0) of Apache may use transferLog instead of CustomerLog.

LogFormat "% h % l % u % t \" % r \ "%> s % B \" % {Referer} I \ "\" % {User-agent} I \ ""

TransferLog logs/access_log

How to view access logs:

 
 

 
Enter the previous IP address in the IP address query, and the queryer will help you find its HOSTNAME, such as Baidu spider or Zhejiang Telecom.



Author's fruit candy