Python Method for counting the number of log ip addresses and the number of ip addresses in python logs

Python Method for counting the number of log ip addresses and the number of ip addresses in python logs

This article describes how to collect ip address counts in python. Share it with you for your reference. The details are as follows:

import ref=open("/tmp/a.log","r")arr={} lines = f.readlines()for line in lines:   ipaddress=re.compile(r'^#(((2[0-4]\d|25[0-5]|[01]?\d\d?)\.){3}(2[0-4]\d|25[0-5]|[01]?\d\d?))')  match=ipaddress.match(line)  if match:     ip = match.group(1)     if(arr.has_key(ip)):       arr[ip]+=1     else:       arr.setdefault(ip,1) f.close() for key in arr:   print key+"->"+str(arr[key])

Log format:

#111.172.249.84 - - [12/Dec/2011:05:33:36 +0800] "GET /images/i/goTop.png HTTP/1.0" 200 486 "http://wh.xxxx.com/" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)" #111.172.249.84 - - [12/Dec/2011:05:33:36 +0800] "GET /images/i/goTop.png HTTP/1.0" 200 486 "http://wh.xxxx.com/" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)" #111.172.249.85 - - [12/Dec/2011:05:33:36 +0800] "GET /images/i/goTop.png HTTP/1.0" 200 486 "http://wh.xxxx.com/" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)" #111.172.249.86 - - [12/Dec/2011:05:33:36 +0800] "GET /images/i/goTop.png HTTP/1.0" 200 486 "http://wh.xxxx.com/" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/5.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E)" 

Output result:

111.172.249.86->1111.172.249.84->2111.172.249.85->1

Note: The setdefault usage of the python field is to obtain information. If the information cannot be obtained, set this value according to its parameters.

>>> A ={}>>> a ['key'] = '000000' >>> print (a) {'key ': '20140901' >>> print (. setdefault ('key', '000000') # display the 'key' value of the dictionary, so I won't set it to 123> print (. setdefault ('key1', '000000') # display the 'key1' value of the Dictionary a, because the dictionary does not exist, so it is set to 456 456 >>> a {'key1': '20160301', 'key': '20160301 '}

I hope this article will help you with Python programming.