vpc flow log analysis

Log analysis!Analyze the last five minutes of logs, take out the most visited Ip,url, and access traffic within five minutes#!/bin/shname= ' cat/etc/salt/minion|grep "^id" |awk ' {print$2} ' Ipaddr= '/sbin/ifconfig|grep "inetaddr" |egrep-v "10\.| 127\. " |awk-f ' [: ]+ ' ' {print$4} ' #LogPath = '/usr/local/tengine/logs/' # #日志的时间格式. Functiontime () {filetime= ' head-1 $Logfile |awk-f "[[/ NBSP:] " ' {prin

|awk ‘{print $1}‘|sort|uniq -c|wc -l4, access the log after the specified timecat access.log|awk ‘$4>"[23/Aug/2014:23:58:00"‘cat access.log|awk ‘($4>"[23/Aug/2014:23:58:00"){print $1}‘cat access.log|awk ‘($4>"[23/Aug/2014:23:58:00"){print $1}‘|sort|uniq -c|sort -nr5. Access the log for the specified resourcecat access.log|awk ‘$7 ~/.html$/‘cat access.log|awk ‘($7 ~/.html$/){print $1 " " $7 " " $9}‘cat acces

Log analysis!Analyze the last five minutes of logs, take out the most visited Ip,url, and access traffic within five minutes#!/bin/shname= ' cat/etc/salt/minion|grep "^id" |awk ' {print$2} ' Ipaddr= '/sbin/ifconfig|grep "inetaddr" |egrep-v "10\.| 127\. " |awk-f ' [: ]+ ' ' {print$4} ' #LogPath = '/usr/local/tengine/logs/' # #日志的时间格式. Functiontime () {filetime= ' head-1 $Logfile |awk-f "[[/ NBSP:] " ' {prin

The system transportation and the development personnel can through the log to understand the server hardware and software information, examines the configuration process the error and the error occurrence reason. Regular analysis of the log can understand the server load, performance security, so as to take timely measures to correct errors. The role of the

There are many methods to analyze the crash log in Mac OS. Here we do not want to explain how to analyze the crash log, mainly to show the usage of Hopper. The powerful Ida may already be known, but its Mac OS version has brought us back to the DOS era. Fortunately, Mac OS has a small alternative: Hopper, which basically meets the need for disassembly at work, including pseudoCodeAnd control

Storm is developed using the Clojure language, but you can write applications in any language in storm, all you need is an adapter that connects to the storm's schema. There are already adapters for Scala, JRuby, Perl, and PHP, but there are also structured Query language adapters that support streaming to the Storm topology.　　 Key properties of StormSome of the features of Storm's implementation determine its performance and reliability. Storm uses ZeroMQ to deliver messages, w

In the day-to-day operation of the flow of traffic will find the phenomenon of sudden increase or increase in server load and so on, in order to find out why, need to use the Nginx limit module to access IP restrictions, and then can analyze the log.Configure Nginx to restrict IP access and configure multiple zone. Limit_req_zone $binary _remote_addr zone=allips:10m rate=20r/s; Parse script for the resulting nginx

format only show hours ggplot(message,aes(x=time,y=size)) + geom_line() + labs(title="时间-流量图",y=‘size(KB)‘) + scale_x_datetime(breaks=date_breaks("1 hour"),labels= date_format("%H")) Save picture ggsave(filename=‘e:/R/时间-流量图-分.jpg‘,width=15,height=8) Statistics URL Access times graph ggplot(message)+ geom_bar(aes(x=url)) + coord_flip() + labs(x=‘url‘,y=‘count‘) Pie chart ggplot(message)+ geom_bar(aes(x=factor(1),fill=url)) + coord_polar(theta=‘y‘) + labs(x=‘‘,y=‘‘)ggsave(filename=‘e:/R