nginx log parser

On the parsing of error_log instruction ----nginx-1.0.9--- Error_log configuration: Error_log Logs/xxx.log Error | Debug_core | Debug_alloc Main () {//... prefix =./configure--prefix ngx_init_cycle (ngx_cycle_t *old_cycle) {Log.log_leve L = ngx_log_notice; Log = Ngx_log_init () = $prefix + Ngx_error_log_path = $prefix/logs/error.log; Ngx_conf_param (ngx_conf_t *cf) {Ngx_error_log (

Nginx log analysis script: The code is as follows:Copy code Vi/mnt/logs/checklog. sh#! /Bin/bashEcho-e "################### 'date + % f'">/mnt/logs/400.txtEcho-e "################### 'date + % f'">/mnt/logs/URL.txtEcho-e "################### 'date + % f'">/mnt/logs/IP.txtCat $1 | wc-l>/mnt/logs/IP.txt # analyze IP addressCat $1 | awk-F '"

Nginx log Cutting Generation 1. nginx log cutting # crontab-e59 23 ***/usr/local/sbin/logcron. sh/dev/null 2> 1 [root @ count ~] # Cat/usr/local/sbin/logcron. sh 1 .#! /Bin/bash 2. log_dir = "/data/logs" 3. time = 'date + % Y % m % d' 4. /bin/mv $ {log_dir}/access_linuxtone.org.log $ {log_dir}/access_count.linuxtone.o

The interview will be quilt cover to the problem is: to give the Web server access logs, please write a script to statistics access to the top 10 of the IP? What are the top 10 requests for access? When you have a taste of goaccess, you understand that these problems, in addition to testing your script memorization ability, the only role is to install a or C.For nginx log analysis, there are many tools to m

To write a script :vim/usr/local/sbin/logrotate.sh//Join#!/bin/bashD= ' date-d '-1 day "+%f"[-d/tmp/nginx_log] | | Mkdir/tmp/nginx_logmv/tmp/access.log/tmp/nginx_log/$d. Log/etc/init.d/nginx Reload 2>/dev/nullcd/tmp/nginx_log/Gzip-f $d. Log #! /bin/bashDatedir= ' Date +%y%m%d '/bin/mkdir/home/logs/$datedir >/dev/null 2>1/bin/mv/home/logs/*.

Professional statistics website, such as Baidu Statistics, Google ANALYTICS,CNZZ and other statistical background to provide the webmaster commonly used statistical indicators, such as UV,PV, online time, IP, etc., in addition, because of network reasons, I found that Google Analytics will be more than Baidu statistics more than hundreds of of the IP, so want to write their own feet to understand the actual number of visits, but the access log based o

Deploy Nginx, look at the Nginx log, found that the value of Request_body is not recordedNginx log:192.168.1.1--2016-02-24t13:33:54+08:00post/rate_plan http/1.12002----0.0020.701192.168.1.1--2016-02-24t13:33:54+08:00post /rate_plan http/1.12002----0.0010.617192.168.1.1--2016-02-24t13:37:44+08:00post /rate_plan http/1.1

Nginx does not log unwanted access logsNginx does not record the log pointing to the elements of the site, why do you need to do so, under what circumstances need to do this:When calculating the log PV, generally do not need to statistics picture element of the log, because,

Because Nginx is not like Apache, has its own cutting log tool. So you need a script to do it.Vim/usr/local/sbin/nginx_logrotate.sh #定义脚本名称#!/bin/bashd= ' date-d '-1 day "+%f ' #定义时间变量, i.e. yesterday's time[-d/tmp/nginx_log] | | Mkdir/tmp/nginx_log #首先判断是否存在目录, does not exist create directorymv/tmp/access.log/tmp/nginx_log/$d. Log #移动日志到指定目录/etc/init.d/

Configure the log loop directly in the Nginx configuration file without using Logrotate or configuring cron tasks. You need to use the $time_iso8601 inline variable to get the time. $time _iso8601 format is as follows: 2015-08-07t18:12:02+02:00. The regular expression is then used to get the data for the desired time.split log by dayUse the following code block

configuration file　　Location ~. php$ { root html; Fastcgi_pass 127.0.0.1:9000; Fastcgi_index index. php; Fastcgi_param $document _root$fastcgi_script_name# Newinclude # New}3. Hide the entry fileA. If the code is in the root directory that the domain name points to, then// ... omit part of the code if $request _filename ) { rewrite ^ (. *) $ /index.php?s=$1 last ; Break ; }}B. If the code is under a subordinate directory th

When using Nginx as a reverse proxy, the client IP for Tomcat logging is not the real client IP, but the IP of the Nginx agent. To solve this problem, you can configure a new header in Nginx to store the $remote_add, and then Tomcat gets the record of this value. 1.Nginx New configuration: Proxy_set_header X-real

Regular mysql backupPut/etc/cron. hourly/Copy codeThe Code is as follows:#! /Bin/bashDUMP =/usr/local/webserver/mysql/bin/mysqldumpOUT_DIR =/data1/backup/DB_NAME = Database NameDB_USER = Database UserDB_PASS = Database Password# How much days backup mostDAYS = 3#12 hours agoMINS = 720# Core of scriptCd $ OUT_DIRDATE = 'date + % Y-% m-% d-% H'OUT_ SQL = "$ DATE. SQL"TAR_ SQL = "db-mongodate.tar.gz"$ DUMP -- default-character-set = utf8 -- opt-u $ DB_USER-p $ DB_PASS $ DB_NAME> $ OUT_ SQLTar-czf $

Regular mysql backup Put/etc/cron. hourly/ Copy codeThe Code is as follows :#! /Bin/bash DUMP =/usr/local/webserver/mysql/bin/mysqldump OUT_DIR =/data1/backup/ DB_NAME = Database Name DB_USER = Database User DB_PASS = Database Password # How much days backup most DAYS = 3 #12 hours ago MINS = 720 # Core of script Cd $ OUT_DIR DATE = 'date + % Y-% m-% d-% H' OUT_ SQL = "$ DATE. SQL" TAR_ SQL = "db-mongodate.tar.gz" $ DUMP -- default-character-set = utf8 -- opt-u $ DB_USER-p $ DB_PASS $ DB_NAME> $