At present, there are several open-source distributed log systems in the industry, such as notify + rsync, Facebook's scribe, Apache's chukwa, linkin's kafa, and cloudera's flume. For more information about these open-source distributed log systems, see this article. Article 1. Although these open-source log systems provide real-time log tail output functions, however, after the tail process goes down, it c
Java uses WebSocket + tail commands to implement real-time Web logs
In Linux, you often need to view the Real-Time Output content of log files.tail -fOrtaifCommand. To view Real-time logs, you may need to first connect to the Linux host through SSH. The steps are troublesome. If the server is in the production environment, various permissions may be controlled. W
1. View logs for a certain period of time#cat Hdfs-audit.log | Sed-n '/2018-04-11 10:00:00/,/2018-04-11 10:01:00/p ' | More---Direct use time period#cat Hdfs-audit.log | Sed-n '/2018-04-11 09:[0-9][0-9]/,/2018-04-11 10:[0-9]:[0-9]/p ' | More---Use regular expressions#sed查看log时间段 (sed-n '/start/,/end/P ' p is printed out, D is deleted)2. View the end of the log 100 lines#tail-F-N-Hdfs-audit.log3. Delete file
in the following two steps:
Docker Daemon creates a user-specified process/bin/bash, so/bin/bash's parent process is Docker Daemon
Docker Daemon sets limits for process P5, such as the isolation Environment (namespaces) in which the container's main process P1 is joined, and is subject to resource constraints (Cgroup) as other processes
In Linux monitoring System log, can use Rsyslog, but rsyslog regardless of application service log, to simple implementation of real-time monitoring remote system log should do. (Note: Real-time, simple)
With the tail command you can continue to update, plus SSH remote commands, as well as Cron, plus a simple script for the keyword.
1, first realize SSH free login
, refer to other ready-made bar: ssh password-free login.
It is strange that if you
position represented by the number variable. - F If the input file is a regular file or if the filename parameter specifies a FIFO (first in, out), then the tail command does not terminate after the last specified unit of the input file is copied, but continues to read and copy additional units from the input file (when those cells are available). If the File parameter is not specified and the standard input is a pipe, the-f flag is ignored.The
I recently added support for Docker container logs in the Log collection feature. This article simply talks about strategy selection and how to handle it.
About the container log for DockerI'm not going to say much about Docker, it's going to be hot for two years. Recently I was also deploying some components of the log system into
Attach Attachment Container
Attach can only be used for interactive containers, not for background containers, when we start an interactive container with Docker start or Docker restart, the container is interactive but the container does not have a terminal associated with it. This allows the attach command interaction container to be associated with a terminal.First, give some of the columns.Docker run-i
Log is a very important part of the system, through the log can be found in time the problems in the system, but also to provide clues to repair problems. Docker provides a variety of plug-in ways to manage logs, and this article records the process of using MongoDB to store Docker logs.Data FlowCreated with Raphaël 2.1.2
Start
to the Nginx master process.
After the Nginx master process receives the signal, it does some processing and then asks the worker process to reopen the log file
Worker process opens a new log file and closes the old log file
In fact, we really need to do the work only two points ahead!
Create a test environment
Assuming that you have Docker installed in your system, here we run an nginx container directly:
$
The basic configuration of Docker + Fluentd + MongoDB was completed in the previous article, "Using the MongoDB storage Docker log." However, in the actual use of the process, but found that Docker generated logs are not immediately written to the MongoDB, there are about 1 minutes of delay.
Consult the FLUENTD documen
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.