hadoop log analysis tool

AWStats is a Perl-based web log analysis tool, while jawstats is a PHP-based statistical suite designed to provide a more elegant graphic interface for AWStats. 1. installing and configuring awstatsawstats is simple, but you must first confirm that the Perl environment on your server is ready. Considering that the website traffic is not large, the daily nginx

Note that Symbolicatecrash is an error log analysis tool that can be used independently.While the iphone is connected to Xcode, it is possible to view the device logs directly, but more crashes occur after we have distributed the IPA (either test or shelves). Therefore, if we are fortunate enough to get the logs from the user, then Symbolicatecrash will be able t

Project Introduction Tika is a content analysis tool that comes with a comprehensive parser tool class. It can parse basic files in all common formats, get the metadata, content, and other content of the file, and return the formatting information. In general, it can be used as a common parsing tool. It is particularly

http://blog.csdn.net/y461517142/article/details/26269529 Tools Introduction Tprofiler is a performance analysis tool that can be used for a long time in a production environment. It also supports both profiling and sampling, recording the time and frequency of the execution of the method, generating hot-spot objects, creating hotspot thread-state analysis data, a

.log (7) Save the query to the Query_review table PT-query-digest--user=root–password=abc123--review h=localhost,d=test,t=query_review--create-review-Table Slow.log (8) Save the query to the Query_history table PT-query-digest--user=root–password=abc123--review H=localhost,d=test,t=query_ history--create-review-Table slow.log_20140401 PT-query-digest--user=root–password=abc123--review h=localhost,d=test,t=query_history--create-review-Table slow.log_20

Again record elk of the building, personally feel very troublesome, suggest or build under the Linux system, performance will be better, but I was built under Windows, or record it, like my memory poor people still have to rely on bad writingBrief introduction:Elk consists of three open source tools, Elasticsearch, Logstash and Kiabana:Elasticsearch is an open source distributed search engine, it features: distributed, 0 configuration, automatic discovery, Index auto-shard, index copy mechanism,

Tags: including verbose no binlog long second getting write betweenSummary: Masterha_master_switch is integrated as a switch tool in the MHA package, Install: After compiling and installing MHA Manager, binary executable program Masterha_master_switch will be generated in/usr/local/bin/. Use: $masterha_master_switch --help Usage: # For master failover masterha_master_switch --master_state=dead --global_conf=/etc/masterha_default.cnf -

Would have thought that the configuration of such a tool does not have a lot of strength, behind the discovery is completely not.First, a small episodeThe morning shows that the computer cannot display all the domain names under the virtual directory, but can open localhost and the database connection will not work. This question has haunted me for a morning. There is another problem is that the input method can not be displayed, after the download of

Label:The benefit of open source projects is that we are faced with what problems can be solved by looking at the source code. For example, a colleague recently asked me why the SQL statements were only printed when the error was jdbctemplate. I think, this is related to the configuration of log. We used slf4j as a log management tool in our system, and it was as

ArticleDirectory 1.2.configure bcompare.exe to create a BAT file, which is scheduled on a daily basis. For details about how to use bcompare, see help. 2.1 register com DLL 2.2. Reference com 2.3. Core code Recently, I used a website monitoring tool for chinamoocs. One of the main tasks is to analyze logs. I used AWStats for analysis and found that the data volume is large and the e

Elk is a elasticsearch+logstash+kibana combination, is an open-source distributed search platform, the purpose of building this platform is to facilitate the query log. Elasticsearch an open-source search engine framework, Logstash integrates a variety of collection log plug-ins, or a good regular cutting log tool;Kiba

This article focuses on DB2diag. how should I analyze the ZRC errors in the log database? I saw DB2diag on the relevant website two days ago. the information on how to analyze ZRC errors in the log database is quite good, so I will share it with you. Log, ZRC This post was last edited by Alan For some zrc code, there are two main methods for

Brief introduction:Elk consists of three open source tools, Elasticsearch, Logstash and Kiabana:Elasticsearch is an open source distributed search engine, it features: distributed, 0 configuration, automatic discovery, Index auto-shard, index copy mechanism, RESTful style interface, multi-data source, automatic search load, etc.Logstash is a fully open source tool that collects, filters, and stores your logs for later use (for example, search).Kibana

The maintenance script is a bit confusing, just as an example of how to quickly use the tool to achieve the goal quickly: Apply to: Shell and Python data interaction, data capture, encoding conversion The code is as follows: #coding: Utf-8#!/usr/bin/python'''Program Description: Apache access.log log AnalysisAnalysis of access to website IP sourcesDate: 2014-01-06 17:01author:gyh9711Program Description: A

Pipe: (NULL)Time Id Command Argument You can view the number of records in a slow query by using the following command: Mysql> show global status like '%slow% ';+ ——————— + ——-+| variable_name | Value |+ ——————— + ——-+| Slow_launch_threads | 0 || slow_queries | 0 |+ ——————— + ——-+ Generated logs we can use the Mysqlsla Slow query log analysis tool to deal wit