/elasticsearch/elasticsearch-0.90.5 bin/elasticsearch -fAccess the default 9200 portcurl -X GET http://localhost:9200Installing LogstashLogstash Homecd /searchsudo mkdir logstashcd logstashsudo wget http://download.elasticsearch.org/logstash/logstash/logstash-1.2.1-flatjar.jarLogstash download can be used, command line parameters can refer to Logstash flags, mainlyagent #运行Agent模式-f CONFIGFILE #指定配置文件web #自动Web服务-p PORT #指定端口,默认9292Installing KibanaThe latest version of Logstash has built-
, sorting and statistics and the large number of machines still use such a method is a little too hard.
Open source real-time log analysis Elk platform can perfectly solve our problems above, elk by Elasticsearch, Logstash and Kiabana three open source tools. Official website: https://www.elastic.co/products
Elasticsearch is an open source distributed search engine, it features: distributed, 0 configuration, automatic discovery, Index auto-shard, inde
, spontaneous self-collection, centralized is collected centrally, a server receives all shipper (personal understanding is Logstash agent) log.Actually logstash itself does not divide what shipper and collector, just is the configuration file is different, we this time in the centralized way to testThere are two servers here.192.168.124.128 Logstash INDEX,ELASTICSEARCH,KIBANA,JDK192.168.124.132 Logstash AG
/configuration/config. js/2** === Parameters*/Return new Settings ({Elasticsearch: "http: // 10.128.170.245: 9200 ",....
Use
You can easily open http: // localhost: 8080/kibana. The previous section contains almost the most frequently-typed characters except "hello world :).
As shown in the preceding figure, you only need to pay attention to the lower left corner of the right panel: Sample Dashboard, Uncon
.el7_5.1.i686 contains libstdc++.so.6, installed.[[emailprotected] data]# yum install libstdc++-4.8.5-28.el7_5.1.i686Back to execute./kibana is no problem.About the configuration of KibanaIf it is installed on the virtual machine Kibana, want to open the Kibana page on their own windows, you need to change the
Installation Rpm-ivh elasticsearch-5.5.0.rpmConfigurationFind the installation directory Whereis elasticsearch//Enter the installation directory cd/etc/elasticsearch//edit the Profile VI elasticsearch.ymlMain configuration network.host (native IP) and http.port (default 9200) (current single-node mode, other parameters refer to official documentation)Start the serviceOpen port 9200firewall-cmd--add-port=9200/tcp--permanent//Reload
$ Bin/elasticsearch is easy to decompress. Next, let's take a look at the effect. First, start the es service, switch to the elasticsearch directory, and run elasticsearch under bin.
cd /search/elasticsearch/elasticsearch-0.90.5/bin./elasticsearch start
Access the default port 9200
curl -X GET http://localhost:9200
3. Start the service
# elasticsearch-1.1.1/bin/elasticsearch # logstash-1.4.2/bin/logstash -f logstash-1.4.2/conf/logstash-apache.conf
2.5 deploy
with ZK IP for connection useTOPIC_ID is the topic Logstash set in Kafka/etc/logstash/conf.d/logstashes.conf
Input {Kafka {Zk_connect => "10.0.0.13:2181"topic_id => "Logstash"}}Filter {Mutate {Split => ["Upstreamtime", ","]}Mutate {Convert => ["Upstreamtime", "float"]}}Output {Elasticsearch {Hosts => ["10.0.0.21"]Index => "logstash-iamle-%{+yyyy. MM.DD} "Document_type => "Iamle"Workers => 5Template_overwrite => True}}Supplementary notes
The above is the main
).
Downloadwget https://download.elasticsearch.org/kibana/kibana/kibana-3.1.2.tar.gzAfter decompression, put the Kibana directory where webserver can access it.
ConfigurationModify Kibana/config.js:
"http://192.168.91.128:9200",#这里实际上是浏览器直接访问该地址连接elasticsearch否则
source, distributed, restful search engine built on Lucene. Designed for cloud computing, it can achieve real-time search, stable, reliable, fast, easy to install and use.Elasticsearch 1.4.2:http://www.elasticsearch.org/download/2 , Logstash: is a fully open source tool that collects, analyzes, and stores your logs for later use (e.g., search), which you can use. When it comes to search, Logstash comes with a web interface that searches and displays all logs.logstash-1.4.2.tar.gzhttp://www.elas
[root@biluos kibana]# cd ../[root@biluos es]# lltotal 12drwxr-xr-x 4 es es 4096 Feb 9 14:55 elasticsearchdrwxr-xr-x 7 es es 4096 Feb 25 11:05 elasticsearch-head-masterdrwxr-xr-x 4 root root 4096 Feb 10 11:56 kibana[root@biluos es]#
This is the root user, but it does not affect kibana startup.
3. modify configuration
Download the installation packageGo to official website https://www.elastic.co/cn/downloadsDownload Kibana, get kibana-5.0.0-linux-x86_64.tar.gzUnzip the installationCopy the kibana-5.0.0-linux-x86_64.tar.gz to the/OPT directory.Extract to current directory, use command TAR-ZXVF kibana-5.0.0-linux-x86_64.tar.gzTo delet
Official website about Kibana's Learning Guide website is: https://www.elastic.co/guide/en/kibana/current/index.htmlKibana is an open source analytics and visualization platform designed for Elasticsearch. Use Kibana to search, view, and interact with data stored in the Elasticsearch index. You can easily perform advanced data analysis and visualize data across a variety of charts, tables, and maps.Kibana m
simple
Curl-l http://toolbelt.treasure-data.com/sh/install-redhat.sh | Sh
After the installation is complete, edit the configuration file
# vim/etc/td-agent/td-agent.conf
Start the FLUENTD service
# service Td-agent Start
III. installation and Deployment Kibana 3
Kibana 3 is a Web UI front-end tool developed using HTML and JavaScript.
Download wget http:/
Tags: proxy art type password Authentication elastics pass Title Temp-dir GPO
6 Installing Nginx
6.1 Installing NginxInstalling Pcre,zlib,openssl,nginx6.2 Generate Web Access user passwordhtpasswd–c–b/usr/local/nginx/conf/passwd/kibana. passwd User pass1236.3 Configuring Proxy forwardingvim/usr/local/nginx/conf/nginx.conf# Add the following configuration at the end of the
Official website https://www.elastic.coSoftware version: Logstash 2.2.0 all Pluginselasticsearch 2.2.0Kibana 4.4.0Note: This environment becomes Centos6.5 64 bits, the single machine does the test, the specific configuration is simple.1.Logstash installation ConfigurationUnzip to/usr/local/logstash-2.2.0/Logstash configuration file:Vim/usr/local/logstash-2.2.0/etc/agent.confInput {file {path = '/usr/local/n
I. Environmental preparedness
Role
SERVER IP
Logstash Agent
10.1.11.31
Logstash Agent
10.1.11.35
Logstash Agent
10.1.11.36
Logstash Central
10.1.11.13
Elasticsearch
10.1.11.13
Redis
10.1.11.13
Kibana
10.1.11.13
The architecture diagram is as follows:650) this.width=650; "src=" Http:
Objective
process, NIGNX format log into JSON, Logstash directly to Elasticsearch, and then through the Kibana GUI interface display analysis
Important NIGNX Log into JSON format, avoid nignx default log is a space, need a regular match, resulting in logstash too much CPUThe Elasticsearch machine configures the firewall, allowing only the specified Logstash machine accessKibana only listens for local 127.0.0.1 use NIGNX direction Agent, Nginx Config
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.