Objective
process, NIGNX format log into JSON, Logstash directly to Elasticsearch, and then through the Kibana GUI interface display analysis
Important NIGNX Log into JSON format, avoid nignx default log is a space, need a regular match, resulting in logstash too much CPUThe Elasticsearch machine configures the firewall, allowing only the specified Logstash machine accessKibana only listens for local 127.
Getting Started
Elasticsearch is a real-time, distributed search and analysis engine. It can help you deal with large-scale data at an unprecedented rate.It can be used for full-text search, structured search and analysis, and of course you can combine the three.
Wikipedia uses ElasticsearchFor full-text search and highlighting keywords, as well as providing search suggestions such as Search-as-you-type, Did-you-mean, and more. United Kingdom
The Gua
The river module is provided in Elastisearch to obtain data from other data sources, which exist as Plug-ins, and existing River Plug-ins include:
River Pluginsedit
1. Supported by Elasticsearch
CouchDB River Plugin
RABBITMQ River Plugin
Twitter River Plugin
Wikipedia River Plugin
2. Supported by the Community
ActiveMQ River Plugin (by Dominik Dorn)
Amazon SQS River Plugin (by Alex Bogdanovski)
CSV River Plugin (by Martin Bednar)
Dropbox Ri
Elastisearch provides the river module to obtain data from other data sources. This function exists as a plug-in. Currently, the existing river plug-in includes
Elastisearch provides the river module to obtain data from other data sources. This function exists as a plug-in. The existing river plug-ins include: river pluginsedit 1. supported by Elasticsearch CouchDB River Plugin RabbitMQ River Plugin Twitter River Plugin Wikipedia River Plug
Elasti
1, first download Elasticsearch installation version: http://www.elasticsearch.org/downloads/JDK1.6X recommends the use of elasticsearch-0.90.13, The high Elasticsearch version does not support jdk1.6x, after the download is complete, unzip to the installation directory, into the installation directory of the Bin folder, run Elasticsearch.bat, after successful st
Prior to the installation, configuration and example of Linux under Elasticsearch, this article installs Elasticserach in a Windows environment. 1. DownloadElasticsearch-2.3.3.zip2. The JDK environment is required and is not introduced here.To see if there is a Java environment:java -version
1
1
3. UnzipUnzip the elasticsearch2.3.3 to a directory, such as D:\softwares_diy\elasticsearch
1. OverviewToday then "Elasticsearch actual combat-log monitoring platform" a article to share the follow-up study, in the "Elasticsearch real-log monitoring platform" in the introduction of a log monitoring platform architecture, then to share how to build a platform for deployment, Make an introductory introduction to everyone. Here is today's share directory:
Build a Deployment Elastic kit
R
ELK you can complete the following functions:L query log details by keywordL Monitoring System Operation statusL statistical analysis, such as the number of calls to the interface, execution time, success rate, etc.L automatically trigger message notification for abnormal dataL Log-based data miningElk can implement Splunk basic functionsSplunk is the engine of machine data. Use Splunk to collect, index, and leverage fast-moving computer data generated by all applications, servers, and devices (
Solr:
Advantages
1. SOLR has a larger, more mature user, development and contributor community.
2, support the addition of multiple formats of the index, such as: HTML, PDF, Microsoft Office series software format, as well as JSON, XML, CSV and other plain text format.
3, SOLR more mature and stable.
4, do not consider the index to search at the same time, faster.
Disadvantages
When indexing is established, search efficiency decreases and real-time index search efficiency is not high.
1. Download the zip package of the elasticsearch-1.2.1, decompress it, and double-clickElasticsearch. bat(For Windows) Start the server (Listening to port 9200 by default)
Access http: // localhost: 9200. If the following JSON data is displayed, the startup is successful.
2. Sample Code for client connection:
Package COM. jiaoyiping. othersimple;/*** created with intellij idea. * User: Jiao Yiping * Date: 14-7-8 * Time: * to change this template us
Original link: http://jingyan.baidu.com/article/48206aead42b53216bd6b372.htmlElasticsearch is a Lucene-based search server. It provides a distributed multi-user-capable full-text search engine, based on a restful web interface.Recently work needed, and then studied the next es. By the way, the process of learning is recorded, it is also convenient for a long time to review again, or other environment to configure the reference.Tools/Materials
JDK, ES installation package
Installing
Because of the limited machine, this article only makes the cluster test of 3 nodes in a single machine.1. Cluster test informationElasticsearch version: elasticsearch-2.4.1Windowns version: Win102, decompression elasticsearch-2.4.1.zip to any directory, install Elasticsearch-head plug-in.Execute command in ${eshome}\bin directory: Plugin install Mobz/
Note: Elasticsearch version: 1.4.2First, installation and configuration1. Download Elasticsearch-analysis-ik-master.zip from Https://github.com/medcl/elasticsearch-analysis-ik2. Unzip the Elasticsearch-analysis-ik-master.zipUnzip Elasticsearch-analysis-ik-master.zip3. enter
Excerpt from: http://www.mayou18.com/detail/nTxPQSyu.html "ElasticSearch Foundation" elasticsearch+spring Integrated maven dependenciesMaven DependencySpring-data-elasticsearch and Elasticsearch version correspondence table
Spring Data Elasticsearch
Recently, there is a business need, that is, full-text search keyword query list, and thus to Es learning, also learned half a month, to do a note, summed up their own learning process.
Learning a new technology alone, always inevitably take a lot of detours, in this recommendation Es Basic tutorial, right, learn the official website tutorial can be.
1) Elasticsearch: Authoritative guide
Https://www.elastic.co/guide/cn/
Tags: technology sharing inf latest allow head blank Fix set imgLinux installation Elasticsearch, Elasticsearch can not be started with the root user, the root user will be error refer to the log in the error details, how to solve this situation? The following small series for everyone to bring Linux installation Elasticsearch start error resolution, go and see i
While Elasticsearch can support full-text retrieval in a variety of languages, we don't want to switch to Elasticsearch as the backend database for the time being.
Of course, when you can store data in a Web application, write a copy of it to Elasticsearch, but it certainly pollutes the original business logic.
In the IT industry, as long as there is demand, ther
Elasticsearch provides developers with a set of restful interfaces based on the HTTP protocol, and only needs to construct a rest request and parse the JSON returned by the request for access to the Elasticsearch server. Elasticsearch API interface is rich in functionality, including clustering, monitoring, deployment management, etc., also contains commonly used
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.