Fluentd is an open source collection event and log system that currently offers 150 + extensions that let you store big data for log searches, data analysis and storage.
Official address http://fluentd.org/plugin address http://fluentd.org/plugin/
Kibana is a Web UI tool that provides log analysis for ElasticSearch, and it can be used to efficiently search, visualize, analyze, and perform various operations on logs. Official Address http://www.elastic
Label:Elasticsearch has a plug-in module called River that can import data from an external data source into a elasticsearch and index it. The river is a singleton pattern on the cluster, it is automatically assigned to a node, and when the node is hung, the river is automatically assigned to another node. Currently supported data sources include: Wikipedia, MongoDB, CouchDB, RabbitMQ, RSS, Sofa, JDBC, File
First, the cluster roleNodes in a multi-machine cluster can be divided into master nodes and data nodes, using the Zen Discovery (Zen discovery) mechanism in the configuration file to manage different nodes. Zen Discovery is the default discovery mechanism that comes with ES, using multicast to discover other nodes. As soon as you start a new ES node and set the same name as the
, and then stores the index on the Shard.Replicas is a backup,Elasticsearch uses the Push replication mode , when you index a document above the Master Master Shard, The Shard copies the document To all the remaining replica replica shards, these shards will also index this document. I personally think this model is very nice, sometimes the index of a document may produce a large index file, will be very much bandwidth, and only transfer the original
Elasticsearch-head is a Elasticsearch cluster management tool, which is a standalone web program written entirely by HTML5, and you can integrate it into ES via plugins. or directly download the source code, open index.html locally to run it. The GIT address for this tool is: Https://github.com/Aconex/elasticsearch-hea
Elasticsearch-head is a elasticsearch cluster management tool, which is a standalone web program written entirely by HTML5, and you can integrate it into ES via plugins. or directly download the source code, open index.html locally to run it. The GIT address for this tool is: Https://github.com/Aconex/elasticsearch-hea
For details about how to import logs to elasticsearch clusters Through flume, see flume log import to elasticsearch clusters.Kibana Introduction
Kibana Homepage
Kibana is a powerful elasticsearch data display client. logstash has built-in kibana. You can also deploy kibana separately. The latest version of kibana3 is a pure HTML + JS client, it can be convenient
Log into the Elasticsearch cluster via flume see here: Flume log import ElasticsearchKibana IntroductionKibana HomeKibana is a powerful elasticsearch data display Client,logstash has built-in Kibana. You can also deploy Kibana alone, the latest version of Kibana3 is pure html+jsclient. can be very convenient to deploy to Apache, Nginx and other httpserver.Address
The file you need to edit is a config/elasticsearch.yml file The items that need to be configured are: # Use a descriptive name for your cluster:# cluster.name:hadoop##------------------------------------Node--------- ---------------------------# # Use a descriptive name for the node:# #node. Name:nn2 node.name: ${hostname}## Set The Bind a Ddress to a specific IP (IPV4 or IPV6): # network.host:192.168.56.122## Set a custom port for http:## http.port:
command
Curl-xput http://localhost:9201/_cluster/settings-d '
{
"persistent": {
"Discovery.zen.minimum_master _nodes ": 2
}
}"This is a permanent configuration, priority is higher than the configuration in the configuration file, you should modify the configuration, whether you are adding a node or deleting a node.
To view the current minimum_master_nodes value of a configuration cluster
Curl-xget localhost:9200/_cluster/settings
At
Package Cn.test;import Java.net.inetaddress;import Java.net.unknownhostexception;import Org.elasticsearch.client.transport.transportclient;import Org.elasticsearch.common.settings.settings;import Org.elasticsearch.common.transport.inetsockettransportaddress;public class Elktest {//private static final String Cluster_Name = "Cluster_Name"; public static final String cluster_name = "Elasticsearch"; Instance name//private static final String IP
Elasticsearch is a very popular full-text search engine, but online tutorials are mostly used for the first time, and there are no advanced usage demos. This encounter need to cross-network segment network problems, their own exploration of the document for a long time, found to be feasible, so began to do an experiment, the final experiment success. Automatic discovery and networking are implemented under cross-network segments.A total of three nodes
Httptest4net is a tool that can customize HTTP stress testing, and users can write test cases to load into httptest4net and run tests according to their own circumstances. Because of the recent need to test the Elasticsearch search cluster in a different situation, a simple test case was written for the test. Code[Test ("ES base")] public class Es_searchurltester:iurltester {public Es_searchurltester () {
Httptest4net is a tool that can customize HTTP stress testing, and users can write test cases to load into httptest4net and run tests according to their own circumstances. Because of the recent need to test the Elasticsearch search cluster in a different situation, a simple test case was written for the test.Code1[Test ("ES Base")]2 Public classEs_searchurltester:iurltester3 {4 5 Publ
First, IntroductionElasticsearch is a Lucene-based search server. It provides a distributed multi-user-capable full-text search engine, based on a restful web interface. Elasticsearch is a popular enterprise-class search engine developed in Java and published as an open source under the Apache license terms. Designed for cloud computing, it can achieve real-time search, stable, reliable, fast, easy to install and use.Second,
Oracle Cluster Health Monitor (CHM)IntroductionOverviewCluster Health Monitor( CHM) is an Oracle -provided tool for automating the collection of operating system resources (CPU, memory, The use of SWAP, process,I/O, and network, etc.). the CHM collects data once per second. These system resource data are for diagnosing the node reboots of the
Nodes in a multi-machine cluster can be divided into master nodes and data nodes, using the Zen Discovery (Zen discovery) mechanism in the configuration file to manage different nodes. Zen Discovery is the default discovery mechanism that comes with ES, using multicast to discover other nodes. As soon as you start a new ES node and set the same name as the cluster, the node is added to the cluster.Select 19
Bigdesk is a cluster monitoring tool of Elasticsearch, which can be used to view the various states of ES cluster, such as CPU, memory usage, index data, search condition, HTTP connection number, etc.Project git address: Https://github.com/lukas-vlcek/bigdesk. Like head, it is also a standalone web program, using the same way as head.Plug-in Installation run:1, B
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.