Distributed Search Elasticsearch configuration file

Elasticsearch Config folder has two configuration files: Elasticsearch.yml and Logging.yml, the first is the basic profile of ES, the second is the log configuration file, ES is also used log4j to record the log, So the settings in the logging.yml are set according to the normal log4j configuration file. The following is the main explanation of the Elasticsearch.yml this file can be configured things.

Cluster.name:elasticsearch
Configure the ES cluster name, by default elasticsearch,es will automatically discover ES in the same network segment, if there are multiple clusters under the same network segment, you can use this attribute to distinguish different clusters.

Node.name: "Franz Kafka"
Node name, by default randomly specifies a name in the name list, which is in the Name.txt file in the Config folder in the ES jar package, which has many interesting names added by the author.

Node.master:true
Specifies whether the node is eligible to be elected node, by default True,es is the first machine in the default cluster as master, and if this machine hangs, it will be re-elected master.

Node.data:true
Specifies whether the node stores index data, which is true by default.

Index.number_of_shards:5
Sets the default index number of shards, which defaults to 5 slices.

Index.number_of_replicas:1
Sets the default number of index replicas, which defaults to 1 copies.

Path.conf:/path/to/conf
Sets the storage path of the configuration file, which is the Config folder under the ES root directory by default.

Path.data:/path/to/data
Set the storage path of the index data, the default is the Data folder in the ES root directory, you can set multiple storage paths, separated by commas, for example:
Path.data:/path/to/data1,/path/to/data2

Path.work:/path/to/work
Set the storage path for temporary files, which is the work folder in the ES root directory by default.

Path.logs:/path/to/logs
Set the storage path for the log file, which is the logs folder in the ES root directory by default

Path.plugins:/path/to/plugins
Set the storage path of the plug-in, by default the plugins folder in the ES root directory

Bootstrap.mlockall:true
Set to True to lock the memory. Because ES is inefficient when the JVM starts to swapping, make sure it does not swap, set the ES_MIN_MEM and ES_MAX_MEM environment variables to the same value, and ensure that the machine has enough memory allocated to ES. Also allow the Elasticsearch process to lock the memory, Linux can be through the ' ulimit-l Unlimited ' command.

network.bind_host:192.168.0.1
Sets the IP address of the binding, which can be either IPv4 or IPv6, which defaults to 0.0.0.0.

network.publish_host:192.168.0.1
Set the other node and the IP address of the node interaction, if not set it will automatically determine that the value must be a real IP address.

network.host:192.168.0.1
This parameter is used to set both Bind_host and Publish_host above two parameters.

transport.tcp.port:9300
Set the TCP port for interaction between nodes, which is 9300 by default.

Transport.tcp.compress:true
Sets whether to compress the data when TCP is transmitted, by default, false, not compressed.

http.port:9200
Sets the HTTP port for the external service, which defaults to 9200.

http.max_content_length:100mb
Set the maximum capacity of content, default 100MB

Http.enabled:false
Whether to use the HTTP protocol to provide services externally, the default is true, open.

Gateway.type:local
The gateway type, default to local file system, can be set to local file system, Distributed File System, Hadoop HDFs, and Amazon S3 Server, other file system Setup method next time.

Gateway.recover_after_nodes:1
Sets the data recovery at the start of N nodes in the cluster by default of 1.

Gateway.recover_after_time:5m
Sets the time-out for initializing the data recovery process, which is 5 minutes by default.

Gateway.expected_nodes:2
Set the number of nodes in this cluster, the default is 2, once the N nodes are started, data recovery will be done immediately.

Cluster.routing.allocation.node_initial_primaries_recoveries:4
When initializing data recovery, the number of concurrent recovery threads is 4 by default.

Cluster.routing.allocation.node_concurrent_recoveries:2
The number of concurrent recovery threads when adding a delete node or load balancer defaults to 4.

indices.recovery.max_size_per_sec:0
Set the bandwidth limit for data recovery, such as 100MB, which defaults to 0, which is unlimited.

Indices.recovery.concurrent_streams:5
Set this parameter to limit the number of concurrent streams to open when recovering data from other shards by default of 5.

Discovery.zen.minimum_master_nodes:1
Set this parameter to ensure that the nodes in the cluster can know the other N nodes that have a master qualification. The default is 1, for large clusters, you can set a larger value (2-4)

Discovery.zen.ping.timeout:3s
Sets the ping connection time-out when the other nodes are automatically discovered in the cluster, which defaults to 3 seconds, and an error in preventing Autodiscover when the value is higher than the poor network environment.

Discovery.zen.ping.multicast.enabled:false
Sets whether to open the multicast Discovery node, which is true by default.

Discovery.zen.ping.unicast.hosts: ["host1", "Host2:port", "Host3[portx-porty]"]
Sets the initial list of master nodes in the cluster, which can be used to automatically discover the nodes that are newly joined to the cluster.

The following are the slow log parameter settings for some queries
Index.search.slowlog.level:TRACE
Index.search.slowlog.threshold.query.warn:10s
Index.search.slowlog.threshold.query.info:5s
Index.search.slowlog.threshold.query.debug:2s
Index.search.slowlog.threshold.query.trace:500ms

Index.search.slowlog.threshold.fetch.warn:1s
Index.search.slowlog.threshold.fetch.info:800ms
Index.search.slowlog.threshold.fetch.debug:500ms
Index.search.slowlog.threshold.fetch.trace:200ms

Reference: http://www.searchtech.pro/articles/2013/02/18/1361194291548.html

Distributed Search Elasticsearch configuration file