The ganglia of big data

1. What is ganglia

An open source cluster monitoring project; Ganglia can do system monitoring, however, currently it does not support server exception or fault alarm function.

2.Ganglia Monitoring Cluster architecture

Ganglia cluster is mainly composed of the 3 daemons, Gmond, Gmetad, Gweb, and the Gmetad process is equivalent to the master of the monitoring cluster. While multiple Gmond processes can be grouped, each grouping is actually a proxy service cluster used to collect monitoring data, which means that multiple gmond clusters function as slave nodes throughout the ganglia monitoring cluster.

3.gmond

Gmond (Ganglia monitor Daemon) Data Logger service program, Gmond equivalent to a proxy (agent) service process, it is deployed on each node to be monitored; The configuration file is/etc/gmond.conf

? Gmond is primarily responsible for interacting with the host node operating system, acquiring some monitoring data to the node, such as CPU load, disk capacity, memory capacity, network status, and so on.

After the Gmond process collects many of the monitored metadata information, wait for Gmetad to poll the information periodically.

The Gmond process runs at a very small load to the system, which does not affect user application performance.

4.gmetad

? Gmetad (Ganglia Meta Daemon): Data mixing collector service Program, config file is/etc/gmetad.conf;

Gmetad listens for remote Gmetad connections over TCP port 8651, and provides an XML-formatted grid state to authorized hosts. Gmetad also responds to interactive requests via TCP port 8652.

Gmetad can be seen as the master of the ganglia cluster, which uses poll to proactively interact with each gmond process in the cluster, periodically polling the metadata collected by each gmond process and then storing it in the RRD database to prepare the Web display monitoring data. ; It is best to have a Gmetad for each cluster to build a multi-level network.

5.gweb

The Gweb process is primarily used to show the monitoring metadata that the Gmetad process has polled from each node, where the data presented is actually handled by the RRDtool tool.

? Visualize the data using a PHP script and draw a table. can be any Web server that supports PHP, SSL (Secure Sockets layer), and XML. Generally use Apache2web server

The ganglia of big data