There was an article in detail about how to install Hadoop+hbase+zookeeper
The title of the article is: Hadoop+hbase+zookeeper distributed cluster construction perfect operation
Its website: http://blog.csdn.net/shatelang/article/details/7605939
This article is about hadoop1.0.0+hbase0.92.1+zookeeper3.3.4.
The installation file versions are as follows:
Please
1. PrefaceThe previous chapter describes the transformation of the existing system architecture, and this chapter describes the detailed design description of the transformation.2.Zookeeper directory structure designZookeeper directory structure diagram:1. As shown in the figure above, zookeeper's directory structure is divided into multiple layers,/zookeeper as the root directory,/
Tags: zopper shellZooper Cluster Structure:Host name roleNode1 FollowerNode2 leaderNode3 FollowerMaster ObserverScript content:#!/bin/bashfunction GetStatus () {#定义一个函数EXEC 9#打开host的port a read-write socket connection that is connected to the file descriptor 9Echo Stat >9#将 "Stat" sent to the socket connectionmode=$ (Cat ")#从socket返回数据中提取Mode的值 and assign a value to modeEXEC 9Echo ${mode:-null}#输出MODE *}For i in node{1..3} nn01;doEcho-ne "${i}\t"
in this example, the master node has the host name of Master, and the hostname of the slave node is slave1,slave2,slave3, the user name is Hadoop, and the zookeeper version used is zookeeper3.4.5. Run the following script under ROOT to achieve a quick build of the zookeeper cluster. Before the installation to ensure that the host can communicate with each other,
The previous article explains how to install the python client of zookeeper. Next, I found an example on the Internet. The application environment is as follows:
1. When two or more services run and only one service accepts requests (work) for the agreed time, other services are on standby.
2. When the service receiving the request (work) Fails abnormally, a service is selected from the remaining standby service to accept the request (work ).
In the
1.zookeeperZookeeper can be used to ensure data transaction consistency between the data in the zookeeper cluster2. Start the cluster and checkStart on each machine separately./zkserver.sh StartCheck Status./zkserver.sh Status3. Client starts shell command linezkcli.sh4.shell command: Enter Help to get a list of all commandsMy personal website: http://www.caicongyang.com;My csdn blog address: Http://blog.cs
1. Heartbeat detection, store supervisor and worker heartbeat (including their status), so that Nimbus can monitor the status of the entire cluster, thus restarting some of the dead worker;
2. Submit a Task
3. Store all state information for the entire cluster for the UI display
4. Storm's storage structure on ZK
/-{storm-zk-root}--The root directory of storm on zoo
The principle is simply that to elect leader, a ZXID is generated and distributed to all servers (so that one server can accept multiple servers to send him a request to elect leader), and then the individual servers are sent to their own zxid, Select a value that is the largest, and then return this selection to the server that sent the ZXID, as long as the server receives a reply greater than or equal to 2/n+1 (that is, more than half of the agreed ticket), it indicates that it was elected lea
sessions life cycle ends. Temporary nodes also play a very important role in some situations.
---------------------------
Zookeeper Series III: Installation of Zookeeper
The installation mode of zookeeper is divided into three kinds: stand-alone mode (stand-alone), cluster mode and
Installation, configuration, startup, and use of ZooKeeper (1) -- Single-host mode, single-host zookeeper
ZooKeeper is easy to install. It works in standalone mode, cluster mode, and pseudo cluster mode. This blog aims to summarize how to install, configure, start, and use
, the sender can not know whether the recipient received this information, and the cause of this failure is very complex, the recipient may have received a network error before the message, or may not receive, or the receiver's process died. The only way for the sender to get to the real situation is to reconnect to the recipient and ask the recipient for the reason for the error, which is the "partial failure" issue in Distributed system development.Zookeeper is the framework for solving the "p
Option explicit'Vss provided ini provided already releasedPrivate srcsafe_ini as string'Vss connected zookeeper IDPrivate user_id as string'Vss is connected to zookeeper without zookeeperPrivate user_password as string'Vss RootPrivate vss_root as string'Worker worker?Private output_dir as string'Too many threads have been transferred too many threads have been transferredPrivate mobjfilesystem as FileSystem
sessions life cycle ends. Temporary nodes also play a very important role in some situations.
---------------------------
Zookeeper Series III: Installation of Zookeeper
The installation mode of zookeeper is divided into three kinds: stand-alone mode (stand-alone), cluster mode and
separated by a slash, in addition, each node has a parent node (except the root node), which is very similar to a file system. For example,/foo/doo indicates a znode. Its parent node is/foo, its parent node is/, And/is the root node without a parent node. Different from the file system, these nodes can set associated data. In the file system, only file nodes can store data, but directory nodes cannot. To ensure high throughput and low latency, Zookeeper
follower is that observer will not participate in leader-sponsored polls.Mainstream application scenarios:Zookeeper of the mainstream application scenario (except for the official example)(1) Configuration managementCentralized configuration management is common in application clusters, where a centralized set of configuration management centers is implemented within a common business company, responding to the need for different application clusters to share their respective configurations and
Reproduced to: http://hi.baidu.com/%CC%D8%B0% AE %C0%B6%C1% AB %BB%A8/blog/item/2ae9efda06e267c9572c841b.html
Installation and configuration details
Zookeeper introduced in this article is based on the stable version 3.2.2. The latest version can be found on the official website.Http://hadoop.apache.org/zookeeper/to obtain, Zookeeper installation is very simple
= 2000
# The number of ticks that the initial
# Synchronization phase can take
InitLimit = 10
# The number of ticks that can pass
# Sending a request and getting an acknowledgement
SyncLimit = 5
# The directory where the snapshot is stored.
# Do not use/tmp for storage,/tmp here is just
# Example sakes.
DataDir =/home/wusc/zookeeper-3.4.6/
DataLogDir =/home/wusc/zookeeper-3.4.6/logs
# The port at which the
Installation and configuration details
Zookeeper introduced in this article is based on the stable version 3.2.2. The latest version can be found on the official website.Http://hadoop.apache.org/zookeeper/to obtain, Zookeeper installation is very simple, the following describes the installation and configuration of zookeeper
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.