HBase cluster installation

Source: Internet
Author: User
Tags passwordless ssh

Environment: CentOS 6.4,hadoop 2.6.0,zookeeper 3.4.6,hbase 1.0.1.1

Cluster role Planning:
HostName HBase Role ZooKeeper Hadoop Role
HDP1 Master YES Slave
HDP2 Backup Master & Regionserver YES Master
HDP3 Regionserver YES Slave
HDP4 Regionserver YES Slave
1. Arbitrary master (HDP1) node decompression hbasesudo tar zxvf hbase-1.0.1.1-bin.tar.gz-c/usr/local/sudo mv hbase-1.0.1.1 hbase sudo chown-r hdp:hdp hbase 2. Modify Hbase-env.shVim conf/hbase-env.sh, out of java_home comments, and modified to local java_home export Java_home=/usr/lib/jdk7 modify Hbase_manages_zk to False,    The default is true, which represents the HBase managed zookeeper instance, which can be set to true if it is hbase exclusive zookeeper. Export Hbase_manages_zk=false 3. Modify Hbase-site.xml    The following only configures several items that must be modified, and the other items use the default values. The default configuration of the Hbase-site.xml can be obtained from the Help document (default configuration).  <configuration>  <property>    <name>hbase.rootdir</name>    <value>hdfs://HDP2:9000/hbase</value>  </property>  <property>     <name>hbase.cluster.distributed</name>     <value>true</value >  </property>  <property>     <name>hbase.master.port</name>      <value>16000</value>  </property>   <property>    <name>hbase.zookeeper.property.dataDir</name>    <value>/usr/local/zookeeper/ data</value>  </property>  <property>    <name>hbase.zookeeper.quorum </name>    <value>HDP1,HDP2,HDP3,HDP4</value>  </property>  < property>  &NBSp <name>hbase.zookeeper.property.clientPort</name>    <value>2181</value>  </property></configuration> hbase.rootdir:region the storage address of the servers shared hbase persisted data. You need to use a fully qualified address that contains the file system scheme. Hbase.cluster.distributed: Specifies whether the HBase cluster runs in a distributed manner. Hbase.master.port:Master bound ports, including Backup-master.hbase.zookeeper.property.datadir: This is datadir in the Zookeeper configuration file zoo.cfg. Zookeeper the location where the database snapshot is stored. List of all member servers for Hbase.zookeeper.quorum:ZooKeeper, separated by commas between server names. Hbase.zookeeper.property.clientPort: This is clientport in the Zookeeper configuration file zoo.cfg. The port that zookeeper provides to the client connection is 2181 by default.   4. Modify the Regionservers to write the regionservers. Vim CONF/REGIONSERVERSHDP2,HDP3,HDP4 5. Modify the Backup-masters to write backup Master。 Vim Conf/backup-masters HDP2 6. Add environment variables to make it easy to invoke HBaseVim/etc/profile #HBase ENV Export hbase_home=/usr/local/hbase export path= $PATH: $HBASE _home/bin: $HBASE _home/conf 7. Distributing the modified installation directory to all nodes, and modify the environment variables together. 8. Start HBaseStart-hbase can be raised in HDP1. 9. Viewing a process through JPS。 On the HDP1 there are HMASTER,HDP2 on the Hmaster and HREGIONSERVER,HDP3 and HDP4 on it are hregionserver. Summary:1. Hbase.master.port needs to be specified, otherwise the already in use error will be reported when Backup-master is started. 2. Hmaster (including backup-master) needs to be able to passwordless ssh to other server 3. I use the zookeeper here is an even number of nodes, in fact, it is unreasonable, should use odd number of nodes.

HBase cluster installation

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.