hbase-0.94安裝方法詳解,hbase-0.94安裝方法
先決條件:
1)java環境,需要安裝java1.6以上版本
2)hadoop環境,由於HBase架構是基於其他檔案儲存體系統的,因此在分布式模式下安裝Hadoop是必須的,但是,如果運行在單價模式下,此條件可以省略。Hadoop-1.2.1的安裝方法參考 hadoop-1.2.1安裝方法詳解
注意:安裝時要注意Hadoop和HBase之間的版本關係,如果不匹配,很可能會影響HBase系統的穩定性。
本帖教程採用的hadoop是hadoop-1.2.1,hbase採用的是hbase-0.94
hbase有三種安裝模式:
單機模式
偽分布模式
完全分布模式
單機模式安裝步驟:
1、上傳並解壓hbase-0.94.16-security.tar.gz
[hadoop@mdw temp]$ cp /mnt/cdrom/hbase-0.94.16-security.tar.gz .
[hadoop@mdw temp]$ tar xzf hbase-0.94.16-security.tar.gz
2、修改hbase-env.sh設定檔
開啟/home/hadoop/hbase-0.94.16-security/conf/hbase-env.sh檔案,添加或修改JAVA_HOME環境變數
export JAVA_HOME=/usr/java/jdk1.6.0_45
修改HBASE_HEAPSIZE配置,預設是1000(如果記憶體比較大可以不設定,根據自己的記憶體設定)
export HBASE_HEAPSIZE=50
3、修改hbase-site.xml檔案,配置hbase.rootdir
<property>
<name>hbase.rootdir</name>
<value>file:///home/hadoop/hbase/data</value>
</property>
路徑可以是任意有許可權讀寫的路徑,要建立好並將owner改為hadoop使用者,這裡放在了hadoop使用者目錄下的 hbase/data目錄下
4、啟動並驗證Hbase
啟動hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/start-hbase.sh
starting master, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-master-mdw.out
啟動之後,通過jps可以看到多了一個HMaster進程
[hadoop@mdw ~]$ jps
2541 NameNode
4236 HMaster
4430 Jps
2687 SecondaryNameNode
2773 JobTracker
訪問hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.16, r1557241, Fri Jan 10 20:10:24 UTC 2014
hbase(main):001:0> quit
[hadoop@mdw ~]$
到此hbase的單機模式已經安裝成功
偽分布模式安裝:
偽分布模式是在單機模式的基礎上修改相應配置
1、先停止單機模式已安裝的hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/stop-hbase.sh
stopping hbase..............
2、修改hbase-env.sh設定檔
開啟/home/hadoop/hbase-0.94.16-security/conf/hbase-env.sh檔案,添加或修改HBASE_CLASSPATH環境變數,以便hbase找到hadoop
export HBASE_CLASSPATH=/home/hadoop/hadoop-1.2.1/conf
設定由hbase自己管理zookeeper,不需要單獨的zookeeper
export HBASE_MANAGES_ZK=true
3、修改hbase-site.xml設定檔,修改hbase.rootdir參數,添加hbase.cluster.distributed參數開啟分布模式
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
4、替換hadoop的jar檔案,主要目的是防止因為hbase和hadoop版本不同出現相容問題,造成hmaster啟動異常
[hadoop@mdw lib]$ pwd
/home/hadoop/hbase-0.94.16-security/lib
備份hbase內建的hadoop-core檔案,並將hadoop安裝目錄下的hadoop-core複製到hbase的lib下
[hadoop@mdw lib]$ mv hadoop-core-1.0.4.jar hadoop-core-1.0.4.bak
[hadoop@mdw lib]$ cp ~/hadoop-1.2.1/hadoop-core-1.2.1.jar .
[hadoop@mdw lib]$ ll hadoop-core*
-rw-r--r-- 1 hadoop hadoop 3929148 Jan 10 2014 hadoop-core-1.0.4.bak
-rw-rw-r-- 1 hadoop hadoop 4203147 Jun 1 02:01 hadoop-core-1.2.1.jar
5、啟動並驗證hbase
啟動hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/start-hbase.sh
localhost: starting zookeeper, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-zookeeper-mdw.out
starting master, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-master-mdw.out
localhost: starting regionserver, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-regionserver-mdw.out
通過jps命令可以看出,比單機模式多了HRegionServer進程和HQuorumPeer進程
[hadoop@mdw ~]$ jps
2541 NameNode
5552 HRegionServer
5404 HMaster
2687 SecondaryNameNode
2773 JobTracker
5293 HQuorumPeer
5681 Jps
訪問hbase並查看狀態
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.16, r1557241, Fri Jan 10 20:10:24 UTC 2014
hbase(main):001:0> status
1 servers, 0 dead, 2.0000 average load
hbase(main):002:0> exit
[hadoop@mdw ~]$
通過hadoop dfs命令查看hadoop檔案系統,會發現hadoop檔案系統的根目錄多了一個hbase檔案夾
[hadoop@mdw ~]$ hadoop dfs -ls /
Found 3 items
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase
drwxr-xr-x - hadoop supergroup 0 2015-05-27 02:14 /home
drwxr-xr-x - hadoop supergroup 0 2015-05-29 01:31 /user
[hadoop@mdw ~]$ hadoop dfs -ls /hbase
Found 7 items
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase/-ROOT-
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase/.META.
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase/.logs
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase/.oldlogs
drwxr-xr-x - hadoop supergroup 0 2015-06-01 02:06 /hbase/.tmp
-rw-r--r-- 2 hadoop supergroup 38 2015-06-01 02:06 /hbase/hbase.id
-rw-r--r-- 2 hadoop supergroup 3 2015-06-01 02:06 /hbase/hbase.version
到目前為止,為分布模式的hbase已經安裝成功
完全分布模式安裝:
完全分布模式是在偽分布模式的基礎上修改相應配置
1、停止hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/stop-hbase.sh
stopping hbase...........
localhost: stopping zookeeper.
2、清除hdfs檔案系統中/hbase檔案目錄
[hadoop@mdw ~]$ hadoop dfs -rmr /hbase
Deleted hdfs://master:9000/hbase
3、修改 hbase-site.xml 設定檔,添加zookeeper相關配置
<property>
<name>hbase.zookeeper.quorum</name>
<value>sdw1,sdw2</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/home/hadoop/tmp/zookeeper</value>
</property>
4、修改regionservers檔案,添加所有Region伺服器的主機名稱或IP地址,
[hadoop@mdw conf]$ cat regionservers
sdw1
sdw2
5、啟動並驗證hbase
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/start-hbase.sh
sdw2: starting zookeeper, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-zookeeper-sdw2.out
sdw1: starting zookeeper, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-zookeeper-sdw1.out
starting master, logging to /home/hadoop/hbase-0.94.16-security/logs/hbase-hadoop-master-mdw.out
sdw1: starting regionserver, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-regionserver-sdw1.out
sdw2: starting regionserver, logging to /home/hadoop/hbase-0.94.16-security/bin/../logs/hbase-hadoop-regionserver-sdw2.out
[hadoop@mdw ~]$ jps
6890 HMaster
2541 NameNode
7031 Jps
2687 SecondaryNameNode
2773 JobTracker
sdw1和sdw2上進程:
[hadoop@sdw1 ~]$ jps
2407 TaskTracker
2340 DataNode
4012 HQuorumPeer
4229 Jps
4079 HRegionServer
訪問hbase並查看狀態
[hadoop@mdw ~]$ hbase-0.94.16-security/bin/hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.16, r1557241, Fri Jan 10 20:10:24 UTC 2014
hbase(main):001:0> status
2 servers, 0 dead, 1.0000 average load
hbase(main):002:0> exit
[hadoop@mdw ~]$
6、配置HBASE_HOME,開啟.bashrc添加修改以下內容(可選)
export HBASE_HOME=/home/hadoop/hbase-0.94.16-securityexport PATH=$PATH:$JAVA_HOME/bin:$HADOOP_HOME/bin:$HBASE_HOME/bin
至此hbase的完全分布模式已經安裝成功
著作權聲明:本文為博主原創文章,轉載請註明本文連結。