NUTCH2.3 hadoop2.7.1 hbase1.0.1.1 solr5.2.1部署(二),hadoop2.7安裝

來源:互聯網
上載者:User

NUTCH2.3 hadoop2.7.1 hbase1.0.1.1 solr5.2.1部署(二),hadoop2.7安裝


Precondition:
hadoop 2.7.1
hbase 1.0.1.1 / hbase 0.98.13

192.168.1.106 ->master
192.168.1.105 ->slave / regionservers


hbase部署

直接下載hbase bin檔案

hbase1.0.1.1 還有hbase 0.98.13 和hadoop2.7.1 / hadoop 2.5.2 配合并沒有問題。只不過

Nutch2.3 似乎和hbase 0.98.13 配合比較好。

1. 配置hbase-site.xml

<configuration><property>    <name>hbase.zookeeper.quorum</name>    <value>192.168.1.105,192.168.1.106</value></property><property>      <name>hbase.master</name>      <value>192.168.1.106:60000</value></property><property><name>hbase.tmp.dir</name><value>/disk2/hbase/hbase-1.0.1.1/tmp</value></property><property><name>hbase.zookeeper.property.dataDir</name><value>/disk2/hbase/hbase-1.0.1.1/zookeepertmp</value></property><property>    <name>hbase.rootdir</name>    <value>hdfs://192.168.1.106:9000/hbase</value></property><property>    <name>hbase.cluster.distributed</name>    <value>true</value></property></configuration>


2. 配置regionservers,只把192.168.1.105作為regionservers

true > regionservers

echo 192.168.1.105 >> regionservers

3. 配置hbase-env.sh

export JAVA_HOME=/disk2/java/jdk1.8.0_45

4. 將hbases整個目錄複寫到其他機器中。
scp -r hbase/ 192.168.1.105:/disk2/

5. 啟動

bin/start-hbase.sh(先啟動hadoop)

6. 測試查看

http://192.168.1.106:60010/master-status (0.98.13)

http://192.168.1.106:16010/master-status (1.0.1.1)

7. 過程中最多的問題是HMaster 和 HRegionServer不能共存,經常其中一個就退出:

master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: HMaster Aborted

解決辦法:

rm /tmp/hbase-root/ -rf
bin/hbase-cleanup.sh --cleanAll
bin/zookeepers.sh clear

著作權聲明:本文為博主原創文章,未經博主允許不得轉載。

相關文章

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.