Hypertable on HDFS(hadoop) 安裝

Hypertable on HDFS(hadoop) 安裝

Hadoop - HDFS 安裝指南

過程&HTTP://www.aliyun.com/zixun/aggregation/37954.html">nbsp;4.2. Hypertable on HDFS

創建工作目錄

$ hadoop fs -mkdir /hypertable$ hadoop fs -chmod 777 /hypertable

安裝 JAVA 運行環境

yum install java-1.7.0-openjdkyum localinstall HTTP://ftp.cuhk.edu.hk/pub/packages/apache.org/hadoop/common/ hadoop-1.1.2/hadoop-1.1.2-1.x86_64.rpm

修改 jrun bug

cp /opt/hypertable/current/bin/jrun /opt/hypertable/current/bin/jrun.oldvim /opt/hypertable/current/bin/jrun# HT_JAR=`ls -1 /opt/hypertable/doug/current/lib/java/*.jar | grep "hypertable-[^-]*.jar" | awk 'BEGIN {FS="/"} {print $NF}'`HT_JAR=`ls -1 /opt/hypertable/current/lib/java/*.jar | grep "hypertable-[^-]*.jar" | awk 'BEGIN {FS="/"} {print $NF}'` export JAVA_HOME=/usr export HADOOP_HOME=/usr export HYPERTABLE_HOME=/opt/hypertable/ current

hypertable.cfg

# cat conf/hypertable.cfg## hypertable.cfg## HDFS Broker#HdfsBroker.Hadoop.ConfDir=/etc/hadoop/ confHdfsBroker.Hadoop.ConfDir=/etc/hadoop# Ceph BrokerCephBroker.MonAddr=192.168.6.25:6789# Local BrokerDfsBroker.Local.Root=fs/local# DFS Broker - for clientsDfsBroker.Port=38030# HyperspaceHyperspace.Replica.Host =localhostHyperspace.Replica.Port=38040Hyperspace.Replica.Dir=hyperspace# Hypertable.Master# Hypertable.Master.Host=localhostHypertable.Master.Port=38050# Hypertable.RangeServerHypertable.RangeServer.Port =38060Hyperspace.KeepAlive.Interval=30000Hyperspace.Lease.Interval=1000000Hyperspace.GracePeriod=200000# ThriftBrokerThriftBroker.Port=38080

/etc/hadoop/hdfs-site.xml

# cat /etc/hadoop/hdfs-site.xml<?xml version="1.0"?><?xml-stylesheet type="text/xsl" href=" configuration.xsl"?><!-- Put site-specific property overrides in this file. --><configuration> <property> <name>dfs.name.dir</name> <value>/var/hadoop/name1 </value> <description> </description> </property> <property> <name>dfs.data.dir </name> <value>/var/hadoop/hdfs/data1</value> <description> </description> </ property> <property> <name>dfs.replication</name> <value>2</value> </property ></configuration>

啟動 dfsbroker

# /opt/hypertable/current/bin/set-hadoop-distro.sh cdh4Hypertable successfully configured for Hadoop cdh4 # /opt/ hypertable/current/bin/start-dfsbroker.sh hadoopDFS broker: available file descriptors: 1024Started DFS Broker (hadoop)

查看開機記錄

# tail -f /opt/hypertable/current/log/DfsBroker.hadoop.loglog4j:WARN No appenders could be found for logger (org.apache.h adoop.conf.Configuration).log4j:WARN Please initialize the log4j system properly. HdfsBroker.dfs.client.read.shortcircuit=falseHdfsBroker.dfs.replication=2HdfsBroker.Server.fs.default.name= hdfs://namenode.example.com:9000Apr 23, 2013 6:43:18 PM org.hypertable.AsyncComm.IOHandler DeliverEventINFO: [/ 192.168.6.25:53556 ; Tue Apr 23 18:43:18 HKT 2013] Connection EstablishedApr 23, 2013 6:43:18 PM org.hypertable.DfsBroker.hadoop.ConnectionHand ler handleINFO: [/192.168.6.25:53556 ; Tue Apr 23 18:43:18 HKT 2013] Disconnect - COMM broken connection : Closing all open handles from /192.168.6.25:53556Close d 0 input streams and 0 output streams for client connection /192.168.6.25:53556