Trivial-hadoop2.2.0-hbase0.96.0-hive0.13.1 integration

The integration of Hadoop and hive, HBase is not said, this is the integration of hbase and hive in the hadoop2.2.0 environment

Because hive0.12 does not support HADOOP2, it also replaces some of the Hadoop jar packages, but it's much easier to start with 0.13.

Environment: Centos6.6-x64, jdk1.7, hadoop2.2.0, hbase0.96, hive0.13.1

1.hadoop startup, hbase installation, MySQL installation

。。。 。。。

Installation and configuration of 2.hive

1) Unzip

2) Copy some of the packages in HBase into the hive Lib directory

　　

Hbase-client-0.96.0-hadoop2.jar,

Hbase-common-0.96.0-hadoop2.jar

Hbase-common-0.96.0-hadoop2-tests.jar

Hbase-protocol-0.96.0-hadoop2.jar

Base-server-0.96.0-hadoop2.jar

Htrace-core-2.01.jar

Protobuf-java-2.5.0.jar

Guava-11.0.2.jar

　3) Copy the MySQL driver package into the hive Lib directory

4) configuration

　　

　　

1 <?XML version= "1.0"?>2 <?xml-stylesheet type= "text/xsl" href= "configuration.xsl "?>3 4 <Configuration>5 6 <!--Hive Execution Parameters -7 8 < Property>9   <name>Javax.jdo.option.ConnectionURL</name>Ten   <value>Jdbc:mysql://hadoop:3306/hive?createdatabaseifnotexist=true</value> One   <Description>JDBC connect string for a JDBC Metastore</Description> A </ Property> -  - < Property> the   <name>Javax.jdo.option.ConnectionDriverName</name> -   <value>Com.mysql.jdbc.Driver</value> -   <Description>Driver class name for a JDBC metastore</Description> - </ Property> +  - < Property> +   <name>Javax.jdo.option.ConnectionUserName</name> A   <value>Hive</value> at   <Description>Username to use against Metastore database</Description> - </ Property> -  - < Property> -   <name>Javax.jdo.option.ConnectionPassword</name> -   <value>Hive</value> in   <Description>Password to use against Metastore database</Description> - </ Property> to  + < Property> -     <name>Hive.aux.jars.path</name> the     <value>file:///home/hadoop/apache-hive-0.13.1-bin/lib/hive-hbase-handler-0.13.1.jar,file:///home/hadoop/ apache-hive-0.13.1-bin/lib/hbase-client-0.96.0-hadoop2.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/ hbase-common-0.96.0-hadoop2.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/ hbase-common-0.96.0-hadoop2-tests.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/ hbase-protocol-0.96.0-hadoop2.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/ hbase-server-0.96.0-hadoop2.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/htrace-core-2.01.jar,file:/// home/hadoop/apache-hive-0.13.1-bin/lib/zookeeper-3.4.5.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/ Protobuf-java-2.5.0.jar,file:///home/hadoop/apache-hive-0.13.1-bin/lib/guava-11.0.2.jar</value> * </ Property> $ Panax Notoginseng </Configuration>

　　

(Hive.aux.jars.path value does not have spaces and line breaks)

5) Start

Hive

2. Testing

Note that the encoding of the operating database in MySQL is set to latin1 (ALTER DATABASE hive character set latin1;) or it will be an error.

Trivial-hadoop2.2.0-hbase0.96.0-hive0.13.1 integration