Spring Hadoop access to HBase Getting Started

Source: Internet
Author: User

1. Environment Preparation:

Maven

Eclipse

Java

Spring version 3..2.9

2. Maven pom.xml Configuration

<!--Spring Hadoop---   <dependency>        <groupId>org.apache.hbase</groupId>        <artifactId>hbase-client</artifactId>        <version>0.96.1.1-hadoop2</version>    < /dependency><dependency><groupid>org.springframework.data</groupid><artifactid> Spring-data-jpa</artifactid><version>1.6.0.release</version></dependency> < dependency>        <groupId>org.springframework.data</groupId>        <artifactId> spring-data-hadoop</artifactid>        <version>2.0.2.RELEASE</version>    </dependency>

3. Spring and Hadoop, hbase related configuration files

<?xml version= "1.0" encoding= "UTF-8"? ><beans xmlns= "Http://www.springframework.org/schema/beans" xmlns: Xsi= "Http://www.w3.org/2001/XMLSchema-instance" xmlns:jdbc= "Http://www.springframework.org/schema/jdbc" Xmlns:tx = "Http://www.springframework.org/schema/tx" xmlns:util= "Http://www.springframework.org/schema/util" xmlns:aop= " Http://www.springframework.org/schema/aop "xmlns:context=" Http://www.springframework.org/schema/context "xmlns: mongo= "Http://www.springframework.org/schema/data/mongo"xmlns:hdp= "Http://www.springframework.org/schema/hadoop"Xmlns:cache= "Http://www.springframework.org/schema/cache" xmlns:c= "HTTP://WWW.SPRINGFRAMEWORK.ORG/SCHEMA/C" xmlns:p= "http://www.springframework.org/schema/p" xsi:schemalocation= "http://www.springframework.org/schema/ JDBC Http://www.springframework.org/schema/jdbc/spring-jdbc.xsd Http://www.springframework.org/schema/beans http: Www.springframework.org/schema/beans/spring-beans.xsd Http://www.springframework.org/schema/util HTTP://WWW.SP Ringframework.org/schema/util/spring-util.xsd Http://www.springframework.org/schema/tx Http://www.springframewor K.org/schema/tx/spring-tx.xsd HTTP://WWW.SPRINGFRAMEWORK.ORG/SCHEMA/AOP Http://www.springframework.org/schema/ao P/spring-aop.xsd Http://www.springframework.org/schema/data/mongo Http://www.springframework.org/schema/data/mon         Go/spring-mongo.xsdHttp://www.springframework.org/schema/hadoop http://www.springframework.org/schema/hadoop/spring-hadoop.xsd Http://www.springframework.org/schema/cache http://www.springframework.org/schema/cache/spring-cache.xsd/HTTP Www.springframework.org/schema/context http://www.springframework.org/schema/context/spring-context.xsd ">

Where red is the spring Hadoop XML namespace configuration.

Hadoop hbase The relevant configuration files are as follows:

<!--default Properties-->

HDFs://192.98.8.224:8010

"${delete-connection}" zk-quorum="${ Hbase.zookeeper.quorum} "zk-port=" ${hbase.zookeeper.property.clientport} "/>

the corresponding properties as follows:

hbase.zookeeper.property.clientport=2181

hbase.zookeeper.quorum=192.98.8.224

hbase.master=192.98.8.224:600000

Fs.default.name=HDFs://192.98.8.224:8010

Delete-connection=true

#hive jdbc URL

Hive.url=jdbc:hive://192.98.8.224:10000/default

Spring Hbasetemplate The configuration is as follows:

<bean id="hbasetemplate" class="Org.springframework.data.hadoop.hbase.HbaseTemplate"> <property name="Configuration" ref="hbaseconfiguration" />

</bean>

Hbasetemplate Using code Examples:

Tile t = hbasetemplate.get ("Gw_tiles", "0_1_1", new Rowmapper<tile> () {@Overridepublic tile maprow (result result, I NT RowNum) throws Exception {//TODO auto-generated method Stubtile t = new Tile (); T.setdata (Result.getvalue ("T". GetBytes ( ), "Key". GetBytes ())); return t;});

  

hbasetemplate Introduction to Common methods:

Hbasetemplate.get ("Gw_tiles", "0_1_1", new rowmapper are commonly used for queries, as shown in the following example:

Tile t = hbasetemplate.get ("Gw_tiles", "0_1_1", new Rowmapper<tile> () {@Overridepublic tile maprow (result result, I NT RowNum) throws Exception {//TODO auto-generated method Stubtile t = new Tile (); T.setdata (Result.getvalue ("T". GetBytes ( ), "Key". GetBytes ())); return t;});

Hbasetemplate.execute (Dataidentifier, new tablecallback is commonly used for update operations, as shown in the following example:

Return Hbasetemplate.execute (Dataidentifier, New tablecallback<boolean> () {@Overridepublic Boolean dointable ( Htableinterface table) throws Throwable {//TODO auto-generated method Stubboolean flag = false;try{delete Delete = new De Lete (Key.getbytes ()); Table.delete (delete); flag = true;} catch (Exception e) {e.printstacktrace ();} return flag;});

  

Note : Spring Hbasetemplate is a powerful package for hbase interfaces, with common functionality that uses its powerful interfaces, while complex functions can also use hbase native interfaces such as: Htableinterface, Result and so on. Its class methods are as follows:

At the same time, Hbasetemplate encapsulates the HBase connection pool, and its creation and release is automatically managed through configuration.

Article reproduced please specify the source: http://www.cnblogs.com/likehua/p/4016257.html

Spring Hadoop access to HBase Getting Started

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.