Hbase on yarn-compiling deployment slider

1, compile slider,

[Email protected] apache-slider-0.91.0-incubating]# pwd/usr/local/src/apache-slider-0.91.0-incubating

Modify the Pom file in this directory for CDH version of Hadoop (2.6.0-cdh5.9.0), HBase (1.2.0-cdh5.9.0)

Comment out the dependencies on the Hadoop-minicluster package in Slider-core and Slider-funtest
<!--<dependency><groupid>org.apache.hadoop</groupid><artifactid>hadoop-minicluster </artifactId><scope>test</scope></dependency>-->
Skip Maven test, execute compile command
[Email protected] apache-slider-0.91.0-incubating]# MVN clean package-dmaven.test.skip=true-dskiptests

[INFO] Slider ..... ..... ..... ..... ..................... SUCCESS [0.762 S]
[INFO] Command Logger Sample application ........... SUCCESS [0.971 S]
[INFO] Slider Command Logger slider App package ..... SUCCESS [0.766 S]
[INFO] Slider Core ...... ..... ..................... SUCCESS [10.766 S]
[INFO] The Slider Agent ...... ..... ................... SUCCESS [1.245 S]
[INFO] Apache Slider Binary Distribution ........ ..... SUCCESS [21.933 S]
[INFO] Slider functional Tests ......... ............ SUCCESS [5.285 S]
[INFO] The Slider App Packages ......... .............. SUCCESS [0.012 S]
[INFO] Slider Accumulo App Package ......... ......... SUCCESS [5.578 S]
[INFO] The Slider HBase App package .............. ..... SUCCESS [0.017 S]
[INFO] Slider Kafka App Package ........... ......... SUCCESS [1.046 S]
[INFO] The Slider Storm App package .............. ..... SUCCESS [0.011 S]
[INFO] Slider Tomcat App Package testing WAR File ... SUCCESS [0.886 S]
[INFO] The Slider Tomcat App package ........... ....... SUCCESS [1.666 S]
[INFO]------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]------------------------------------------------------------------------
[INFO] Total time:51.578 S
[INFO] Finished at:2016-12-01t12:00:14+08:00
[INFO] Final memory:89m/2916m
[INFO]------------------------------------------------------------------------

2, download hbase-1.2.0-cdh5.9.0.tar.gz, storage directory/USR/LOCAL/SRC
wget http://archive.cloudera.com/cdh5/cdh/5/hbase-1.2.0-cdh5.9.0.tar.gz

3. Generate Slider-hbase-app-package-1.2.0-cdh5.9.0.zip
MVN clean package-p hbase-app-package-d pkg.version=1.2.0-cdh5.9.0-dpkg.name=hbase-1.2.0-cdh5.9.0.tar.gz-d pkg.src= /usr/local/src

-dhbase.version=
-dpkg.version=<app Package version> Application version
-dpkg.name=<file name of the app tarball> app tar package file name
-dpkg.src=\ ' #\ ' location where the pkg is available> app tar package files folder


4. Build a successful package deployment of slider, configure environment variables

Packages that were successfully compiled are located in slider_src_home/slider-assembly/target/slider-0.91.0-incubating-all.tar.gz
Unzip to/usr/local/slider
and configure environment variables export Slider_home=/usr/local/slider

5. Create the Package
Slider Package--install--name HBASE--package slider-0.91.0-incubating/slider-hbase-app-package-1.2.0-cdh5.9.0.zip
Verify:
[Email protected] slider]$ Hadoop fs-ls/user/hadoop/.slider/package/hbase/ slider-hbase-app-package-1.2.0-cdh5.9.0.zip-rw-r--r--3 Hadoop hadoop 241347310 2016-12-01 13:43/user/hadoop/.slider /package/hbase/slider-hbase-app-package-1.2.0-cdh5.9.0.zip
6. Extracting Appconfig-default.json and Resource-default.json from Slider-hbase-app-package-1.2.0-cdh5.9.0.zip
Unzip Slider-hbase-app-package-1.2.0-cdh5.9.0.zip appconfig-default.json-d/usr/local/slieder/
Unzip Slider-hbase-app-package-1.2.0-cdh5.9.0.zip resource-default.json-d/usr/local/slider/

7, modify the Appconfig-default.json
{"Schema":  "http://example.org/specification/v2.0.0", "Metadata":  {}, "global":  {"Application.def ": ". Slider/package/hbase/slider-hbase-app-package-1.2.0-cdh5.9.0.zip "," Create.default.zookeeper.node ":   "true", "Java_home":  "/usr/local/jdk", "System_configs":  "Core-site", "Site.global.app_user":   "Hadoop", "Site.global.app_version":  "1.2.0-cdh5.9.0", "Site.global.app_root":  "${agent_work_ root}/app/install/hbase-1.2.0-cdh5.9.0 "," Site.global.metric_collector_host ": " ${nn_host} "," Site.global.metric_collector_port ": " 6188 "," Site.global.metric_collector_lib ": " "," site.global.hbase _instance_name ": " InstanceName "," Site.global.hbase_root_password ": " secret "," Site.global.user_group " :  "Hadoop", "Site.global.monitor_protocol":  "http", "Site.global.hbase_thrift_port":  "${hbase_" THRIFT. Allocated_port} "," Site.global.hbase_thrift2_port ": " ${hbase_thrift2. Allocated_port} "," Site.global.hbase_rest_port ": " ${hbase_rest. Allocated_port} "," Site.hbase-env.hbase_master_heapsize ": " 1024m "," Site.hbase-env.hbase_regionserver_ HeapSize ": " 1024m "," Site.hbase-site.hbase.rootdir ": " ${default_data_dir}/data "," Site.hbase-site.hbase.superuser ": " ${user_name} "," Site.hbase-site.hbase.tmp.dir ": " ${AGENT_WORK_ROOT }/work/app/tmp "," Site.hbase-site.hbase.local.dir ": " ${hbase.tmp.dir}/local "," Site.hbase-site.hbase.zookeeper.quorum ": " ${zk_host} "," Site.hbase-site.zookeeper.znode.parent ": " ${ Default_zk_path} "," Site.hbase-site.hbase.regionserver.info.port ": " 0 "," Site.hbase-site.hbase.bulkload.staging.dir ": "/user/${user_name}/hbase-staging "," Site.hbase-site.hbase.coprocessor.region.classes ": " Org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint "," Site.hbase-site.hbase.master.info.port ":   "${hbase_master. Allocated_port} "," Site.hbase-site.hbase.regionserver.port ": " 0 "," site.hbase-site.hbase.master.port ":   "0"}, "Components":  {"Slider-appmaster": &NBsp {"Jvm.heapsize":  "1024M"}}}
 8, modify Resource-default.json 
 
{"Schema":  "http://example.org/specification/v2.0.0", "Metadata":  {}, "global":  {" Yarn.log.include.patterns ": " "," Yarn.log.exclude.patterns ": " "," Yarn.component.instances ": " 1 ", "Yarn.vcores":  "1"}, "Components":  {"Slider-appmaster":  {"Yarn.memory":  "10240"}, "Hbase_ MASTER ":  {" Yarn.role.priority ": " 1 "," Yarn.component.instances ": " 1 "," Yarn.placement.escalate.seconds ": ", "Yarn.memory":  "15000"}, "Hbase_regionserver":  {" Yarn.role.priority ": " 2 "," Yarn.component.instances ": " 1 "," Yarn.memory ": " 15000 "," Yarn.container.failure.threshold ": ", "Yarn.placement.escalate.seconds":  "$"}, "Hbase_rest":  {"Yarn.role.priority":  "3", "Yarn.component.instances":  "1", "Yarn.component.placement.policy":  " 1 "," Yarn.memory ": " 5560 "}," Hbase_thrift ":  {" Yarn.role.priority ": " 4 "," Yarn.component.instances " :  "1", "Yarn.component.placement.policy":  "1", "Yarn.memory":  "5560 "}," hbase_thrift2 ":  {" Yarn.role.priority ": " 5 "," Yarn.component.instances ": " 1 "," Yarn.component.placement.policy ": " 1 "," Yarn.memory ": " 5560 "}}
9. Start HBase application on yarn
[Email protected] slider]$ slider Create Hbase1--template./appconfig-default.json--resources. Resources-default.json
650) this.width=650; "src=" Http://s4.51cto.com/wyfs02/M02/8B/1E/wKiom1hFDfnjpABDAAC6sCmrANQ287.png "title=" Clipboard.png "alt=" Wkiom1hfdfnjpabdaac6scmranq287.png "/>
This article is from the "Chocolate Black" blog, be sure to keep this source http://10120275.blog.51cto.com/10110275/1879569
Hbase on yarn-compiling deployment slider