Preliminary study on biginsights (1)

The previous article, "IBM BigInsights-a Hadoop-based data analytics platform", introduced IBM's Big Data analytics platform BigInsights, which added additional modules on Hadoop to provide broader data analysis. What's a biginsight to know? IBM also provides a biginsights version of the virtual machine for students who can do anything. Biginsight virtual machines are also a good choice for those who want to know about Hadoop, but don't want to manually build a Hadoop platform.

First download https://www-01.ibm.com/marketing/iwm/iwm/web/reg/download.do?source=swg-beta-iibob&s_pkg=dl& on the IBM website lang=en_us&cp=utf-8&dlmethod=http, download "iibi3002_quickstart_single_vmware.7z", open with VMware workstation, After booting the following interface, you can see is based on SuSE.

650) this.width=650; "title=" clip_image002 "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt = "clip_image002" src= "http://s3.51cto.com/wyfs02/M01/79/9E/wKiom1aWMYLSLFI0AAClVQ1MJ0s766.jpg" width= "643" height = "484"/>

File system check at first boot

650) this.width=650; "title=" clip_image002[4] "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt = "Clip_image002[4]" src= "http://s3.51cto.com/wyfs02/M00/79/9C/wKioL1aWMbegL0tUAAFUbdk_o4Y160.jpg" width= "644" height= "363"/>

Select language

650) this.width=650; "title=" clip_image002[6] "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt = "Clip_image002[6]" src= "http://s3.51cto.com/wyfs02/M01/79/9C/wKioL1aWMbjQbv9NAADIMuHvPh0834.jpg" width= "644" height= "366"/>

Agree license

650) this.width=650; "title=" clip_image002[8] "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt = "Clip_image002[8]" src= "http://s3.51cto.com/wyfs02/M02/79/9E/wKiom1aWMYmQ6ByMAACSptZT9TI559.jpg" width= "644" height= "362"/>

Enter the user name password, the default user name password and the port number as follows

650) this.width=650; "title=" clip_image001 "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;margin:0px;padding-right:0px;border-top-width:0px; " Border= "0" alt= "clip_image001" src= "Http://s3.51cto.com/wyfs02/M00/79/9E/wKiom1aWMYuRinUcAADoZNyh41Y296.png" Width= "561" height= "484"/>

You will then see the following interface

650) this.width=650; "title=" image "style=" border-right-width:0px;background-image:none;border-bottom-width:0px; padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt=" image "src=" http:// S3.51cto.com/wyfs02/m02/79/9c/wkiol1awmcctfcifaajs5spr-te472.png "width=" 644 "height=" 314 "/>

Double-click Start Biginsights on the desktop, start the Biginsight service, or start with a script

[Email protected]:~>/opt/ibm/biginsights/bin/start-all.sh [INFO] Deploycmdline-[IBM InfoSphere BigInsights Quickstart Edition] [INFO] Progress-start HDM [INFO] @bivm. IBM.COM-HDM started, PID 4363 [INFO] progress-8% [INFO] Progress-start Zookeeper [INFO] Hdmutil-install configuration has changed in the system, reloading ... [INFO] @bivm. Ibm.com-zookeeper started, PID 4618 [INFO] Deployer-zookeeper Service started [INFO] progress-17% [INFO] Progress-start Hadoop [INFO] @bivm. Ibm.com-namenode started, PID 4829 [INFO] @bivm. Ibm.com-secondarynamenode started, PID 5363 [INFO] @bivm. Ibm.com-datanode started, PID 5713 [INFO] progress-19% [INFO] Deployer-waiting for Namenode to exit Safe mode ... [INFO]  Deployer-waiting another 5 seconds for Namenode to exit SafeMode. Check the Namenode log for details. [INFO] Deployer-hdfs Cluster started successfully [INFO] progress-20% [INFO] progress-21% [INFO] @bivm. Ibm.com-jobtracker started, PID 6468 [INFO] @bivm. Ibm.com-tasktracker started, PID 6888 [INFO] progress-25% [INFO] Deployer-mapreduce Cluster started successfully [INFO] Progress-start Catalog [INFO] Db2operator-starting DB2 Instance db2inst1 on node bivm.ibm.com. Database to be activated BIDB [INFO] DB2OPERATOR-DB2 node bivm.ibm.com is started with process ID 7672 [INFO] Db2operator-database BIDB has been activated [INFO] progress-33% [INFO] Progress-start HBase [INFO] Deployer-check Zookeeper Services, make sure zookeeper service is started before start HBase service [INFO] @bivm. Ibm.com-hbase-master (Active) started [INFO] @bivm. Ibm.com-hbase-regionserver started [INFO] Deployer-hbase Service started [INFO] progress-42% [INFO] Progress-start Hive [INFO] Db2operator-starting DB2 Instance db2inst1 on node bivm.ibm.com. Database to be activated BIDB [INFO] DB2OPERATOR-DB2 Instance Db2inst1 is already running on node bivm.ibm.com with process ID 7672 [INFO] Db2operator-database BIDB has already been activated [INFO] @bivm. Ibm.com-hive-web-interface started, PID 10001 [INFO] @bivm. Ibm.com-hive-server2 started, PID 10587 [INFO] progress-49% [INFO] progress-50% [INFO] Progress-start Bigsql [INFO] Deployer-starting Big SQL Scheduler:ok Starting Big Sql:ok Starting Big SQL V1:ok (PID 17836) [INFO] @bivm. Ibm.com-scheduler started [INFO] @bivm. Ibm.com-bigsql-server started [INFO] @bivm. Ibm.com-bigsql-server-v1 started, PID 17836 [INFO] DEPLOYER-FMP PIDs File written [INFO] progress-58% [INFO] Progress-start Oozie [INFO] Deployer-run Oozie Command As:oozie [INFO] @bivm. Ibm.com-oozie started, PID 19082 [INFO] progress-67% [INFO] Progress-start Console [INFO] Deployer-starting Pigserver, logging to/var/ibm/biginsights/sheets/logs/bigsheets-console-pigserver.out [INFO] Deployer-server Waslp-server is not running. [INFO] Deployer-starting server Waslp-server. [INFO] Deployer-server Waslp-server started with process ID 19488. [INFO] Deployer-biginsights Management Console started, PID 19488 [INFO] progress-75% [INFO] Progress-start HTTPFS [INFO] @bivm. Ibm.com-httpfs-server started, PID 19975 [INFO] DEPLOYER-HTTPFS Service started [INFO] progress-83% [INFO] Progress-start Monitoring [INFO] Deployer-start monitoring ... [INFO] Deployer-starting Monitoring Agent on bivm.ibm.com as user monitoring [INFO] @bivm. Ibm.com-monitoring started, PID 21613 [INFO] Deployer-monitoring Service started [INFO] progress-92% [INFO] Progress-start Alert [INFO] Deployer-start Alert Management Service ... [INFO] Deployer-server Waslp-server is not running. [INFO] Deployer-starting server Waslp-server. [INFO] Deployer-server waslp-server start failed. Check server logs for details. [INFO] progress-100% [INFO] Deploymanager-start; Succeeded components: [HDM, Zookeeper, Hadoop, catalog, HBase, Hive, Bigsql, Oozie, console, HTTPFS, monitoring, alert]; Consumes:2148290ms

After about 10 minutes, you can then use the command line to view the status of the Biginsight services.

[Email protected]:~> /opt/ibm/biginsights/bin/status.sh

In addition, there are biginsight shells on the desktop,

650) this.width=650; "title=" clip_image002[12] "style=" border-right-width:0px;background-image:none; border-bottom-width:0px;padding-top:0px;padding-left:0px;padding-right:0px;border-top-width:0px; "border=" 0 "alt = "clip_image002[12]" src= "http://s3.51cto.com/wyfs02/M02/79/9E/wKiom1aWMZDxNespAAA1kgvqASI387.jpg" width= "644" height= "164"/>

For example, by double-clicking the HBase shell on the desktop, you can go directly to the shell

650) this.width=650; "title=" Image "style=" border-top:0px;border-right:0px;background-image:none;border-bottom:0 px;padding-top:0px;padding-left:0px;border-left:0px;padding-right:0px; "border=" 0 "alt=" Image "src=" http:// S3.51cto.com/wyfs02/m00/79/9c/wkiol1awmcljcll9aac8zmkvjeq375.png "height=" 305 "/>

Open the Biginsight Web interface with a browser, http://192.168.133.135:8080/

650) this.width=650; "title=" image "style=" border-top:0px;border-right:0px;background-image:none;border-bottom:0 px;padding-top:0px;padding-left:0px;border-left:0px;padding-right:0px; "border=" 0 "alt=" image "src=" http:// S3.51cto.com/wyfs02/m00/79/9e/wkiom1awmzbgvntaaajhgemr2sa961.png "height=" 451 "/>

Web interface for Distributed File System HDFs

650) this.width=650; "title=" image "style=" border-top:0px;border-right:0px;background-image:none;border-bottom:0 px;padding-top:0px;padding-left:0px;border-left:0px;padding-right:0px; "border=" 0 "alt=" image "src=" http:// S3.51cto.com/wyfs02/m01/79/9c/wkiol1awmcniory8aael9mn5f-o279.png "height=" 238 "/>

In the following article we will learn how Biginsight works in several experiments.

Biginsight Knowledge Center For more information, please refer to:

http://www-01.ibm.com/support/knowledgecenter/SSPT3X_3.0.0/com.ibm.swg.im.infosphere.biginsights.product.doc/ Doc/using.html%23task_edc_xhj_3n?lang=zh

This article is from the "star&storage" blog, make sure to keep this source http://taotao1240.blog.51cto.com/731446/1734755

Preliminary study on biginsights (1)