2016-12-29 14:48:44,188 INFO [master:master:60000] http. Httpserver:jetty bound to Port 60010
2016-12-29 14:48:44,188 INFO [master:master:60000] mortbay.log:jetty-6.1.26
2016-12-29 14:48:44,721 INFO [master:master:60000] mortbay.log:Started selectchannelconnector@0.0.0.0:60010
2016-12-29 14:48:44,822 DEBUG [Main-eventthread] Master. ACTIVEMASTERMANAGER:A Master is now available
2016-12-29 14:48:44,826 INFO [master:master:60000] Master. activemastermanager:registered Active master=master,60000,1482994123213
2016-12-29 14:48:44,861 INFO [master:master:60000] Configuration.deprecation:fs.default.name is deprecated. Instead, use Fs.defaultfs
2016-12-29 14:48:44,972 FATAL [master:master:60000] Master. Hmaster:unhandled exception. Starting shutdown.
Org.apache.hadoop.ipc.RemoteException (org.apache.hadoop.ipc.StandbyException): Operation category READ is not Supported in State standby
At Org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation (standbystate.java:87)
At Org.apache.hadoop.hdfs.server.namenode.namenode$namenodehacontext.checkoperation (NameNode.java:1774)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation (fsnamesystem.java:1313)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo (fsnamesystem.java:3850)
At Org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo (namenoderpcserver.java:1011)
At Org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo ( clientnamenodeprotocolserversidetranslatorpb.java:843)
At org.apache.hadoop.hdfs.protocol.proto.clientnamenodeprotocolprotos$clientnamenodeprotocol$2. Callblockingmethod (Clientnamenodeprotocolprotos.java)
At Org.apache.hadoop.ipc.protobufrpcengine$server$protobufrpcinvoker.call (protobufrpcengine.java:616)
At Org.apache.hadoop.ipc.rpc$server.call (rpc.java:969)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2049)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2045)
At java.security.AccessController.doPrivileged (Native Method)
At Javax.security.auth.Subject.doAs (subject.java:422)
At Org.apache.hadoop.security.UserGroupInformation.doAs (usergroupinformation.java:1657)
At Org.apache.hadoop.ipc.server$handler.run (server.java:2043)
At Org.apache.hadoop.ipc.Client.call (client.java:1347)
At Org.apache.hadoop.ipc.Client.call (client.java:1300)
At Org.apache.hadoop.ipc.protobufrpcengine$invoker.invoke (protobufrpcengine.java:206)
At Com.sun.proxy. $Proxy 10.getFileInfo (Unknown Source)
At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
At Sun.reflect.NativeMethodAccessorImpl.invoke (nativemethodaccessorimpl.java:62)
At Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43)
At Java.lang.reflect.Method.invoke (method.java:498)
At Org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod (retryinvocationhandler.java:186)
At Org.apache.hadoop.io.retry.RetryInvocationHandler.invoke (retryinvocationhandler.java:102)
At Com.sun.proxy. $Proxy 10.getFileInfo (Unknown Source)
At Org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo ( clientnamenodeprotocoltranslatorpb.java:651)
At Org.apache.hadoop.hdfs.DFSClient.getFileInfo (dfsclient.java:1679)
At Org.apache.hadoop.hdfs.distributedfilesystem$17.docall (distributedfilesystem.java:1106)
At Org.apache.hadoop.hdfs.distributedfilesystem$17.docall (distributedfilesystem.java:1102)
At Org.apache.hadoop.fs.FileSystemLinkResolver.resolve (filesystemlinkresolver.java:81)
At Org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus (distributedfilesystem.java:1102)
At Org.apache.hadoop.fs.FileSystem.exists (filesystem.java:1397)
At Org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir (masterfilesystem.java:450)
At Org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout (masterfilesystem.java:154)
At Org.apache.hadoop.hbase.master.masterfilesystem.<init> (masterfilesystem.java:130)
At Org.apache.hadoop.hbase.master.HMaster.finishInitialization (hmaster.java:889)
At Org.apache.hadoop.hbase.master.HMaster.run (hmaster.java:692)
At Java.lang.Thread.run (thread.java:745)
2016-12-29 14:48:44,975 INFO [master:master:60000] Master. Hmaster:aborting
2016-12-29 14:48:44,975 DEBUG [master:master:60000] Master. Hmaster:stopping Service Threads
2016-12-29 14:48:44,975 INFO [master:master:60000] IPC. Rpcserver:stopping Server on 60000
2016-12-29 14:48:44,976 INFO [rpcserver.listener,port=60000] IPC. Rpcserver:rpcserver.listener,port=60000:stopping
2016-12-29 14:48:44,980 INFO [master:master:60000] Master. Hmaster:stopping Infoserver
2016-12-29 14:48:44,980 INFO [Rpcserver.responder] IPC. RpcServer:RpcServer.responder:stopped
2016-12-29 14:48:44,980 INFO [Rpcserver.responder] IPC. RpcServer:RpcServer.responder:stopping
2016-12-29 14:48:44,982 INFO [master:master:60000] mortbay.log:Stopped selectchannelconnector@0.0.0.0:60010
2016-12-29 14:48:45,105 INFO [master:master:60000] zookeeper. ZOOKEEPER:SESSION:0X359458718A3003B closed
2016-12-29 14:48:45,105 INFO [Main-eventthread] zookeeper. Clientcnxn:eventthread shut down
2016-12-29 14:48:45,105 INFO [master:master:60000] Master. Hmaster:hmaster Main thread exiting
2016-12-29 14:48:45,107 ERROR [main] master. Hmastercommandline:master exiting
Java.lang.RuntimeException:HMaster aborted
At Org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster (hmastercommandline.java:207)
At Org.apache.hadoop.hbase.master.HMasterCommandLine.run (hmastercommandline.java:135)
At Org.apache.hadoop.util.ToolRunner.run (toolrunner.java:70)
At Org.apache.hadoop.hbase.util.ServerCommandLine.doMain (servercommandline.java:127)
At Org.apache.hadoop.hbase.master.HMaster.main (hmaster.java:3135)
Issue: Start-hbase startup Hmaster Not start, view log the above error occurred. Operation category Read is a supported in the state standby this line of code can be seen, read does not support backup status. Check that the host Namenode my master is in a backup state.
Workaround: Start the namenode of the host on which the configured Hmaster resides, hadoop-daemon.sh start Namenode, and leave it in the active state, at which point the start-hbase is started. The problem that has plagued the day has finally been solved.
Second, check the disk footprint, df-h if the root directory occupies a full space, this can also cause this situation. This will clean up the files under the root directory.
This line
Error Two:
Org.apache.hadoop.hbase.client.RetriesExhaustedException:Failed after attempts=35, exceptions:
Thu Dec 16:42:34 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:35 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:35 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:36 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:38 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:42 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:52 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:02 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:12 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:22 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:42 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:25 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:45 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:05 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:25 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:45 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:129)
At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:90)
At Org.apache.hadoop.hbase.client.ClientScanner.nextScanner (clientscanner.java:264)
At Org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction (clientscanner.java:169)
At Org.apache.hadoop.hbase.client.clientscanner.<init> (clientscanner.java:164)
At Org.apache.hadoop.hbase.client.clientscanner.<init> (clientscanner.java:107)
At Org.apache.hadoop.hbase.client.HTable.getScanner (htable.java:736)
At Org.apache.hadoop.hbase.catalog.MetaReader.fullScan (metareader.java:539)
At Org.apache.hadoop.hbase.catalog.MetaReader.tableExists (metareader.java:310)
At Org.apache.hadoop.hbase.client.HBaseAdmin.tableExists (hbaseadmin.java:279)
At Org.apache.hadoop.hbase.client.HBaseAdmin.tableExists (hbaseadmin.java:293)
At Com.test.dao.ConnectHbase.createTable (connecthbase.java:37)
At Com.test.dao.ConnectHbase.main (connecthbase.java:53)
caused By:java.net.UnknownHostException:unknown host:slave1-4
At Org.apache.hadoop.hbase.ipc.rpcclient$connection.<init> (rpcclient.java:385)
At Org.apache.hadoop.hbase.ipc.RpcClient.createConnection (rpcclient.java:351)
At Org.apache.hadoop.hbase.ipc.RpcClient.getConnection (rpcclient.java:1523)
At Org.apache.hadoop.hbase.ipc.RpcClient.call (rpcclient.java:1435)
At Org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod (rpcclient.java:1654)
At Org.apache.hadoop.hbase.ipc.rpcclient$blockingrpcchannelimplementation.callblockingmethod (RpcClient.java : 1712)
At Org.apache.hadoop.hbase.protobuf.generated.clientprotos$clientservice$blockingstub.scan (ClientProtos.java : 29900)
At Org.apache.hadoop.hbase.client.ScannerCallable.openScanner (scannercallable.java:302)
At Org.apache.hadoop.hbase.client.ScannerCallable.call (scannercallable.java:157)
At Org.apache.hadoop.hbase.client.ScannerCallable.call (scannercallable.java:57)
At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:114)
... More
Problem: Java.net.UnknownHostException:unknown host:xxxx, HBase is not linked to a node on the cluster
Workaround: Modify the Hosts file under local Windows to add the IP of each node of the cluster and the corresponding hostname.