HBase operation category READ is not supported on State standby

Source: Internet
Author: User
Tags thread zookeeper
2016-12-29 14:48:44,188 INFO [master:master:60000] http. Httpserver:jetty bound to Port 60010
2016-12-29 14:48:44,188 INFO [master:master:60000] mortbay.log:jetty-6.1.26
2016-12-29 14:48:44,721 INFO [master:master:60000] mortbay.log:Started selectchannelconnector@0.0.0.0:60010
2016-12-29 14:48:44,822 DEBUG [Main-eventthread] Master. ACTIVEMASTERMANAGER:A Master is now available
2016-12-29 14:48:44,826 INFO [master:master:60000] Master. activemastermanager:registered Active master=master,60000,1482994123213
2016-12-29 14:48:44,861 INFO [master:master:60000] Configuration.deprecation:fs.default.name is deprecated. Instead, use Fs.defaultfs
2016-12-29 14:48:44,972 FATAL [master:master:60000] Master. Hmaster:unhandled exception. Starting shutdown.
Org.apache.hadoop.ipc.RemoteException (org.apache.hadoop.ipc.StandbyException): Operation category READ is not Supported in State standby
At Org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation (standbystate.java:87)
At Org.apache.hadoop.hdfs.server.namenode.namenode$namenodehacontext.checkoperation (NameNode.java:1774)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation (fsnamesystem.java:1313)
At Org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getFileInfo (fsnamesystem.java:3850)
At Org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getFileInfo (namenoderpcserver.java:1011)
At Org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getFileInfo ( clientnamenodeprotocolserversidetranslatorpb.java:843)
At org.apache.hadoop.hdfs.protocol.proto.clientnamenodeprotocolprotos$clientnamenodeprotocol$2. Callblockingmethod (Clientnamenodeprotocolprotos.java)
At Org.apache.hadoop.ipc.protobufrpcengine$server$protobufrpcinvoker.call (protobufrpcengine.java:616)
At Org.apache.hadoop.ipc.rpc$server.call (rpc.java:969)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2049)
At Org.apache.hadoop.ipc.server$handler$1.run (server.java:2045)
At java.security.AccessController.doPrivileged (Native Method)
At Javax.security.auth.Subject.doAs (subject.java:422)
At Org.apache.hadoop.security.UserGroupInformation.doAs (usergroupinformation.java:1657)
At Org.apache.hadoop.ipc.server$handler.run (server.java:2043)


At Org.apache.hadoop.ipc.Client.call (client.java:1347)
At Org.apache.hadoop.ipc.Client.call (client.java:1300)
At Org.apache.hadoop.ipc.protobufrpcengine$invoker.invoke (protobufrpcengine.java:206)
At Com.sun.proxy. $Proxy 10.getFileInfo (Unknown Source)
At Sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
At Sun.reflect.NativeMethodAccessorImpl.invoke (nativemethodaccessorimpl.java:62)
At Sun.reflect.DelegatingMethodAccessorImpl.invoke (delegatingmethodaccessorimpl.java:43)
At Java.lang.reflect.Method.invoke (method.java:498)
At Org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod (retryinvocationhandler.java:186)
At Org.apache.hadoop.io.retry.RetryInvocationHandler.invoke (retryinvocationhandler.java:102)
At Com.sun.proxy. $Proxy 10.getFileInfo (Unknown Source)
At Org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo ( clientnamenodeprotocoltranslatorpb.java:651)
At Org.apache.hadoop.hdfs.DFSClient.getFileInfo (dfsclient.java:1679)
At Org.apache.hadoop.hdfs.distributedfilesystem$17.docall (distributedfilesystem.java:1106)
At Org.apache.hadoop.hdfs.distributedfilesystem$17.docall (distributedfilesystem.java:1102)
At Org.apache.hadoop.fs.FileSystemLinkResolver.resolve (filesystemlinkresolver.java:81)
At Org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus (distributedfilesystem.java:1102)
At Org.apache.hadoop.fs.FileSystem.exists (filesystem.java:1397)
At Org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir (masterfilesystem.java:450)
At Org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout (masterfilesystem.java:154)
At Org.apache.hadoop.hbase.master.masterfilesystem.<init> (masterfilesystem.java:130)
At Org.apache.hadoop.hbase.master.HMaster.finishInitialization (hmaster.java:889)
At Org.apache.hadoop.hbase.master.HMaster.run (hmaster.java:692)
At Java.lang.Thread.run (thread.java:745)
2016-12-29 14:48:44,975 INFO [master:master:60000] Master. Hmaster:aborting
2016-12-29 14:48:44,975 DEBUG [master:master:60000] Master. Hmaster:stopping Service Threads
2016-12-29 14:48:44,975 INFO [master:master:60000] IPC. Rpcserver:stopping Server on 60000
2016-12-29 14:48:44,976 INFO [rpcserver.listener,port=60000] IPC. Rpcserver:rpcserver.listener,port=60000:stopping
2016-12-29 14:48:44,980 INFO [master:master:60000] Master. Hmaster:stopping Infoserver
2016-12-29 14:48:44,980 INFO [Rpcserver.responder] IPC. RpcServer:RpcServer.responder:stopped
2016-12-29 14:48:44,980 INFO [Rpcserver.responder] IPC. RpcServer:RpcServer.responder:stopping
2016-12-29 14:48:44,982 INFO [master:master:60000] mortbay.log:Stopped selectchannelconnector@0.0.0.0:60010
2016-12-29 14:48:45,105 INFO [master:master:60000] zookeeper. ZOOKEEPER:SESSION:0X359458718A3003B closed
2016-12-29 14:48:45,105 INFO [Main-eventthread] zookeeper. Clientcnxn:eventthread shut down
2016-12-29 14:48:45,105 INFO [master:master:60000] Master. Hmaster:hmaster Main thread exiting
2016-12-29 14:48:45,107 ERROR [main] master. Hmastercommandline:master exiting
Java.lang.RuntimeException:HMaster aborted
At Org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster (hmastercommandline.java:207)
At Org.apache.hadoop.hbase.master.HMasterCommandLine.run (hmastercommandline.java:135)
At Org.apache.hadoop.util.ToolRunner.run (toolrunner.java:70)
At Org.apache.hadoop.hbase.util.ServerCommandLine.doMain (servercommandline.java:127)

At Org.apache.hadoop.hbase.master.HMaster.main (hmaster.java:3135)

Issue: Start-hbase startup Hmaster Not start, view log the above error occurred. Operation category Read is a supported in the state standby this line of code can be seen, read does not support backup status. Check that the host Namenode my master is in a backup state.

Workaround: Start the namenode of the host on which the configured Hmaster resides, hadoop-daemon.sh start Namenode, and leave it in the active state, at which point the start-hbase is started. The problem that has plagued the day has finally been solved.

Second, check the disk footprint, df-h if the root directory occupies a full space, this can also cause this situation. This will clean up the files under the root directory.

This line

Error Two:

Org.apache.hadoop.hbase.client.RetriesExhaustedException:Failed after attempts=35, exceptions:
Thu Dec 16:42:34 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:35 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:35 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:36 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:38 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:42 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:42:52 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:02 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:12 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:22 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:43:42 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:44:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:45:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:23 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:46:43 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:03 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:47:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:48:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:24 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:49:44 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:04 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:25 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:50:45 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:05 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:25 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4
Thu Dec 16:51:45 CST, org.apache.hadoop.hbase.client.rpcretryingcaller@6e0f5f7f, Java.net.UnknownHostException:unknown host:slave1-4


At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:129)
At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:90)
At Org.apache.hadoop.hbase.client.ClientScanner.nextScanner (clientscanner.java:264)
At Org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction (clientscanner.java:169)
At Org.apache.hadoop.hbase.client.clientscanner.<init> (clientscanner.java:164)
At Org.apache.hadoop.hbase.client.clientscanner.<init> (clientscanner.java:107)
At Org.apache.hadoop.hbase.client.HTable.getScanner (htable.java:736)
At Org.apache.hadoop.hbase.catalog.MetaReader.fullScan (metareader.java:539)
At Org.apache.hadoop.hbase.catalog.MetaReader.tableExists (metareader.java:310)
At Org.apache.hadoop.hbase.client.HBaseAdmin.tableExists (hbaseadmin.java:279)
At Org.apache.hadoop.hbase.client.HBaseAdmin.tableExists (hbaseadmin.java:293)
At Com.test.dao.ConnectHbase.createTable (connecthbase.java:37)
At Com.test.dao.ConnectHbase.main (connecthbase.java:53)
caused By:java.net.UnknownHostException:unknown host:slave1-4
At Org.apache.hadoop.hbase.ipc.rpcclient$connection.<init> (rpcclient.java:385)
At Org.apache.hadoop.hbase.ipc.RpcClient.createConnection (rpcclient.java:351)
At Org.apache.hadoop.hbase.ipc.RpcClient.getConnection (rpcclient.java:1523)
At Org.apache.hadoop.hbase.ipc.RpcClient.call (rpcclient.java:1435)
At Org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod (rpcclient.java:1654)
At Org.apache.hadoop.hbase.ipc.rpcclient$blockingrpcchannelimplementation.callblockingmethod (RpcClient.java : 1712)
At Org.apache.hadoop.hbase.protobuf.generated.clientprotos$clientservice$blockingstub.scan (ClientProtos.java : 29900)
At Org.apache.hadoop.hbase.client.ScannerCallable.openScanner (scannercallable.java:302)
At Org.apache.hadoop.hbase.client.ScannerCallable.call (scannercallable.java:157)
At Org.apache.hadoop.hbase.client.ScannerCallable.call (scannercallable.java:57)
At Org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries (rpcretryingcaller.java:114)
... More


Problem: Java.net.UnknownHostException:unknown host:xxxx, HBase is not linked to a node on the cluster

Workaround: Modify the Hosts file under local Windows to add the IP of each node of the cluster and the corresponding hostname.


Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.