hive中刪除表的錯誤Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException

標籤：hive   mysql   

1：請看操作

[[email protected] hive-0.12.0-bin]$ hiveLogging initialized using configuration in jar:file:/home/jifeng/hadoop/hive-0.12.0-bin/lib/hive-common-0.12.0.jar!/hive-log4j.propertieshive> show tables;OKt1tianqtianqiTime taken: 3.338 seconds, Fetched: 3 row(s)hive> drop table t1;FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Iteration request failed : SELECT `A0`.`COMMENT`,`A0`.`COLUMN_NAME`,`A0`.`TYPE_NAME`,`A0`.`INTEGER_IDX` AS NUCORDER0 FROM `COLUMNS_V2` `A0` WHERE `A0`.`CD_ID` = ? AND `A0`.`INTEGER_IDX` >= 0 ORDER BY NUCORDER0        at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)        at org.datanucleus.api.jdo.JDOPersistenceManager.jdoRetrieve(JDOPersistenceManager.java:610)        at org.datanucleus.api.jdo.JDOPersistenceManager.retrieve(JDOPersistenceManager.java:622)        at org.datanucleus.api.jdo.JDOPersistenceManager.retrieve(JDOPersistenceManager.java:631)        at org.apache.hadoop.hive.metastore.ObjectStore.removeUnusedColumnDescriptor(ObjectStore.java:2293)        at org.apache.hadoop.hive.metastore.ObjectStore.preDropStorageDescriptor(ObjectStore.java:2321)        at org.apache.hadoop.hive.metastore.ObjectStore.dropTable(ObjectStore.java:742)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:124)        at com.sun.proxy.$Proxy10.dropTable(Unknown Source)        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_core(HiveMetaStore.java:1192)        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_with_environment_context(HiveMetaStore.java:1328)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:103)        at com.sun.proxy.$Proxy11.drop_table_with_environment_context(Unknown Source)        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.dropTable(HiveMetaStoreClient.java:671)        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.dropTable(HiveMetaStoreClient.java:647)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:89)        at com.sun.proxy.$Proxy12.dropTable(Unknown Source)        at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:869)        at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:836)        at org.apache.hadoop.hive.ql.exec.DDLTask.dropTable(DDLTask.java:3329)        at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:277)        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:65)        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1414)        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1192)        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1020)        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.util.RunJar.main(RunJar.java:160)NestedThrowablesStackTrace:com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)        at com.mysql.jdbc.Util.handleNewInstance(Util.java:406)        at com.mysql.jdbc.Util.getInstance(Util.java:381)        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1030)        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:956)        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3491)        at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3423)        at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1936)        at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2060)        at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2536)        at com.mysql.jdbc.StatementImpl.executeSimpleNonQuery(StatementImpl.java:1463)        at com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:1869)        at com.jolbox.bonecp.PreparedStatementHandle.executeQuery(PreparedStatementHandle.java:172)        at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeQuery(ParamLoggingPreparedStatement.java:381)        at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:504)        at org.datanucleus.store.rdbms.scostore.JoinListStore.listIterator(JoinListStore.java:748)        at org.datanucleus.store.rdbms.scostore.AbstractListStore.listIterator(AbstractListStore.java:92)        at org.datanucleus.store.rdbms.scostore.AbstractListStore.iterator(AbstractListStore.java:82)        at org.datanucleus.store.types.backed.List.loadFromStore(List.java:300)        at org.datanucleus.store.types.backed.List.load(List.java:273)        at org.datanucleus.state.JDOStateManager.loadUnloadedFields(JDOStateManager.java:2967)        at org.datanucleus.api.jdo.state.Hollow.transitionRetrieve(Hollow.java:168)        at org.datanucleus.state.AbstractStateManager.retrieve(AbstractStateManager.java:598)        at org.datanucleus.ExecutionContextImpl.retrieveObject(ExecutionContextImpl.java:1778)        at org.datanucleus.ExecutionContextThreadedImpl.retrieveObject(ExecutionContextThreadedImpl.java:203)        at org.datanucleus.api.jdo.JDOPersistenceManager.jdoRetrieve(JDOPersistenceManager.java:605)        at org.datanucleus.api.jdo.JDOPersistenceManager.retrieve(JDOPersistenceManager.java:622)        at org.datanucleus.api.jdo.JDOPersistenceManager.retrieve(JDOPersistenceManager.java:631)        at org.apache.hadoop.hive.metastore.ObjectStore.removeUnusedColumnDescriptor(ObjectStore.java:2293)        at org.apache.hadoop.hive.metastore.ObjectStore.preDropStorageDescriptor(ObjectStore.java:2321)        at org.apache.hadoop.hive.metastore.ObjectStore.dropTable(ObjectStore.java:742)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingRawStore.invoke(RetryingRawStore.java:124)        at com.sun.proxy.$Proxy10.dropTable(Unknown Source)        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_core(HiveMetaStore.java:1192)        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.drop_table_with_environment_context(HiveMetaStore.java:1328)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:103)        at com.sun.proxy.$Proxy11.drop_table_with_environment_context(Unknown Source)        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.dropTable(HiveMetaStoreClient.java:671)        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.dropTable(HiveMetaStoreClient.java:647)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:89)        at com.sun.proxy.$Proxy12.dropTable(Unknown Source)        at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:869)        at org.apache.hadoop.hive.ql.metadata.Hive.dropTable(Hive.java:836)        at org.apache.hadoop.hive.ql.exec.DDLTask.dropTable(DDLTask.java:3329)        at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:277)        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:151)        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:65)        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1414)        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1192)        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1020)        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.util.RunJar.main(RunJar.java:160))hive> show tables;  OKt1tianqtianqiTime taken: 0.033 seconds, Fetched: 3 row(s)hive> drop table tianq;FAILED: SemanticException [Error 10001]: Table not found tianqhive> show tables;     OKt1tianqtianqiTime taken: 0.022 seconds, Fetched: 3 row(s)

記得前2天用sqoop從mysql匯入資料到hive出現的錯誤，後面替換mysql-connector-java-5.1.32-bin.jar包解決問題的

我也用這個新的包試試，並且把mysql-connector-java-5.1.6-bin.jar刪除

[[email protected] mysql-connector-java-5.1.32]$ cp mysql-connector-java-5.1.32-bin.jar /home/jifeng/hadoop/hive-0.12.0-bin/lib[[email protected] mysql-connector-java-5.1.32]$ cd ..[[email protected] ~]$ cd  /home/jifeng/hadoop/hive-0.12.0-bin/lib[[email protected] lib]$ rm mysql-connector-java-5.1.6-bin.jar 

問題解決了，估計是mysql的bug吧

[[email protected] hive-0.12.0-bin]$ hiveLogging initialized using configuration in jar:file:/home/jifeng/hadoop/hive-0.12.0-bin/lib/hive-common-0.12.0.jar!/hive-log4j.propertieshive> show tables;OKt1tianqtianqiTime taken: 2.182 seconds, Fetched: 3 row(s)hive> drop table t1;OKTime taken: 1.02 secondshive> select * from tianq;OKTime taken: 0.192 secondshive> drop table tianq;OKTime taken: 0.28 seconds

hive中刪除表的錯誤Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException