Feng Yuan created HIVE-12454: -------------------------------- Summary: in tez model when i use add jar xxx query will fail Key: HIVE-12454 URL: https://issues.apache.org/jira/browse/HIVE-12454 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 0.14.0 Reporter: Feng Yuan Fix For: 1.3.0
whatever hql only if i use add jar udf.jar hql will throws out these: Status: Running (Executing on YARN cluster with App id application_1447448264041_0723) -------------------------------------------------------------------------------- VERTICES STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED -------------------------------------------------------------------------------- Map 1 FAILED -1 0 0 -1 0 0 Map 2 FAILED -1 0 0 -1 0 0 -------------------------------------------------------------------------------- VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.27 s -------------------------------------------------------------------------------- Status: Failed Vertex failed, vertexName=Map 2, vertexId=vertex_1447448264041_0723_1_00, diagnostics=[Vertex vertex_1447448264041_0723_1_00 [Map 2] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: mid_bdi_customer_online initializer failed, vertex=vertex_1447448264041_0723_1_00 [Map 2], java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getMergedCredentials(Lorg/apache/hadoop/mapred/JobConf;)V at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:104) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ] Vertex failed, vertexName=Map 1, vertexId=vertex_1447448264041_0723_1_01, diagnostics=[Vertex vertex_1447448264041_0723_1_01 [Map 1] killed/failed due to:ROOT_INPUT_INIT_FAILURE, Vertex Input: raw_kafka_event_pageview_dt0 initializer failed, vertex=vertex_1447448264041_0723_1_01 [Map 1], java.lang.NoSuchMethodError: org.apache.hadoop.hive.shims.HadoopShims.getMergedCredentials(Lorg/apache/hadoop/mapred/JobConf;)V at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:104) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:245) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable$1.run(RootInputInitializerManager.java:239) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:239) at org.apache.tez.dag.app.dag.RootInputInitializerManager$InputInitializerCallable.call(RootInputInitializerManager.java:226) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ] DAG failed due to vertex failure. failedVertices:2 killedVertices:0 FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask sometime is NoSuchMethodError other package such as org.apache.hadoop.hive.ql.log.PerfLogger.PerfLogBegin(Ljava/lang/String;Ljava/lang/String;)V or something. -- This message was sent by Atlassian JIRA (v6.3.4#6332)