[
https://issues.apache.org/jira/browse/BIGTOP-1349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14049794#comment-14049794
]
Guodong Wang commented on BIGTOP-1349:
--------------------------------------
[~rvs], Thanks for reply.
I think this issue happens before the Ooize hive action is submitted. This
issue happens during preparing hive action.
When hive action is submitted, the MR container will download the hive jars
from HDFS. Class not found should not be there.
Actually, this issue happens when Oozie is preparing hive action in secure
Hadoop/Hive cluster. Because Oozie should get hcatalog credential and put it
into the action conf, then after hive action is submitted, hive action can use
this credential to talk to metastore server.
After I put the hive jars into the Oozie catalina classpath, the issue is fixed.
So, I think adding hive dependency to make sure the Oozie host has hive jars
can solve this issue.
> oozie fail to execute Hive action in secure cluster
> ---------------------------------------------------
>
> Key: BIGTOP-1349
> URL: https://issues.apache.org/jira/browse/BIGTOP-1349
> Project: Bigtop
> Issue Type: Bug
> Components: RPM
> Reporter: Guodong Wang
>
> When executing Hive action in secure hadoop cluster, the following error is
> got
> {noformat}
> 20:24:52,497 ERROR ActionStartXCommand:536 - USER[***] GROUP[-] TOKEN[]
> APP[hive-wf] JOB[0000000-140619202307001-oozie-oozi-W]
> ACTION[0000000-140619202307001-oozie-oozi-W@hive-node] Error,
> java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf
> at
> org.apache.oozie.action.hadoop.HCatCredentialHelper.getHCatClient(HCatCredentialHelper.java:79)
> at
> org.apache.oozie.action.hadoop.HCatCredentialHelper.set(HCatCredentialHelper.java:52)
> at
> org.apache.oozie.action.hadoop.HCatCredentials.addtoJobConf(HCatCredentials.java:58)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:869)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:731)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:945)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:215)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:60)
> at org.apache.oozie.command.XCommand.call(XCommand.java:280)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
> at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> Exception in thread "pool-2-thread-9" java.lang.NoClassDefFoundError:
> org/apache/hadoop/hive/conf/HiveConf
> at
> org.apache.oozie.action.hadoop.HCatCredentialHelper.getHCatClient(HCatCredentialHelper.java:79)
> at
> org.apache.oozie.action.hadoop.HCatCredentialHelper.set(HCatCredentialHelper.java:52)
> at
> org.apache.oozie.action.hadoop.HCatCredentials.addtoJobConf(HCatCredentials.java:58)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:869)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:731)
> at
> org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:945)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:215)
> at
> org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:60)
> at org.apache.oozie.command.XCommand.call(XCommand.java:280)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
> at
> org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
> at
> org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
