[
https://issues.apache.org/jira/browse/HIVE-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813138#comment-13813138
]
Eugene Koifman commented on HIVE-5188:
--------------------------------------
Approximate test case from [~deepesh]
'num' => 2,
'setup' => [
{
'method' => 'POST',
'url' => ':TEMPLETON_URL:/templeton/v1/ddl',
'status_code' => 200,
'post_options' => ['user.name=:UNAME:','exec=drop table if
exists templetontest_mr; create table templetontest_mr(name string, age int,
gpa double) STORED AS textfile;'],
'json_field_substr_match' => {'stderr' => 'OK'}
}
],
'method' => 'POST',
'url' => ':TEMPLETON_URL:/templeton/v1/mapreduce/jar',
'post_options' => ['user.name=:UNAME:','usehcatalog=true',
'libjars=:INPDIR_HDFS:/hcatalog-core.jar',
'jar=:INPDIR_HDFS:/testudf.jar',
'class=org.apache.hcatalog.utils.ReadWrite',
'arg=:THRIFTSERVER:', 'arg=studenttab10k',
'arg=templetontest_mr'],
'json_field_substr_match' => { 'id' => '\d+'},
#results
'status_code' => 200,
'check_job_created' => 1,
'check_job_complete' => 'SUCCESS',
'check_job_exit_value' => 0,
'check_call_back' => 1,
> MR job launched through WebHCat fails to find additional jars in classpath
> --------------------------------------------------------------------------
>
> Key: HIVE-5188
> URL: https://issues.apache.org/jira/browse/HIVE-5188
> Project: Hive
> Issue Type: Bug
> Components: WebHCat
> Affects Versions: 0.12.0
> Reporter: Deepesh Khandelwal
> Assignee: Eugene Koifman
>
> When running MR job using jar (compiled with external dependencies eg.
> HCatInputFormat, HCatOutputFormat) through WebHCat the job fails complaining
> about missing HCat classes. I did pass those through the libjars argument but
> it seems that we run the hadoop jar locally on the tasktracker node and so it
> doesn't have the additional classes in the HADOOP_CLASSPATH. To get around
> the problem I had to explicitly add the additional jar dependencies in the
> hadoop-env.sh.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
