[
https://issues.apache.org/jira/browse/HCATALOG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13672762#comment-13672762
]
Gautam Kowshik edited comment on HCATALOG-647 at 6/3/13 3:21 AM:
-----------------------------------------------------------------
patched, built and restarted our webhcat instance. We now
percentComplete, jobid and parent id are aas expected.
{code}
{"status":{"startTime":1370226370481,"jobID":{"jtIdentifier":"201305221934","id":831},"jobPriority":"NORMAL","username":"wand","failureInfo":"NA","runState":1,"schedulingInfo":"NA",
"jobId":"job_201305221934_0831","jobACLs":{},"jobComplete":false},"profile":{"url":"http://localhost:50030/jobdetails.jsp?jobid=job_201305221934_0831","user":"wand","jobID":{"jtIdentifier":"201305221934","id":831},"jobName":"select
count(*) from
db_gk....utc_timestamp(Stage-1)","queueName":"default","jobFile":"hdfs://localhost:8020/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/wand/.staging/job_201305221934_0831/job.xml","jobId":"job_201305221934_0831"},
"id":"job_201305221934_0831","parentId":"job_201305221934_0830","percentComplete":"map
= 33%, reduce = 0%","exitValue":null,
"user":"wand","callback":"http://gautam-kowshik.dev.kt-engineering.com:8302/hquery/query/$jobId/completed","completed":null}
{code}
was (Author: gkowshik):
patched, built and restarted our webhcat instance. We now
percentComplete, jobid and parent id are aas expected.
{code}
{"status":{"startTime":1370226370481,"jobID":{"jtIdentifier":"201305221934","id":831},"jobPriority":"NORMAL","username":"wand","failureInfo":"NA","runState":1,"schedulingInfo":"NA",
"jobId":"job_201305221934_0831","jobACLs":{},"jobComplete":false},"profile":{"url":"http://mains-2.dev.kt-engineering.com:50030/jobdetails.jsp?jobid=job_201305221934_0831","user":"wand","jobID":{"jtIdentifier":"201305221934","id":831},"jobName":"select
count(*) from
db_gk....utc_timestamp(Stage-1)","queueName":"default","jobFile":"hdfs://mains-2.dev.kt-engineering.com:8020/var/lib/hadoop-hdfs/cache/mapred/mapred/staging/wand/.staging/job_201305221934_0831/job.xml","jobId":"job_201305221934_0831"},
"id":"job_201305221934_0831","parentId":"job_201305221934_0830","percentComplete":"map
= 33%, reduce = 0%","exitValue":null,
"user":"wand","callback":"http://gautam-kowshik.dev.kt-engineering.com:8302/hquery/query/$jobId/completed","completed":null}
{code}
> Webhcat resource /templeton/v1/status doesn't track Hive job progress
> ---------------------------------------------------------------------
>
> Key: HCATALOG-647
> URL: https://issues.apache.org/jira/browse/HCATALOG-647
> Project: HCatalog
> Issue Type: Bug
> Components: webhcat-svr
> Affects Versions: 0.5
> Reporter: Gautam Kowshik
> Fix For: 0.5
>
> Attachments:
> 0001-HCATALOG-647-Added-ability-to-parse-child-job-id-and.patch
>
>
> Problem: Unable to track Hive job progress through webhcat.
> Cause:
> TempletonUtils has code to parse PIG and JAR child jobid and percentage
> progress but none for Hive jobs. extractPercentComplete() and
> extractChildJobId() are supposed to do this parsing.
> Effect:
> /templeton/v1/queue/$job_id?user.name=$user returns no job progress info. The
> jobid param in the json result that's supposed to contain the child hive
> jobid contains the templetoncontrollerjob id instead leaving the parent jobid
> null.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
