RE: Can WebHCat show non-MapReduce jobs?

[Xiaoyong Zhu]

Ping... not sure anybody has more ideas here...?

Xiaoyong

From: Xiaoyong Zhu [mailto:xiaoy...@microsoft.com]
Sent: Thursday, March 26, 2015 9:07 AM
To: user@hive.apache.org
Cc: ekoif...@hortonworks.com
Subject: RE: Can WebHCat show non-MapReduce jobs?

Thanks for the reply, Eugene. However, when I try to list the jobs via WebHCat 
(via /templeton/v1/jobs):

[{"id":"job_1427201295241_0001","detail":null},{"id":"job_1427201295241_0003","detail":null},{"id":"job_1427201295241_0005","detail":null}]
As you can see, there are three jobs there: 0001,0003 and 0005. However, I 
submitted three Hive on Tez jobs.

However, in YARN UI, I can see 6 jobs, where 0002, 0004, 0006 (which do not 
exist in WebHCat) are shown here.

[cid:image001.png@01D07107.4B48B3F0]
Maybe something is wrong with my configurations?

Xiaoyong

From: Eugene Koifman [mailto:ekoif...@hortonworks.com]
Sent: Thursday, March 26, 2015 12:52 AM
To: user@hive.apache.org<mailto:user@hive.apache.org>
Subject: Re: Can WebHCat show non-MapReduce jobs?

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Jobs should 
produce all jobs (assuming the calling user has permissions to see them).
templeton.Server.showJobList() has detailed JavaDoc

From: Xiaoyong Zhu mailto:xiaoy...@microsoft.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" 
mailto:user@hive.apache.org>>
Date: Wednesday, March 25, 2015 at 5:35 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>" 
mailto:user@hive.apache.org>>
Subject: Can WebHCat show non-MapReduce jobs?

It seems that WebHCat could only show the Map Reduce jobs - for example, if I 
submit a Hive on Tez job via WebHCat, I can only get the TempletonControllerJob 
ID (which is a MAPREDUCE job) but I cannot get the Tez job ID (which is 
launched by TempletonControllerJob).

Is this by design? Is there a way to return all type of jobs via WebHCat?

Xiaoyong

RE: Can WebHCat show non-MapReduce jobs?

[Xiaoyong Zhu]

Thanks for the reply, Eugene. However, when I try to list the jobs via WebHCat 
(via /templeton/v1/jobs):

[{"id":"job_1427201295241_0001","detail":null},{"id":"job_1427201295241_0003","detail":null},{"id":"job_1427201295241_0005","detail":null}]
As you can see, there are three jobs there: 0001,0003 and 0005. However, I 
submitted three Hive on Tez jobs.

However, in YARN UI, I can see 6 jobs, where 0002, 0004, 0006 (which do not 
exist in WebHCat) are shown here.

[cid:image001.png@01D067A4.3C21F420]
Maybe something is wrong with my configurations?

Xiaoyong

From: Eugene Koifman [mailto:ekoif...@hortonworks.com]
Sent: Thursday, March 26, 2015 12:52 AM
To: user@hive.apache.org
Subject: Re: Can WebHCat show non-MapReduce jobs?

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Jobs should 
produce all jobs (assuming the calling user has permissions to see them).
templeton.Server.showJobList() has detailed JavaDoc

From: Xiaoyong Zhu mailto:xiaoy...@microsoft.com>>
Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" 
mailto:user@hive.apache.org>>
Date: Wednesday, March 25, 2015 at 5:35 AM
To: "user@hive.apache.org<mailto:user@hive.apache.org>" 
mailto:user@hive.apache.org>>
Subject: Can WebHCat show non-MapReduce jobs?

It seems that WebHCat could only show the Map Reduce jobs - for example, if I 
submit a Hive on Tez job via WebHCat, I can only get the TempletonControllerJob 
ID (which is a MAPREDUCE job) but I cannot get the Tez job ID (which is 
launched by TempletonControllerJob).

Is this by design? Is there a way to return all type of jobs via WebHCat?

Xiaoyong

Re: Can WebHCat show non-MapReduce jobs?

[Eugene Koifman]

https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Jobs should 
produce all jobs (assuming the calling user has permissions to see them).
templeton.Server.showJobList() has detailed JavaDoc

From: Xiaoyong Zhu mailto:xiaoy...@microsoft.com>>
Reply-To: "user@hive.apache.org" 
mailto:user@hive.apache.org>>
Date: Wednesday, March 25, 2015 at 5:35 AM
To: "user@hive.apache.org" 
mailto:user@hive.apache.org>>
Subject: Can WebHCat show non-MapReduce jobs?

It seems that WebHCat could only show the Map Reduce jobs - for example, if I 
submit a Hive on Tez job via WebHCat, I can only get the TempletonControllerJob 
ID (which is a MAPREDUCE job) but I cannot get the Tez job ID (which is 
launched by TempletonControllerJob).

Is this by design? Is there a way to return all type of jobs via WebHCat?

Xiaoyong