[
https://issues.apache.org/jira/browse/TEZ-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated TEZ-986:
-----------------------------------
Description:
Would like to have the conf set on DAG and Vertex
1) viewable in Tez UI after the job completes. This is very essential for
debugging jobs.
2) We have processes, that parse jobconf.xml from job history (hdfs) and load
them into hive tables for analysis. Would like to have Tez also make all the
configuration (byte array) available in job history so that we can similarly
parse them. 1) mandates that you store it in hdfs. 2) is just to say make the
format stored as a contract others can rely on for parsing.
was: We have processes, that parse jobconf.xml from job history (hdfs) and
load them into hive tables for analysis. Would like to have Tez also make all
the configuration (byte array) available in job history.
> Make conf set on DAG and vertex available in jobhistory
> -------------------------------------------------------
>
> Key: TEZ-986
> URL: https://issues.apache.org/jira/browse/TEZ-986
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Rohini Palaniswamy
>
> Would like to have the conf set on DAG and Vertex
> 1) viewable in Tez UI after the job completes. This is very essential for
> debugging jobs.
> 2) We have processes, that parse jobconf.xml from job history (hdfs) and
> load them into hive tables for analysis. Would like to have Tez also make all
> the configuration (byte array) available in job history so that we can
> similarly parse them. 1) mandates that you store it in hdfs. 2) is just to
> say make the format stored as a contract others can rely on for parsing.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
