[ https://issues.apache.org/jira/browse/TEZ-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17826814#comment-17826814 ]
Venkatasubrahmanian Narayanan commented on TEZ-4547: ---------------------------------------------------- Github PR: https://github.com/apache/tez/pull/339 > Add Tez AM JobID to the JobConf > ------------------------------- > > Key: TEZ-4547 > URL: https://issues.apache.org/jira/browse/TEZ-4547 > Project: Apache Tez > Issue Type: Improvement > Affects Versions: 0.10.2 > Reporter: Venkatasubrahmanian Narayanan > Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Tez creates JobIDs for tasks by appending the vertex index to the cluster > timestamp to avoid multiple jobs run in a single Tez session sharing a JobID. > Hadoop's MagicS3GuardCommitter needs a job-wide UUID to ensure that the task > committers and the job committer write to/read from the same paths and can > hence actually commit data. Adding the AM's JobID to the Configuration > objects allows applications like Hive to pass that as the UUID to the > committer. -- This message was sent by Atlassian Jira (v8.20.10#820010)