Venkatasubrahmanian Narayanan created TEZ-4547:
--------------------------------------------------
Summary: Add Tez AM JobID to the Configuration object
Key: TEZ-4547
URL: https://issues.apache.org/jira/browse/TEZ-4547
Project: Apache Tez
Issue Type: Improvement
Affects Versions: 0.10.2
Reporter: Venkatasubrahmanian Narayanan
Tez creates JobIDs for tasks by appending the vertex index to the cluster
timestamp to avoid multiple jobs run in a single Tez session sharing a JobID.
Hadoop's MagicS3GuardCommitter needs a job-wide UUID to ensure that the task
committers and the job committer write to/read from the same paths and can
hence actually commit data. Adding the AM's JobID to the Configuration objects
allows applications like Hive to pass that as the UUID to the committer.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
