[
https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259301#comment-16259301
]
Xuefu Zhang commented on PIG-5316:
----------------------------------
[~nkollar], while it might be just an placeholder, it's used to create staging
scratch or staging directories. I think we should follow the custom format of a
task id. You might want to check Pig code where this is set. As another
reference, you can find how Hive on Spark sets it in
{{HivePairFlatMapFunction.jara}}.
> Initialize mapred.task.id property for PoS jobs
> -----------------------------------------------
>
> Key: PIG-5316
> URL: https://issues.apache.org/jira/browse/PIG-5316
> Project: Pig
> Issue Type: Improvement
> Components: spark
> Reporter: Adam Szita
> Assignee: Nandor Kollar
>
> Some downstream systems may require the presence of {{mapred.task.id}}
> property (e.g. HCatalog). This is currently not set when Pig On Spark jobs
> are started. Let's initialise it.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
