[ 
https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268832#comment-16268832
 ] 

Nandor Kollar commented on PIG-5316:
------------------------------------

Looks like we can't create TaskAttemptID with default constructor, should use 
the one which gets parameters to avoid NPEs on Hadoop 2.x. Using 
HadoopShims#getNewTaskAttemptID should solve this, attached PIG-5316_2.patch.

> Initialize mapred.task.id property for PoS jobs
> -----------------------------------------------
>
>                 Key: PIG-5316
>                 URL: https://issues.apache.org/jira/browse/PIG-5316
>             Project: Pig
>          Issue Type: Improvement
>          Components: spark
>            Reporter: Adam Szita
>            Assignee: Nandor Kollar
>             Fix For: 0.18.0
>
>         Attachments: PIG-5316_1.patch, PIG-5316_2.patch
>
>
> Some downstream systems may require the presence of {{mapred.task.id}} 
> property (e.g. HCatalog). This is currently not set when Pig On Spark jobs 
> are started. Let's initialise it.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to