[ https://issues.apache.org/jira/browse/PIG-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268832#comment-16268832 ]
Nandor Kollar commented on PIG-5316: ------------------------------------ Looks like we can't create TaskAttemptID with default constructor, should use the one which gets parameters to avoid NPEs on Hadoop 2.x. Using HadoopShims#getNewTaskAttemptID should solve this, attached PIG-5316_2.patch. > Initialize mapred.task.id property for PoS jobs > ----------------------------------------------- > > Key: PIG-5316 > URL: https://issues.apache.org/jira/browse/PIG-5316 > Project: Pig > Issue Type: Improvement > Components: spark > Reporter: Adam Szita > Assignee: Nandor Kollar > Fix For: 0.18.0 > > Attachments: PIG-5316_1.patch, PIG-5316_2.patch > > > Some downstream systems may require the presence of {{mapred.task.id}} > property (e.g. HCatalog). This is currently not set when Pig On Spark jobs > are started. Let's initialise it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)