[ https://issues.apache.org/jira/browse/PIG-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683043#comment-15683043 ]
Adam Szita commented on PIG-5052: --------------------------------- Attached new patches with adjusted code style: [^PIG-5052.3.patch] - can be used if we revert the first patch submitted ([^PIG-5052.patch]) [^PIG-5052.3-incrementalToPatch1.patch] - is the incremental diff to [^PIG-5052.patch] in case we don't want to revert My suggestion is to use [^PIG-5052.3.patch] > Initialize MRConfiguration.JOB_ID in spark mode correctly > --------------------------------------------------------- > > Key: PIG-5052 > URL: https://issues.apache.org/jira/browse/PIG-5052 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: liyunzhang_intel > Assignee: Adam Szita > Fix For: spark-branch > > Attachments: PIG-5052.2.patch, PIG-5052.3-incrementalToPatch1.patch, > PIG-5052.3.patch, PIG-5052.patch > > > currently, we initialize MRConfiguration.JOB_ID in SparkUtil#newJobConf. > we just set the value as a random string. > {code} > jobConf.set(MRConfiguration.JOB_ID, UUID.randomUUID().toString()); > {code} > We need to find a spark api to initiliaze it correctly. -- This message was sent by Atlassian JIRA (v6.3.4#6332)