[ https://issues.apache.org/jira/browse/PIG-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated PIG-3861: ------------------------------------ Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committed to branch-0.14 and trunk. Thanks Mona for the patch and Daniel for the review. > duplicate jars get added to distributed cache > --------------------------------------------- > > Key: PIG-3861 > URL: https://issues.apache.org/jira/browse/PIG-3861 > Project: Pig > Issue Type: Bug > Reporter: Mona Chitnis > Assignee: Mona Chitnis > Priority: Minor > Fix For: 0.14.0 > > Attachments: PIG-3681-1.patch, PIG-3861-2.patch, PIG-3861-3.patch, > PIG-3861-4.patch, PIG-3861-5.patch > > > PigContext's scriptJars should handle de-duplication of jars to account for > script engines e.g. JythonScriptEngine performing various jar loading for > module and sometimes adding same jar twice. > AlsoJobControlCompiler.shipToHdfs() needs a check against adding the same jar > more than once, under different randomly incremented sub-dirs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)