Mona Chitnis created PIG-3861: --------------------------------- Summary: duplicate jars get added to distributed cache Key: PIG-3861 URL: https://issues.apache.org/jira/browse/PIG-3861 Project: Pig Issue Type: Bug Reporter: Mona Chitnis Assignee: Mona Chitnis Priority: Minor
PigContext's scriptJars should handle de-duplication of jars to account for script engines e.g. JythonScriptEngine performing various jar loading for module and sometimes adding same jar twice. AlsoJobControlCompiler.shipToHdfs() needs a check against adding the same jar more than once, under different randomly incremented sub-dirs. -- This message was sent by Atlassian JIRA (v6.2#6252)