[ https://issues.apache.org/jira/browse/OOZIE-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891238#comment-15891238 ]
Hadoop QA commented on OOZIE-2802: ---------------------------------- Testing JIRA OOZIE-2802 Cleaning local git workspace ---------------------------- {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:green}+1 RAW_PATCH_ANALYSIS{color} . {color:green}+1{color} the patch does not introduce any @author tags . {color:green}+1{color} the patch does not introduce any tabs . {color:green}+1{color} the patch does not introduce any trailing spaces . {color:green}+1{color} the patch does not introduce any line longer than 132 . {color:green}+1{color} the patch does adds/modifies 1 testcase(s) {color:green}+1 RAT{color} . {color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} . {color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} . {color:green}+1{color} HEAD compiles . {color:green}+1{color} patch compiles . {color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [hadooplibs/hadoop-utils-2]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [tools]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} . {color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations . {color:green}+1{color} the patch does not modify JPA files {color:red}-1 TESTS{color} - patch does not compile, cannot run testcases {color:green}+1 DISTRO{color} . {color:green}+1{color} distro tarball builds with the patch ---------------------------- {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3665/ > Spark action failure on Spark 2.1.0 due to duplicate sharelibs > -------------------------------------------------------------- > > Key: OOZIE-2802 > URL: https://issues.apache.org/jira/browse/OOZIE-2802 > Project: Oozie > Issue Type: Bug > Reporter: Satish Subhashrao Saley > Assignee: Peter Cseh > Attachments: OOZIE-2802-001.patch, OOZIE-2802-002.patch, > spark-2.1-failure-launcherlib.txt > > > There are some same jars in launcher lib and sharelib. These jars are causing > failures in spark action for spark 2.1.0. SPARK-18099 added an exception to > be thrown if same file gets added multiple times to distributed cache. > {code} > $ hdfs dfs -ls /user/saley/share/lib/launcher_20170216150752/oozie > 17/02/16 15:14:22 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > Found 3 items > -rwxr-xr-x 1 saley supergroup 11871 2017-02-16 15:07 > /user/saley/share/lib/launcher_20170216150752/oozie/oozie-hadoop-utils-hadoop-2-4.4.0-SNAPSHOT.jar > -rwxr-xr-x 1 saley supergroup 17514 2017-02-16 15:07 > /user/saley/share/lib/launcher_20170216150752/oozie/oozie-sharelib-hcatalog-4.4.0-SNAPSHOT.jar > -rwxr-xr-x 1 saley supergroup 55092 2017-02-16 15:07 > /user/saley/share/lib/launcher_20170216150752/oozie/oozie-sharelib-oozie-4.4.0-SNAPSHOT.jar > $ hdfs dfs -ls /user/saley/share/lib/lib_20170216150706/oozie > 17/02/16 15:14:39 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable > Found 3 items > -rw-r--r-- 1 saley supergroup 16046 2017-02-16 15:07 > /user/saley/share/lib/lib_20170216150706/oozie/json-simple-1.1.jar > -rw-r--r-- 1 saley supergroup 11871 2017-02-16 15:07 > /user/saley/share/lib/lib_20170216150706/oozie/oozie-hadoop-utils-hadoop-2-4.4.0-SNAPSHOT.jar > -rw-r--r-- 1 saley supergroup 55092 2017-02-16 15:07 > /user/saley/share/lib/lib_20170216150706/oozie/oozie-sharelib-oozie-4.4.0-SNAPSHOT.jar > {code} > The file with same name can't be in twice in any of *--files , --archives, > --jars* (ie one file in both --files and --jars) and can't be in --files > twice and can't be in --archives twice. It is allowed to be in --jars twice. > Possible solutions: > 1. While specifying the --files options, filter out the duplicate jars > 2. Separate out jars and files. Use --jars options to distribute jars and > --files for files. Also remember to remove duplicates from --files, and make > sure that there is nothing common in --jars and --files. -- This message was sent by Atlassian JIRA (v6.3.15#6346)