[ https://issues.apache.org/jira/browse/OOZIE-2787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15859120#comment-15859120 ]
Hadoop QA commented on OOZIE-2787: ---------------------------------- Testing JIRA OOZIE-2787 Cleaning local git workspace ---------------------------- {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} . {color:green}+1{color} the patch does not introduce any @author tags . {color:green}+1{color} the patch does not introduce any tabs . {color:green}+1{color} the patch does not introduce any trailing spaces . {color:green}+1{color} the patch does not introduce any line longer than 132 . {color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} . {color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} . {color:green}+1{color} the patch does not seem to introduce new Javadoc warnings {color:green}+1 COMPILE{color} . {color:green}+1{color} HEAD compiles . {color:green}+1{color} patch compiles . {color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [client]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [hadooplibs/hadoop-utils-2]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} . {color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations . {color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} . Tests run: 1872 {color:green}+1 DISTRO{color} . {color:green}+1{color} distro tarball builds with the patch ---------------------------- {color:red}*-1 Overall result, please check the reported -1(s)*{color} The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/3634/ > Oozie distributes application jar twice making the spark job fail > ----------------------------------------------------------------- > > Key: OOZIE-2787 > URL: https://issues.apache.org/jira/browse/OOZIE-2787 > Project: Oozie > Issue Type: Bug > Reporter: Satish Subhashrao Saley > Assignee: Satish Subhashrao Saley > Attachments: OOZIE-2787-1.patch, OOZIE-2787-2.patch, > OOZIE-2787-3.patch, OOZIE-2787-4.patch, OOZIE-2787-5.patch, > OOZIE-2787-amend-1.patch > > > Oozie adds the application jar to the list of files to be uploaded to > distributed cache. Since this gets added twice, the job fails. This is > observed from spark 2.1.0 which introduces a check for same file and fails > the job. > {code} > --master > yarn > --deploy-mode > cluster > --name > oozieSparkStarter > --class > ScalaWordCount > --queue > default > --conf > spark.executor.extraClassPath=$PWD/* > --conf > spark.driver.extraClassPath=$PWD/* > --conf > spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j.properties > --conf > spark.driver.extraJavaOptions=-Dlog4j.configuration=spark-log4j.properties > --conf > spark.yarn.security.tokens.hive.enabled=false > --conf > spark.yarn.security.tokens.hbase.enabled=false > --files > hdfs://mycluster.com/user/saley/oozie/apps/sparkapp/lib/spark-example.jar > --properties-file > spark-defaults.conf > --verbose > spark-example.jar > samplefile.txt > output > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)