No problem - glad to help. There may be related item that I have not been able to resolve where 2 test failures observed after on-demand build 181 completed:
09:56:22 Running org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest 09:56:23 Tests run: 4, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 21.572 sec <<< FAILURE! - in org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest 09:56:23 testHomesDummycodeSparkCSV (org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest) Time elapsed: 11.657 sec <<< ERROR! 09:56:23 java.lang.RuntimeException: java.io.IOException: Failed parallel read of text csv input. 09:56:23 at java.util.concurrent.FutureTask.report (FutureTask.java:122) 09:56:23 at java.util.concurrent.FutureTask.get (FutureTask.java:192) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSVParallel.readCSVFrameFromHDFS (FrameReaderTextCSVParallel.java:108) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSV.readFrameFromHDFS (FrameReaderTextCSV.java:96) 09:56:23 at org.apache.sysml.runtime.io.FrameReader.readFrameFromHDFS (FrameReader.java:83) 09:56:23 at org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest.runTransformTest (TransformFrameEncodeDecodeTest.java:132) 09:56:23 at org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest.testHomesDummycodeSparkCSV (TransformFrameEncodeDecodeTest.java:79) 09:56:23 Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 09:56:23 at java.util.ArrayList.rangeCheck(ArrayList.java:653) 09:56:23 at java.util.ArrayList.get(ArrayList.java:429) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSV.readCSVFrameFromInputSplit (FrameReaderTextCSV.java:185) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSVParallel$ReadRowsTask.call (FrameReaderTextCSVParallel.java:226) 09:56:23 at java.util.concurrent.FutureTask.run (FutureTask.java:266) 09:56:23 at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1142) 09:56:23 at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:617) 09:56:23 at java.lang.Thread.run(Thread.java:745) 09:56:23 09:56:23 testHomesRecodeSparkCSV (org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest) Time elapsed: 4.671 sec <<< ERROR! 09:56:23 java.lang.RuntimeException: java.io.IOException: Failed parallel read of text csv input. 09:56:23 at java.util.concurrent.FutureTask.report (FutureTask.java:122) 09:56:23 at java.util.concurrent.FutureTask.get (FutureTask.java:192) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSVParallel.readCSVFrameFromHDFS (FrameReaderTextCSVParallel.java:108) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSV.readFrameFromHDFS (FrameReaderTextCSV.java:96) 09:56:23 at org.apache.sysml.runtime.io.FrameReader.readFrameFromHDFS (FrameReader.java:83) 09:56:23 at org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest.runTransformTest (TransformFrameEncodeDecodeTest.java:132) 09:56:23 at org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest.testHomesRecodeSparkCSV (TransformFrameEncodeDecodeTest.java:69) 09:56:23 Caused by: java.lang.IndexOutOfBoundsException: Index: 1, Size: 1 09:56:23 at java.util.ArrayList.rangeCheck(ArrayList.java:653) 09:56:23 at java.util.ArrayList.get(ArrayList.java:429) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSV.readCSVFrameFromInputSplit (FrameReaderTextCSV.java:185) 09:56:23 at org.apache.sysml.runtime.io.FrameReaderTextCSVParallel$ReadRowsTask.call (FrameReaderTextCSVParallel.java:226) 09:56:23 at java.util.concurrent.FutureTask.run (FutureTask.java:266) 09:56:23 at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1142) 09:56:23 at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:617) 09:56:23 at java.lang.Thread.run(Thread.java:745) I can't reproduce the failure as the 150 transform tests all passed when run on my local development environment including when run in parallel from command shell or under Eclipse as suite. Running org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecodeTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.164 sec - in org.apache.sysml.test.integration.functions.transform.TransformFrameEncodeDecode ... Tests run: 150, Failures: 0, Errors: 0, Skipped: 0 The daily build will kick-off soon and will check to see if re-occurs. Thanks, Glenn From: Matthias Boehm/Almaden/IBM@IBMUS To: dev@systemml.incubator.apache.org Date: 06/24/2016 10:51 AM Subject: Re: Build failed in Jenkins: SystemML-DailyTest #338 thanks for the fix Glenn. Regards, Matthias Glenn Weidner---06/24/2016 09:16:05 AM---I've directly pushed 1 commit of pom.xml to exclude new test data file (src/test/scripts/functions/j From: Glenn Weidner/Silicon Valley/IBM@IBMUS To: dev@systemml.incubator.apache.org Date: 06/24/2016 09:16 AM Subject: Re: Build failed in Jenkins: SystemML-DailyTest #338 I've directly pushed 1 commit of pom.xml to exclude new test data file (src/test/scripts/functions/jmlc/tfmtd_example2/column.names) from license check. Note I verified the rat-license check passed prior to merging the change: https://sparktc.ibmcloud.com/jenkins/job/SystemML-OnDemand/181/console Thanks, Glenn jenkins---06/24/2016 12:32:33 AM---See < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/338/changes> Changes: From: jenk...@spark.tc To: Michael W Dusenberry/San Francisco/IBM@IBMUS, lrese...@apache.org, dev@systemml.incubator.apache.org, Matthias Boehm/Almaden/IBM@IBMUS Date: 06/24/2016 12:32 AM Subject: Build failed in Jenkins: SystemML-DailyTest #338 See < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/338/changes> Changes: [Matthias Boehm] [SYSTEMML-569] Distributed spark transform encode/decode (recode, dummy) ------------------------------------------ [...truncated 299 lines...] [INFO] Copying hadoop-yarn-common-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-yarn-common-2.4.1.jar > [INFO] Copying core-1.1.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/core-1.1.2.jar > [INFO] Copying jetty-util-6.1.26.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jetty-util-6.1.26.jar > [INFO] Copying jackson-core-2.4.4.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jackson-core-2.4.4.jar > [INFO] Copying test-interface-1.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/test-interface-1.0.jar > [INFO] Copying snappy-java-1.1.1.7.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/snappy-java-1.1.1.7.jar > [INFO] Copying hamcrest-core-1.3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hamcrest-core-1.3.jar > [INFO] Copying uncommons-maths-1.2.2a.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/uncommons-maths-1.2.2a.jar > [INFO] Copying jsp-api-2.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jsp-api-2.1.jar > [INFO] Copying jersey-server-1.9.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jersey-server-1.9.jar > [INFO] Copying pyrolite-4.4.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/pyrolite-4.4.jar > [INFO] Copying compress-lzf-1.0.3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/compress-lzf-1.0.3.jar > [INFO] Copying xmlenc-0.52.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/xmlenc-0.52.jar > [INFO] Copying zookeeper-3.4.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/zookeeper-3.4.5.jar > [INFO] Copying jasper-runtime-5.5.23.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jasper-runtime-5.5.23.jar > [INFO] Copying hadoop-hdfs-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-hdfs-2.4.1.jar > [INFO] Copying antlr4-runtime-4.3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/antlr4-runtime-4.3.jar > [INFO] Copying curator-framework-2.4.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/curator-framework-2.4.0.jar > [INFO] Copying jodd-core-3.6.3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jodd-core-3.6.3.jar > [INFO] Copying commons-net-2.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-net-2.2.jar > [INFO] Copying json4s-ast_2.10-3.2.10.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/json4s-ast_2.10-3.2.10.jar > [INFO] Copying commons-lang3-3.3.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-lang3-3.3.2.jar > [INFO] Copying py4j-0.8.2.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/py4j-0.8.2.1.jar > [INFO] Copying stream-2.7.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/stream-2.7.0.jar > [INFO] Copying hadoop-mapreduce-client-shuffle-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-mapreduce-client-shuffle-2.4.1.jar > [INFO] Copying slf4j-api-1.7.10.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/slf4j-api-1.7.10.jar > [INFO] Copying paranamer-2.6.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/paranamer-2.6.jar > [INFO] Copying objenesis-1.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/objenesis-1.0.jar > [INFO] Copying breeze-macros_2.10-0.11.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/breeze-macros_2.10-0.11.2.jar > [INFO] Copying commons-configuration-1.6.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-configuration-1.6.jar > [INFO] Copying commons-digester-1.8.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-digester-1.8.jar > [INFO] Copying commons-beanutils-1.7.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-beanutils-1.7.0.jar > [INFO] Copying parquet-format-2.2.0-rc1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/parquet-format-2.2.0-rc1.jar > [INFO] Copying commons-collections-3.2.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-collections-3.2.1.jar > [INFO] Copying junit-4.11.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/junit-4.11.jar > [INFO] Copying hadoop-annotations-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-annotations-2.4.1.jar > [INFO] Copying mockito-core-1.9.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/mockito-core-1.9.5.jar > [INFO] Copying mavenized-jcuda-0.7.5b.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/mavenized-jcuda-0.7.5b.jar > [INFO] Copying pmml-schema-1.1.15.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/pmml-schema-1.1.15.jar > [INFO] Copying spark-mllib_2.10-1.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/spark-mllib_2.10-1.4.1.jar > [INFO] Copying metrics-json-3.1.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/metrics-json-3.1.0.jar > [INFO] Copying jaxb-impl-2.2.7.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jaxb-impl-2.2.7.jar > [INFO] Copying scala-library-2.10.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/scala-library-2.10.5.jar > [INFO] Copying hadoop-yarn-server-web-proxy-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-yarn-server-web-proxy-2.4.1.jar > [INFO] Copying jcl-over-slf4j-1.7.10.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jcl-over-slf4j-1.7.10.jar > [INFO] Copying metrics-core-3.1.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/metrics-core-3.1.0.jar > [INFO] Copying spark-catalyst_2.10-1.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/spark-catalyst_2.10-1.4.1.jar > [INFO] Copying commons-cli-1.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-cli-1.2.jar > [INFO] Copying lz4-1.2.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/lz4-1.2.0.jar > [INFO] Copying jaxb-core-2.2.7.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jaxb-core-2.2.7.jar > [INFO] Copying httpclient-4.2.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/httpclient-4.2.5.jar > [INFO] Copying unused-1.0.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/unused-1.0.0.jar > [INFO] Copying parquet-encoding-1.6.0rc3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/parquet-encoding-1.6.0rc3.jar > [INFO] Copying RoaringBitmap-0.4.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/RoaringBitmap-0.4.5.jar > [INFO] Copying reflectasm-1.07-shaded.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/reflectasm-1.07-shaded.jar > [INFO] Copying scalap-2.10.5.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/scalap-2.10.5.jar > [INFO] Copying chill-java-0.5.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/chill-java-0.5.0.jar > [INFO] Copying jettison-1.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jettison-1.1.jar > [INFO] Copying antlr4-4.3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/antlr4-4.3.jar > [INFO] Copying akka-actor_2.10-2.3.4-spark.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/akka-actor_2.10-2.3.4-spark.jar > [INFO] Copying guice-servlet-3.0.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/guice-servlet-3.0.jar > [INFO] Copying netty-all-4.0.23.Final.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/netty-all-4.0.23.Final.jar > [INFO] Copying parquet-hadoop-1.6.0rc3.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/parquet-hadoop-1.6.0rc3.jar > [INFO] Copying jackson-module-scala_2.10-2.4.4.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/jackson-module-scala_2.10-2.4.4.jar > [INFO] Copying akka-slf4j_2.10-2.3.4-spark.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/akka-slf4j_2.10-2.3.4-spark.jar > [INFO] Copying hadoop-yarn-server-nodemanager-2.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/hadoop-yarn-server-nodemanager-2.4.1.jar > [INFO] Copying spark-network-common_2.10-1.4.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/spark-network-common_2.10-1.4.1.jar > [INFO] Copying avro-1.7.4.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/avro-1.7.4.jar > [INFO] Copying netty-3.6.2.Final.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/netty-3.6.2.Final.jar > [INFO] Copying commons-httpclient-3.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/commons-httpclient-3.1.jar > [INFO] Copying breeze_2.10-0.11.2.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/lib/breeze_2.10-0.11.2.jar > [INFO] [INFO] --- maven-resources-plugin:2.4:copy-resources (copy-resources) @ systemml --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ systemml --- [INFO] Test Source directory: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/src/test_suites/java > added. [INFO] [INFO] --- maven-resources-plugin:2.4:testResources (default-testResources) @ systemml --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 4 resources [INFO] Copying 4 resources [INFO] [INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ systemml --- [WARNING] Expected all dependencies to require Scala version: 2.10.5 [WARNING] com.twitter:chill_2.10:0.5.0 requires scala version: 2.10.4 [WARNING] Multiple versions of scala libraries detected! [INFO] < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/src/test/java >:-1: info: compiling [INFO] < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/src/test/scala >:-1: info: compiling [INFO] < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/src/test_suites/java >:-1: info: compiling [INFO] Compiling 442 source files to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/test-classes > at 1466753465167 [INFO] prepare-compile in 0 s [INFO] compile in 7 s [INFO] [INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ systemml --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 439 source files to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/test-classes > [INFO] [INFO] --- maven-surefire-plugin:2.18:test (default-test) @ systemml --- [INFO] Surefire report directory: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/surefire-reports > ------------------------------------------------------- T E S T S ------------------------------------------------------- Results : Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [JENKINS] Recording test results [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ systemml --- [INFO] Building jar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar > [INFO] [INFO] --- maven-dependency-plugin:2.4:unpack (unpack) @ systemml --- [INFO] Configured Artifact: org.apache.hadoop:hadoop-test:1.2.1:jar [INFO] Unpacking /home/jenkins/.m2/repository/org/apache/hadoop/hadoop-test/1.2.1/hadoop-test-1.2.1.jar to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/hadoop-test > with includes "**/*" and excludes "" [INFO] [INFO] --- maven-shade-plugin:2.3:shade (default) @ systemml --- [INFO] Including org.apache.wink:wink-json4j:jar:1.4 in the shaded jar. [INFO] Including org.antlr:antlr4-annotations:jar:4.3 in the shaded jar. [INFO] Including org.antlr:antlr4-runtime:jar:4.3 in the shaded jar. [INFO] Including org.abego.treelayout:org.abego.treelayout.core:jar:1.0.1 in the shaded jar. [INFO] Replacing original artifact with shaded artifact. [INFO] Replacing < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar > with < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-shaded.jar > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] Dependency-reduced POM written at: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > [INFO] [INFO] --- maven-clean-plugin:3.0.0:clean (clean-original-jar) @ systemml --- [INFO] Deleting < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target> (includes = [original-*.jar], excludes = []) [INFO] [INFO] --- maven-assembly-plugin:2.4:single (create-main-jar) @ systemml --- [INFO] Reading assembly descriptor: src/assembly/jar.xml [WARNING] Artifact: org.apache.systemml:systemml:jar:0.11.0-incubating-SNAPSHOT references the same file as the assembly destination file. Moving it to a temporary location for inclusion. [INFO] Building jar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar > [WARNING] Configuration options: 'appendAssemblyId' is set to false, and 'classifier' is missing. Instead of attaching the assembly file: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar ,> it will become the file for main project artifact. NOTE: If multiple descriptors or descriptor-formats are provided for this project, the value of this file will be non-deterministic! [WARNING] Replacing pre-existing project main-artifact file: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/archive-tmp/systemml-0.11.0-incubating-SNAPSHOT.jar > with assembly file: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar > [INFO] [INFO] --- maven-assembly-plugin:2.4:single (create-source-distribution-assembly) @ systemml --- [INFO] Reading assembly descriptor: src/assembly/source.xml [INFO] Building tar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-src.tar.gz > [INFO] Building zip: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-src.zip > [INFO] [INFO] --- maven-assembly-plugin:2.4:single (create-binary-cluster-distribution-assembly) @ systemml --- [INFO] Reading assembly descriptor: src/assembly/distrib.xml [INFO] Building tar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.tar.gz > [INFO] Building zip: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.zip > [INFO] [INFO] --- maven-assembly-plugin:2.4:single (create-standalone-jar) @ systemml --- [INFO] Reading assembly descriptor: src/assembly/standalone-jar.xml [INFO] Building jar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.jar > [INFO] [INFO] --- maven-assembly-plugin:2.4:single (create-binary-standalone-distribution-assembly) @ systemml --- [INFO] Reading assembly descriptor: src/assembly/standalone.xml [INFO] Building tar: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.tar.gz > [INFO] Building zip: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.zip > [INFO] [INFO] --- maven-antrun-plugin:1.8:run (copy) @ systemml --- [INFO] Executing tasks copy and rename JAR: [copy] Copying 1 file to < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target> [INFO] Executed tasks [INFO] [INFO] --- apache-rat-plugin:0.11:check (default) @ systemml --- [INFO] 51 implicit excludes (use -debug for more details). [INFO] Exclude: .gitignore [INFO] Exclude: .repository/ [INFO] Exclude: .idea/ [INFO] Exclude: .git [INFO] Exclude: .settings [INFO] Exclude: .classpath [INFO] Exclude: .project [INFO] Exclude: docs [INFO] Exclude: **/docs/** [INFO] Exclude: **/*.csv [INFO] Exclude: **/*.json [INFO] Exclude: **/*.mtx [INFO] Exclude: **/*.mtd [INFO] Exclude: **/target/** [INFO] Exclude: **/README.md [INFO] Exclude: samples/jupyter-notebooks/*.ipynb [INFO] Exclude: src/main/j ava/*.tokens [INFO] Exclude: src/test/scripts/functions/external/kMeans/kMeansWrapperOutput [INFO] Exclude: src/test/scripts/functions/external/kMeans2/kMeansWrapperOutput1 [INFO] Exclude: src/test/scripts/functions/external/kMeans2/kMeansWrapperOutput2 [INFO] Exclude: src/test/scripts/functions/external/seqMiner/FreqSeqFile [INFO] Exclude: src/test/scripts/functions/external/seqMiner/FreqSeqSupportFile [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_1.data [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_1.data.single [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_2.data/part-0 [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_2.data/part-1 [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_2.data.single [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_3.data/part-0 [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_3.data/part-1 [INFO] Exclude: src/test/scripts/functions/io/csv/in/transfusion_3.data.single [INFO] Exclude: src/test/scripts/functions/jmlc/**/*.impute [INFO] Exclude: src/test/scripts/functions/jmlc/**/*.map [INFO] Exclude: src/test/scripts/functions/jmlc/**/*.mode [INFO] Exclude: src/test/scripts/functions/jmlc/**/*.ndistinct [INFO] Exclude: src/test/scripts/functions/jmlc/**/*.node [INFO] Exclude: src/test/scripts/functions/jmlc/tfmtd_example/Bin/saleprice.bin [INFO] Exclude: src/test/scripts/functions/jmlc/tfmtd_example/Bin/sqft.bin [INFO] Exclude: src/test/scripts/functions/jmlc/tfmtd_example/column.names [INFO] Exclude: src/test/scripts/functions/jmlc/tfmtd_example/dummycoded.column.names [INFO] Exclude: src/test/scripts/functions/jmlc/tfmtd_frame_example/tfmtd_frame [INFO] Exclude: src/test/scripts/functions/transform/input/homes/homesNAN.csv.colnames [INFO] 2821 resources included (use -debug for more details) [INFO] Rat check: Summary of files. Unapproved: 1 unknown: 1 generated: 0 approved: 2788 licence. [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:25 min [INFO] Finished at: 2016-06-24T02:31:51-05:00 [INFO] Final Memory: 99M/3206M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check (default) on project systemml: Too many files with unapproved license: 1 See RAT report in: < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/rat.txt > -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/dependency-reduced-pom.xml > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT.pom [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.jar > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT.jar [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-src.tar.gz > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT-src.tar.gz [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-src.zip > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT-src.zip [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.tar.gz > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT.tar.gz [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT.zip > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT.zip [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.jar > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT-standalone.jar [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.tar.gz > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT-standalone.tar.gz [JENKINS] Archiving < https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/systemml-0.11.0-incubating-SNAPSHOT-standalone.zip > to org.apache.systemml/systemml/0.11.0-incubating-SNAPSHOT/systemml-0.11.0-incubating-SNAPSHOT-standalone.zip channel stopped Run condition [Always] enabling perform for step [[]]
