See <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/800/changes>
Changes: [Deron Eriksson] [MINOR] Add license to ColumnGroupPartitioner and PlanningMemoTable [Matthias Boehm] [SYSTEMML-1167] Fix size propagation right indexing (all rows/columns) ------------------------------------------ [...truncated 10554 lines...] 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Parents of final stage: List(ShuffleMapStage 242) 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 242) 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 242 (MapPartitionsRDD[663] at flatMapToPair at RDDConverterUtils.java:273), which has no missing parents 17/02/09 05:39:10 INFO memory.MemoryStore: Block broadcast_242 stored as values in memory (estimated size 3.9 KB, free 1045.5 MB) 17/02/09 05:39:10 INFO memory.MemoryStore: Block broadcast_242_piece0 stored as bytes in memory (estimated size 2.2 KB, free 1045.5 MB) 17/02/09 05:39:10 INFO storage.BlockManagerInfo: Added broadcast_242_piece0 in memory on localhost:60275 (size: 2.2 KB, free: 1045.8 MB) 17/02/09 05:39:10 INFO spark.SparkContext: Created broadcast 242 from broadcast at DAGScheduler.scala:1012 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 242 (MapPartitionsRDD[663] at flatMapToPair at RDDConverterUtils.java:273) 17/02/09 05:39:10 INFO scheduler.TaskSchedulerImpl: Adding task set 242.0 with 1 tasks 17/02/09 05:39:10 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_242 tasks to pool default 17/02/09 05:39:10 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 242.0 (TID 252, localhost, partition 0, PROCESS_LOCAL, 5637 bytes) 17/02/09 05:39:10 INFO executor.Executor: Running task 0.0 in stage 242.0 (TID 252) 17/02/09 05:39:10 INFO executor.Executor: Finished task 0.0 in stage 242.0 (TID 252). 1079 bytes result sent to driver 17/02/09 05:39:10 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 242.0 (TID 252) in 7 ms on localhost (1/1) 17/02/09 05:39:10 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 242.0, whose tasks have all completed, from pool default 17/02/09 05:39:10 INFO scheduler.DAGScheduler: ShuffleMapStage 242 (flatMapToPair at RDDConverterUtils.java:273) finished in 0.007 s 17/02/09 05:39:10 INFO scheduler.DAGScheduler: looking for newly runnable stages 17/02/09 05:39:10 INFO scheduler.DAGScheduler: running: Set() 17/02/09 05:39:10 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 243) 17/02/09 05:39:10 INFO scheduler.DAGScheduler: failed: Set() 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Submitting ResultStage 243 (MapPartitionsRDD[669] at collectAsList at MLContextTest.java:1337), which has no missing parents 17/02/09 05:39:10 INFO memory.MemoryStore: Block broadcast_243 stored as values in memory (estimated size 10.5 KB, free 1045.4 MB) 17/02/09 05:39:10 INFO memory.MemoryStore: Block broadcast_243_piece0 stored as bytes in memory (estimated size 5.3 KB, free 1045.4 MB) 17/02/09 05:39:10 INFO storage.BlockManagerInfo: Added broadcast_243_piece0 in memory on localhost:60275 (size: 5.3 KB, free: 1045.8 MB) 17/02/09 05:39:10 INFO spark.SparkContext: Created broadcast 243 from broadcast at DAGScheduler.scala:1012 17/02/09 05:39:10 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 243 (MapPartitionsRDD[669] at collectAsList at MLContextTest.java:1337) 17/02/09 05:39:10 INFO scheduler.TaskSchedulerImpl: Adding task set 243.0 with 1 tasks 17/02/09 05:39:10 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_243 tasks to pool default 17/02/09 05:39:10 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 243.0 (TID 253, localhost, partition 0, NODE_LOCAL, 5202 bytes) 17/02/09 05:39:10 INFO executor.Executor: Running task 0.0 in stage 243.0 (TID 253) 17/02/09 05:39:10 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks 17/02/09 05:39:10 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 17/02/09 05:39:10 INFO executor.Executor: Finished task 0.0 in stage 243.0 (TID 253). 1855 bytes result sent to driver 17/02/09 05:39:10 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 243.0 (TID 253) in 11 ms on localhost (1/1) 17/02/09 05:39:10 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 243.0, whose tasks have all completed, from pool default 17/02/09 05:39:10 INFO scheduler.DAGScheduler: ResultStage 243 (collectAsList at MLContextTest.java:1337) finished in 0.011 s 17/02/09 05:39:10 INFO storage.BlockManagerInfo: Removed broadcast_243_piece0 on localhost:60275 in memory (size: 5.3 KB, free: 1045.8 MB) 17/02/09 05:39:10 INFO spark.ContextCleaner: Cleaned accumulator 14817 17/02/09 05:39:10 INFO spark.ContextCleaner: Cleaned shuffle 62 17/02/09 05:39:10 INFO storage.BlockManagerInfo: Removed broadcast_242_piece0 on localhost:60275 in memory (size: 2.2 KB, free: 1045.8 MB) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Registering RDD 671 (flatMapToPair at RDDConverterUtils.java:273) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Got job 181 (collectAsList at MLContextTest.java:1225) with 1 output partitions 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Final stage: ResultStage 245 (collectAsList at MLContextTest.java:1225) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Parents of final stage: List(ShuffleMapStage 244) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Missing parents: List(ShuffleMapStage 244) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 244 (MapPartitionsRDD[671] at flatMapToPair at RDDConverterUtils.java:273), which has no missing parents 17/02/09 05:39:11 INFO memory.MemoryStore: Block broadcast_244 stored as values in memory (estimated size 3.9 KB, free 1045.5 MB) 17/02/09 05:39:11 INFO memory.MemoryStore: Block broadcast_244_piece0 stored as bytes in memory (estimated size 2.2 KB, free 1045.5 MB) 17/02/09 05:39:11 INFO storage.BlockManagerInfo: Added broadcast_244_piece0 in memory on localhost:60275 (size: 2.2 KB, free: 1045.8 MB) 17/02/09 05:39:11 INFO spark.SparkContext: Created broadcast 244 from broadcast at DAGScheduler.scala:1012 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ShuffleMapStage 244 (MapPartitionsRDD[671] at flatMapToPair at RDDConverterUtils.java:273) 17/02/09 05:39:11 INFO scheduler.TaskSchedulerImpl: Adding task set 244.0 with 1 tasks 17/02/09 05:39:11 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_244 tasks to pool default 17/02/09 05:39:11 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 244.0 (TID 254, localhost, partition 0, PROCESS_LOCAL, 5637 bytes) 17/02/09 05:39:11 INFO executor.Executor: Running task 0.0 in stage 244.0 (TID 254) 17/02/09 05:39:11 INFO executor.Executor: Finished task 0.0 in stage 244.0 (TID 254). 1079 bytes result sent to driver 17/02/09 05:39:11 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 244.0 (TID 254) in 7 ms on localhost (1/1) 17/02/09 05:39:11 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 244.0, whose tasks have all completed, from pool default 17/02/09 05:39:11 INFO scheduler.DAGScheduler: ShuffleMapStage 244 (flatMapToPair at RDDConverterUtils.java:273) finished in 0.007 s 17/02/09 05:39:11 INFO scheduler.DAGScheduler: looking for newly runnable stages 17/02/09 05:39:11 INFO scheduler.DAGScheduler: running: Set() 17/02/09 05:39:11 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 245) 17/02/09 05:39:11 INFO scheduler.DAGScheduler: failed: Set() 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Submitting ResultStage 245 (MapPartitionsRDD[677] at collectAsList at MLContextTest.java:1225), which has no missing parents 17/02/09 05:39:11 INFO memory.MemoryStore: Block broadcast_245 stored as values in memory (estimated size 10.5 KB, free 1045.4 MB) 17/02/09 05:39:11 INFO memory.MemoryStore: Block broadcast_245_piece0 stored as bytes in memory (estimated size 5.3 KB, free 1045.4 MB) 17/02/09 05:39:11 INFO storage.BlockManagerInfo: Added broadcast_245_piece0 in memory on localhost:60275 (size: 5.3 KB, free: 1045.8 MB) 17/02/09 05:39:11 INFO spark.SparkContext: Created broadcast 245 from broadcast at DAGScheduler.scala:1012 17/02/09 05:39:11 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 245 (MapPartitionsRDD[677] at collectAsList at MLContextTest.java:1225) 17/02/09 05:39:11 INFO scheduler.TaskSchedulerImpl: Adding task set 245.0 with 1 tasks 17/02/09 05:39:11 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_245 tasks to pool default 17/02/09 05:39:11 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 245.0 (TID 255, localhost, partition 0, NODE_LOCAL, 5202 bytes) 17/02/09 05:39:11 INFO executor.Executor: Running task 0.0 in stage 245.0 (TID 255) 17/02/09 05:39:11 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty blocks out of 1 blocks 17/02/09 05:39:11 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms 17/02/09 05:39:11 INFO executor.Executor: Finished task 0.0 in stage 245.0 (TID 255). 1855 bytes result sent to driver 17/02/09 05:39:11 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 245.0 (TID 255) in 9 ms on localhost (1/1) 17/02/09 05:39:11 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 245.0, whose tasks have all completed, from pool default 17/02/09 05:39:11 INFO scheduler.DAGScheduler: ResultStage 245 (collectAsList at MLContextTest.java:1225) finished in 0.010 s 17/02/09 05:39:11 INFO storage.BlockManagerInfo: Removed broadcast_244_piece0 on localhost:60275 in memory (size: 2.2 KB, free: 1045.8 MB) 17/02/09 05:39:11 INFO storage.BlockManagerInfo: Removed broadcast_245_piece0 on localhost:60275 in memory (size: 5.3 KB, free: 1045.8 MB) 17/02/09 05:39:11 INFO spark.ContextCleaner: Cleaned accumulator 14906 17/02/09 05:39:11 INFO spark.ContextCleaner: Cleaned shuffle 63 17/02/09 05:39:12 INFO server.ServerConnector: Stopped ServerConnector@53e9157a{HTTP/1.1}{0.0.0.0:4040} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@45d6a45a{/stages/stage/kill,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@712ceb7c{/api,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@22c08788{/,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@7428012c{/static,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@3b6ff1c{/executors/threadDump/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@77449f6b{/executors/threadDump,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@64a0e97{/executors/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@6b139f51{/executors,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@5e055077{/environment/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@18cd264b{/environment,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@4ff4581c{/storage/rdd/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@4edf6f81{/storage/rdd,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@66d41b4e{/storage/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@4f2309a0{/storage,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@618c04d2{/stages/pool/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@61792b4e{/stages/pool,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@2c30bdcf{/stages/stage/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@32438853{/stages/stage,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@33866e75{/stages/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@9388780{/stages,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@52999e9a{/jobs/job/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@18e334f2{/jobs/job,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@16658c2e{/jobs/json,null,UNAVAILABLE} 17/02/09 05:39:12 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@603779b0{/jobs,null,UNAVAILABLE} 17/02/09 05:39:12 INFO ui.SparkUI: Stopped Spark web UI at http://localhost:4040 17/02/09 05:39:12 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 17/02/09 05:39:12 INFO memory.MemoryStore: MemoryStore cleared 17/02/09 05:39:12 INFO storage.BlockManager: BlockManager stopped 17/02/09 05:39:12 INFO storage.BlockManagerMaster: BlockManagerMaster stopped 17/02/09 05:39:12 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 17/02/09 05:39:12 INFO spark.SparkContext: Successfully stopped SparkContext Running org.apache.sysml.test.integration.mlcontext.MLContextTest Tests run: 165, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.186 sec - in org.apache.sysml.test.integration.mlcontext.MLContextTest 17/02/09 05:39:12 INFO util.ShutdownHookManager: Shutdown hook called 17/02/09 05:39:12 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-55c6407e-582d-411d-b723-5f04656b2aa0 Running org.apache.sysml.test.integration.functions.append.AppendVectorTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 330.956 sec - in org.apache.sysml.test.integration.functions.append.AppendVectorTest Running org.apache.sysml.test.integration.applications.dml.ArimaDMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 184.229 sec - in org.apache.sysml.test.integration.applications.dml.ArimaDMLTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 983.946 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedSigmoidTest 17/02/09 05:40:47 INFO util.ShutdownHookManager: Shutdown hook called 17/02/09 05:40:47 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-c9ea9dc9-0da1-4fd9-9a3f-357a5c7ef957 Running org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 658.92 sec - in org.apache.sysml.test.integration.functions.indexing.LeftIndexingTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 258.595 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 312.695 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleDenseTest Running org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.556 sec - in org.apache.sysml.test.integration.applications.parfor.ParForCorrelationTestLarge Running org.apache.sysml.test.integration.functions.reorg.FullOrderTest Tests run: 132, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,347.961 sec - in org.apache.sysml.test.integration.functions.reorg.FullOrderTest Running org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest Tests run: 90, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,458.459 sec - in org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest 17/02/09 05:47:44 INFO util.ShutdownHookManager: Shutdown hook called 17/02/09 05:47:44 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-d48de914-a2db-48fe-b316-c53c0ac2ad38 Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 341.081 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest Running org.apache.sysml.test.integration.functions.append.AppendChainTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,055.663 sec - in org.apache.sysml.test.integration.functions.append.AppendChainTest Running org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 512.779 sec - in org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 282.675 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest Running org.apache.sysml.test.integration.functions.append.AppendMatrixTest Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,372.169 sec - in org.apache.sysml.test.integration.functions.append.AppendMatrixTest Running org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 359.205 sec - in org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest Running org.apache.sysml.test.integration.applications.dml.HITSDMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 155.803 sec - in org.apache.sysml.test.integration.applications.dml.HITSDMLTest Running org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.842 sec - in org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.776 sec - in org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 102.291 sec - in org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.954 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.789 sec - in org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.588 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.27 sec - in org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest Running org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 128.688 sec - in org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest Running org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 293.557 sec - in org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.47 sec - in org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.321 sec - in org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.011 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest Running org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 613.631 sec - in org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest Running org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.36 sec - in org.apache.sysml.test.integration.applications.dml.PageRankDMLTest Running org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 590.004 sec - in org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 89.762 sec - in org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest Running org.apache.sysml.test.integration.applications.dml.ID3DMLTest Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 656.134 sec - in org.apache.sysml.test.integration.applications.dml.ID3DMLTest Running org.apache.sysml.test.integration.applications.dml.GLMDMLTest Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,411.795 sec - in org.apache.sysml.test.integration.applications.dml.GLMDMLTest Running org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.278 sec - in org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.69 sec - in org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest Running org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 176.374 sec - in org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest Running org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.459 sec - in org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest Running org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.491 sec - in org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest Running org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 162.83 sec - in org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest Running org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.603 sec - in org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest Running org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.489 sec - in org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest Running org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 123.057 sec - in org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest Running org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.942 sec - in org.apache.sysml.test.integration.applications.dml.GNMFDMLTest Running org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.211 sec - in org.apache.sysml.test.integration.applications.dml.WelchTDMLTest Running org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.638 sec - in org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest Running org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 335.715 sec - in org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest Running org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 56.452 sec - in org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest Results : Failed tests: FrameMatrixReblockTest.testFrameWriteMultipleSparseBinarySpark:170->runFrameReblockTest:230 36 values are not in equal Tests run: 6664, Failures: 1, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-failsafe-plugin:2.17:verify (default) @ systemml --- [INFO] Failsafe report directory: <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:55 h [INFO] Finished at: 2017-02-09T07:16:40-06:00 [INFO] Final Memory: 62M/1997M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.17:verify (default) on project systemml: There are test failures. [ERROR] [ERROR] Please refer to <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Run condition [Always] enabling perform for step [[]]