See <https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/974/changes>
Changes:
[Matthias Boehm] [SYSTEMML-1548] Minor performance improvements ultra-sparse
matrix read
------------------------------------------
[...truncated 29151 lines...]
17/05/07 04:03:06 INFO executor.Executor: Finished task 0.0 in stage 1.0 (TID
1). 1253 bytes result sent to driver
17/05/07 04:03:06 INFO scheduler.DAGScheduler: looking for newly runnable stages
17/05/07 04:03:06 INFO scheduler.DAGScheduler: running: Set(ShuffleMapStage 1)
17/05/07 04:03:06 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 1.0
(TID 1) in 19 ms on localhost (executor driver) (1/1)
17/05/07 04:03:06 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 2)
17/05/07 04:03:06 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 1.0, whose
tasks have all completed, from pool default
17/05/07 04:03:06 INFO scheduler.DAGScheduler: failed: Set()
17/05/07 04:03:06 INFO scheduler.DAGScheduler: ShuffleMapStage 1
(parallelizePairs at SparkExecutionContext.java:706) finished in 0.155 s
17/05/07 04:03:06 INFO scheduler.DAGScheduler: looking for newly runnable stages
17/05/07 04:03:06 INFO scheduler.DAGScheduler: running: Set()
17/05/07 04:03:06 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 2)
17/05/07 04:03:06 INFO scheduler.DAGScheduler: failed: Set()
17/05/07 04:03:06 INFO scheduler.DAGScheduler: Submitting ResultStage 2
(MapPartitionsRDD[5] at mapValues at BinarySPInstruction.java:117), which has
no missing parents
17/05/07 04:03:06 INFO memory.MemoryStore: Block broadcast_2 stored as values
in memory (estimated size 4.2 KB, free 1033.8 MB)
17/05/07 04:03:06 INFO memory.MemoryStore: Block broadcast_2_piece0 stored as
bytes in memory (estimated size 2.3 KB, free 1033.8 MB)
17/05/07 04:03:06 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in
memory on 169.54.146.43:59652 (size: 2.3 KB, free: 1033.8 MB)
17/05/07 04:03:06 INFO spark.SparkContext: Created broadcast 2 from broadcast
at DAGScheduler.scala:996
17/05/07 04:03:06 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from
ResultStage 2 (MapPartitionsRDD[5] at mapValues at BinarySPInstruction.java:117)
17/05/07 04:03:06 INFO scheduler.TaskSchedulerImpl: Adding task set 2.0 with 1
tasks
17/05/07 04:03:06 INFO scheduler.FairSchedulableBuilder: Added task set
TaskSet_2.0 tasks to pool default
17/05/07 04:03:06 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 2.0
(TID 2, localhost, executor driver, partition 0, PROCESS_LOCAL, 5813 bytes)
17/05/07 04:03:06 INFO executor.Executor: Running task 0.0 in stage 2.0 (TID 2)
17/05/07 04:03:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty
blocks out of 1 blocks
17/05/07 04:03:06 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote
fetches in 6 ms
17/05/07 04:03:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty
blocks out of 1 blocks
17/05/07 04:03:06 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote
fetches in 1 ms
17/05/07 04:03:06 INFO executor.Executor: Finished task 0.0 in stage 2.0 (TID
2). 2164 bytes result sent to driver
17/05/07 04:03:06 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 2.0
(TID 2) in 109 ms on localhost (executor driver) (1/1)
17/05/07 04:03:06 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 2.0, whose
tasks have all completed, from pool default
17/05/07 04:03:06 INFO scheduler.DAGScheduler: ResultStage 2 (collect at
SparkExecutionContext.java:796) finished in 0.113 s
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Registering RDD 7
(parallelizePairs at SparkExecutionContext.java:706)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Registering RDD 6
(parallelizePairs at SparkExecutionContext.java:706)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Got job 1 (collect at
SparkExecutionContext.java:796) with 1 output partitions
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Final stage: ResultStage 5
(collect at SparkExecutionContext.java:796)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Parents of final stage:
List(ShuffleMapStage 3, ShuffleMapStage 4)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Missing parents:
List(ShuffleMapStage 3, ShuffleMapStage 4)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 3
(ParallelCollectionRDD[7] at parallelizePairs at
SparkExecutionContext.java:706), which has no missing parents
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_3 stored as values
in memory (estimated size 2032.0 B, free 1033.8 MB)
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_3_piece0 stored as
bytes in memory (estimated size 1305.0 B, free 1033.8 MB)
17/05/07 04:03:07 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in
memory on 169.54.146.43:59652 (size: 1305.0 B, free: 1033.8 MB)
17/05/07 04:03:07 INFO spark.SparkContext: Created broadcast 3 from broadcast
at DAGScheduler.scala:996
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from
ShuffleMapStage 3 (ParallelCollectionRDD[7] at parallelizePairs at
SparkExecutionContext.java:706)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Adding task set 3.0 with 1
tasks
17/05/07 04:03:07 INFO scheduler.FairSchedulableBuilder: Added task set
TaskSet_3.0 tasks to pool default
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting ShuffleMapStage 4
(ParallelCollectionRDD[6] at parallelizePairs at
SparkExecutionContext.java:706), which has no missing parents
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_4 stored as values
in memory (estimated size 2032.0 B, free 1033.8 MB)
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 3.0
(TID 3, localhost, executor driver, partition 0, PROCESS_LOCAL, 6445 bytes)
17/05/07 04:03:07 INFO executor.Executor: Running task 0.0 in stage 3.0 (TID 3)
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_4_piece0 stored as
bytes in memory (estimated size 1305.0 B, free 1033.8 MB)
17/05/07 04:03:07 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in
memory on 169.54.146.43:59652 (size: 1305.0 B, free: 1033.8 MB)
17/05/07 04:03:07 INFO spark.SparkContext: Created broadcast 4 from broadcast
at DAGScheduler.scala:996
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from
ShuffleMapStage 4 (ParallelCollectionRDD[6] at parallelizePairs at
SparkExecutionContext.java:706)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Adding task set 4.0 with 1
tasks
17/05/07 04:03:07 INFO scheduler.FairSchedulableBuilder: Added task set
TaskSet_4.0 tasks to pool default
17/05/07 04:03:07 INFO executor.Executor: Finished task 0.0 in stage 3.0 (TID
3). 1253 bytes result sent to driver
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 4.0
(TID 4, localhost, executor driver, partition 0, PROCESS_LOCAL, 6445 bytes)
17/05/07 04:03:07 INFO executor.Executor: Running task 0.0 in stage 4.0 (TID 4)
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 3.0
(TID 3) in 13 ms on localhost (executor driver) (1/1)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 3.0, whose
tasks have all completed, from pool default
17/05/07 04:03:07 INFO scheduler.DAGScheduler: ShuffleMapStage 3
(parallelizePairs at SparkExecutionContext.java:706) finished in 0.015 s
17/05/07 04:03:07 INFO scheduler.DAGScheduler: looking for newly runnable stages
17/05/07 04:03:07 INFO scheduler.DAGScheduler: running: Set(ShuffleMapStage 4)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 5)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: failed: Set()
17/05/07 04:03:07 INFO storage.BlockManagerInfo: Removed broadcast_2_piece0 on
169.54.146.43:59652 in memory (size: 2.3 KB, free: 1033.8 MB)
17/05/07 04:03:07 INFO executor.Executor: Finished task 0.0 in stage 4.0 (TID
4). 1253 bytes result sent to driver
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 4.0
(TID 4) in 22 ms on localhost (executor driver) (1/1)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 4.0, whose
tasks have all completed, from pool default
17/05/07 04:03:07 INFO scheduler.DAGScheduler: ShuffleMapStage 4
(parallelizePairs at SparkExecutionContext.java:706) finished in 0.026 s
17/05/07 04:03:07 INFO scheduler.DAGScheduler: looking for newly runnable stages
17/05/07 04:03:07 INFO scheduler.DAGScheduler: running: Set()
17/05/07 04:03:07 INFO scheduler.DAGScheduler: waiting: Set(ResultStage 5)
17/05/07 04:03:07 INFO scheduler.DAGScheduler: failed: Set()
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting ResultStage 5
(MapPartitionsRDD[11] at mapValues at BinarySPInstruction.java:117), which has
no missing parents
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_5 stored as values
in memory (estimated size 4.2 KB, free 1033.8 MB)
17/05/07 04:03:07 INFO memory.MemoryStore: Block broadcast_5_piece0 stored as
bytes in memory (estimated size 2.3 KB, free 1033.8 MB)
17/05/07 04:03:07 INFO storage.BlockManagerInfo: Added broadcast_5_piece0 in
memory on 169.54.146.43:59652 (size: 2.3 KB, free: 1033.8 MB)
17/05/07 04:03:07 INFO spark.SparkContext: Created broadcast 5 from broadcast
at DAGScheduler.scala:996
17/05/07 04:03:07 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from
ResultStage 5 (MapPartitionsRDD[11] at mapValues at
BinarySPInstruction.java:117)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Adding task set 5.0 with 1
tasks
17/05/07 04:03:07 INFO scheduler.FairSchedulableBuilder: Added task set
TaskSet_5.0 tasks to pool default
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 5.0
(TID 5, localhost, executor driver, partition 0, PROCESS_LOCAL, 5814 bytes)
17/05/07 04:03:07 INFO executor.Executor: Running task 0.0 in stage 5.0 (TID 5)
17/05/07 04:03:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty
blocks out of 1 blocks
17/05/07 04:03:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote
fetches in 1 ms
17/05/07 04:03:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1 non-empty
blocks out of 1 blocks
17/05/07 04:03:07 INFO storage.ShuffleBlockFetcherIterator: Started 0 remote
fetches in 1 ms
17/05/07 04:03:07 INFO executor.Executor: Finished task 0.0 in stage 5.0 (TID
5). 2240 bytes result sent to driver
17/05/07 04:03:07 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 5.0
(TID 5) in 15 ms on localhost (executor driver) (1/1)
17/05/07 04:03:07 INFO scheduler.TaskSchedulerImpl: Removed TaskSet 5.0, whose
tasks have all completed, from pool default
17/05/07 04:03:07 INFO scheduler.DAGScheduler: ResultStage 5 (collect at
SparkExecutionContext.java:796) finished in 0.016 s
17/05/07 04:03:08 INFO storage.BlockManagerInfo: Removed broadcast_5_piece0 on
169.54.146.43:59652 in memory (size: 2.3 KB, free: 1033.8 MB)
17/05/07 04:03:08 INFO storage.BlockManagerInfo: Removed broadcast_4_piece0 on
169.54.146.43:59652 in memory (size: 1305.0 B, free: 1033.8 MB)
17/05/07 04:03:08 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on
169.54.146.43:59652 in memory (size: 1305.0 B, free: 1033.8 MB)
17/05/07 04:03:08 INFO spark.ContextCleaner: Cleaned shuffle 2
17/05/07 04:03:08 INFO spark.ContextCleaner: Cleaned shuffle 3
17/05/07 04:05:07 INFO server.ServerConnector: Stopped
ServerConnector@555722bc{HTTP/1.1}{0.0.0.0:4040}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@308b710e{/stages/stage/kill,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@63454945{/jobs/job/kill,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@19c8c643{/api,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@17ffb21d{/,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@7c55e91a{/static,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@14adcb54{/executors/threadDump/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@3b46affe{/executors/threadDump,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@5edd598{/executors/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@77d3e86b{/executors,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@53bf8f65{/environment/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@7ce85fa4{/environment,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@48b75f66{/storage/rdd/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@36e2554c{/storage/rdd,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@1007efeb{/storage/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@467e42a6{/storage,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@77d12f51{/stages/pool/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@4a1d9bdc{/stages/pool,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@87bda98{/stages/stage/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@1ef5fd70{/stages/stage,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@37114c12{/stages/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@4e419caf{/stages,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@71fcec8a{/jobs/job/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@7c9aaafa{/jobs/job,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@37e9c815{/jobs/json,null,UNAVAILABLE}
17/05/07 04:05:07 INFO handler.ContextHandler: Stopped
o.s.j.s.ServletContextHandler@15655cf6{/jobs,null,UNAVAILABLE}
17/05/07 04:05:07 INFO ui.SparkUI: Stopped Spark web UI at
http://169.54.146.43:4040
17/05/07 04:05:07 INFO spark.MapOutputTrackerMasterEndpoint:
MapOutputTrackerMasterEndpoint stopped!
17/05/07 04:05:07 INFO memory.MemoryStore: MemoryStore cleared
17/05/07 04:05:07 INFO storage.BlockManager: BlockManager stopped
17/05/07 04:05:07 INFO storage.BlockManagerMaster: BlockManagerMaster stopped
17/05/07 04:05:07 INFO
scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
OutputCommitCoordinator stopped!
17/05/07 04:05:07 INFO spark.SparkContext: Successfully stopped SparkContext
Running org.apache.sysml.test.integration.scripts.nn.NNTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 496.878 sec -
in org.apache.sysml.test.integration.scripts.nn.NNTest
17/05/07 04:05:07 INFO util.ShutdownHookManager: Shutdown hook called
17/05/07 04:05:07 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-2e679272-beed-4ba7-84af-1f822db5a4da
Running
org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest
Tests run: 90, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,509.378 sec
- in
org.apache.sysml.test.integration.functions.quaternary.WeightedDivMatrixMultTest
17/05/07 04:05:59 INFO util.ShutdownHookManager: Shutdown hook called
17/05/07 04:05:59 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-fd755b68-5afe-48c6-93c8-31dcd5e30c02
Running
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 364.219 sec -
in
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleDenseTest
Running org.apache.sysml.test.integration.functions.append.AppendChainTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,054.383 sec
- in org.apache.sysml.test.integration.functions.append.AppendChainTest
Running
org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 552.835 sec -
in org.apache.sysml.test.integration.applications.parfor.ParForNaiveBayesTest
Running
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 274.997 sec -
in
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateUnweightedScaleSparseTest
Running org.apache.sysml.test.integration.applications.dml.HITSDMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 92.622 sec - in
org.apache.sysml.test.integration.applications.dml.HITSDMLTest
Running org.apache.sysml.test.integration.functions.append.AppendMatrixTest
Tests run: 22, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1,335.599 sec
- in org.apache.sysml.test.integration.functions.append.AppendMatrixTest
Running
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 351.12 sec -
in
org.apache.sysml.test.integration.applications.descriptivestats.UnivariateWeightedScaleSparseTest
Running org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.695 sec - in
org.apache.sysml.test.integration.applications.pydml.ArimaPyDMLTest
Running org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 78.562 sec - in
org.apache.sysml.test.integration.applications.pydml.HITSPyDMLTest
Running
org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.656 sec - in
org.apache.sysml.test.integration.applications.dml.LinearRegressionDMLTest
Running org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.763 sec - in
org.apache.sysml.test.integration.applications.pydml.CsplineDSPyDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 90.436 sec - in
org.apache.sysml.test.integration.applications.pydml.LinearLogRegPyDMLTest
Running org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.901 sec - in
org.apache.sysml.test.integration.applications.pydml.NaiveBayesPyDMLTest
Running org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.241 sec - in
org.apache.sysml.test.integration.applications.dml.CsplineCGDMLTest
Running org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.596 sec - in
org.apache.sysml.test.integration.applications.dml.L2SVMDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 295.849 sec -
in
org.apache.sysml.test.integration.applications.pydml.MDABivariateStatsPyDMLTest
Running org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.279 sec - in
org.apache.sysml.test.integration.applications.pydml.PageRankPyDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.914 sec - in
org.apache.sysml.test.integration.applications.pydml.NaiveBayesParforPyDMLTest
Running org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.113 sec - in
org.apache.sysml.test.integration.applications.dml.NaiveBayesDMLTest
Running
org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 295.864 sec -
in org.apache.sysml.test.integration.applications.dml.MDABivariateStatsDMLTest
Running org.apache.sysml.test.integration.applications.dml.PageRankDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.543 sec - in
org.apache.sysml.test.integration.applications.dml.PageRankDMLTest
Running org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 586.905 sec -
in org.apache.sysml.test.integration.applications.pydml.GLMPyDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 86.112 sec - in
org.apache.sysml.test.integration.applications.pydml.MultiClassSVMPyDMLTest
Running org.apache.sysml.test.integration.applications.dml.ID3DMLTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 386.988 sec -
in org.apache.sysml.test.integration.applications.dml.ID3DMLTest
Running org.apache.sysml.test.integration.applications.dml.GLMDMLTest
Tests run: 30, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 867.951 sec -
in org.apache.sysml.test.integration.applications.dml.GLMDMLTest
Running org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.041 sec - in
org.apache.sysml.test.integration.applications.pydml.CsplineCGPyDMLTest
Running org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.413 sec - in
org.apache.sysml.test.integration.applications.pydml.WelchTPyDMLTest
Running org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 87.958 sec - in
org.apache.sysml.test.integration.applications.dml.MultiClassSVMDMLTest
Running org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.803 sec - in
org.apache.sysml.test.integration.applications.dml.CsplineDSDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.792 sec - in
org.apache.sysml.test.integration.applications.pydml.ApplyTransformPyDMLTest
Running
org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 81.489 sec - in
org.apache.sysml.test.integration.applications.dml.NaiveBayesParforDMLTest
Running org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.496 sec - in
org.apache.sysml.test.integration.applications.pydml.L2SVMPyDMLTest
Running
org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 50.608 sec - in
org.apache.sysml.test.integration.applications.pydml.LinearRegressionPyDMLTest
Running org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.898 sec - in
org.apache.sysml.test.integration.applications.dml.LinearLogRegDMLTest
Running org.apache.sysml.test.integration.applications.dml.GNMFDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.198 sec - in
org.apache.sysml.test.integration.applications.dml.GNMFDMLTest
Running org.apache.sysml.test.integration.applications.dml.WelchTDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.393 sec - in
org.apache.sysml.test.integration.applications.dml.WelchTDMLTest
Running org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.256 sec - in
org.apache.sysml.test.integration.applications.dml.ApplyTransformDMLTest
Running org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 384.313 sec -
in org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest
Running org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.428 sec - in
org.apache.sysml.test.integration.applications.pydml.GNMFPyDMLTest
Results :
Failed tests:
FrameMatrixReblockTest.testFrameWriteMultipleDenseBinarySpark:110->runFrameReblockTest:230
77 values are not in equal
Tests in error:
FrameMatrixCastingTest.testStringFrame2MatrixCastMultiSpark:109->runFrameCastingTest:179
Runtime
FrameMatrixCastingTest.testDoubleFrame2MatrixCastMultiSpark:119->runFrameCastingTest:179
Runtime
Tests run: 6940, Failures: 1, Errors: 2, Skipped: 0
[INFO]
[INFO] --- maven-failsafe-plugin:2.17:verify (default) @ systemml ---
[INFO] Failsafe report directory:
<https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports>
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:26 h
[INFO] Finished at: 2017-05-07T05:05:17-05:00
[INFO] Final Memory: 65M/2228M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-failsafe-plugin:2.17:verify (default) on project
systemml: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://sparktc.ibmcloud.com/jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Build step 'Execute shell' marked build as failure
Run condition [Always] enabling perform for step [[]]
