See <https://builds.apache.org/job/Hama-trunk/383/changes>
Changes:
[edwardyoon] HAMA-951: Make BSPMessageBundle thread-safe
------------------------------------------
[...truncated 133342 lines...]
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 32 superstep:
1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 34 superstep:
0 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
Exception in thread "pool-20-thread-1"
java.lang.NullPointerException
at
org.apache.hama.examples.MaxFlow$MaxFlowVertex.getEdgeFlow(MaxFlow.java:537)
at
org.apache.hama.examples.MaxFlow$MaxFlowVertex.pushFlowToNeighbors(MaxFlow.java:319)
at
org.apache.hama.examples.MaxFlow$MaxFlowVertex.normalVertexCompute(MaxFlow.java:154)
at
org.apache.hama.examples.MaxFlow$MaxFlowVertex.compute(MaxFlow.java:102)
at
org.apache.hama.graph.GraphJobRunner$ComputeRunnable.run(GraphJobRunner.java:320)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 36 superstep:
1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 38 superstep:
1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
maxFlow is: 4.0
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 40 superstep:
1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for 42 superstep:
0 ms
15/04/17 01:21:09 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:09 INFO Configuration.deprecation: mapred.cache.localFiles is
deprecated. Instead, use mapreduce.job.cache.local.files
15/04/17 01:21:09 ERROR bsp.LocalBSPRunner: Exception during BSP execution!
java.util.concurrent.ExecutionException: java.lang.AssertionError: vertex value
cannot be null
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
at java.util.concurrent.FutureTask.get(FutureTask.java:111)
at
org.apache.hama.bsp.LocalBSPRunner$ThreadObserver.run(LocalBSPRunner.java:313)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.lang.AssertionError: vertex value cannot be null
at
org.apache.hama.graph.DefaultVertexOutputWriter.write(DefaultVertexOutputWriter.java:49)
at org.apache.hama.graph.GraphJobRunner.cleanup(GraphJobRunner.java:189)
at
org.apache.hama.bsp.LocalBSPRunner$BSPRunner.run(LocalBSPRunner.java:262)
at
org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:286)
at
org.apache.hama.bsp.LocalBSPRunner$BSPRunner.call(LocalBSPRunner.java:211)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
15/04/17 01:21:12 INFO bsp.BSPJobClient: Current supersteps number: 43
15/04/17 01:21:12 INFO bsp.BSPJobClient: Job failed.
maxflow is: 23.0
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec <<<
FAILURE!
Running org.apache.hama.examples.SemiClusterMatchingTest
15/04/17 01:21:13 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/04/17 01:21:14 INFO bsp.FileInputFormat: Total input paths to process : 1
15/04/17 01:21:14 WARN bsp.BSPJobClient: No job jar file set. User classes may
not be found. See BSPJob#setJar(String) or check Your jar file.
15/04/17 01:21:14 INFO Configuration.deprecation: user.name is deprecated.
Instead, use mapreduce.job.user.name
15/04/17 01:21:14 WARN conf.Configuration:
org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream@d54080:an
attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
15/04/17 01:21:14 WARN conf.Configuration:
org.apache.hadoop.fs.ChecksumFileSystem$FSDataBoundedInputStream@d54080:an
attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
15/04/17 01:21:14 INFO Configuration.deprecation: user.name is deprecated.
Instead, use mapreduce.job.user.name
15/04/17 01:21:14 INFO bsp.BSPJobClient: Running job: job_localrunner_0001
15/04/17 01:21:14 INFO bsp.LocalBSPRunner: Setting up a new barrier for 1 tasks!
15/04/17 01:21:14 INFO graph.GraphJobRunner: 100 vertices are loaded into
local:0
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for loading
vertices: 54 ms
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for broadcasting
global vertex count: 7 ms
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for initial
superstep: 61 ms
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for 3 superstep:
195 ms
15/04/17 01:21:14 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 4 superstep:
205 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 5 superstep:
91 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 6 superstep:
73 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 7 superstep:
60 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 8 superstep:
61 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 9 superstep:
64 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 10 superstep:
57 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 1 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 11 superstep:
44 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 12 superstep:
22 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 13 superstep:
26 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 14 superstep:
20 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 15 superstep:
19 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 16 superstep:
21 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for broadcasting
aggregation values: 0 ms
15/04/17 01:21:15 INFO graph.GraphJobRunner: Total time spent for 17 superstep:
22 ms
15/04/17 01:21:15 INFO Configuration.deprecation: mapred.cache.localFiles is
deprecated. Instead, use mapreduce.job.cache.local.files
15/04/17 01:21:17 INFO bsp.BSPJobClient: Current supersteps number: 16
15/04/17 01:21:17 INFO bsp.BSPJobClient: The total number of supersteps: 16
15/04/17 01:21:17 INFO bsp.BSPJobClient: Counters: 11
15/04/17 01:21:17 INFO bsp.BSPJobClient:
org.apache.hama.graph.GraphJobRunner$GraphJobCounter
15/04/17 01:21:17 INFO bsp.BSPJobClient: ITERATIONS=15
15/04/17 01:21:17 INFO bsp.BSPJobClient: INPUT_VERTICES=100
15/04/17 01:21:17 INFO bsp.BSPJobClient:
org.apache.hama.bsp.JobInProgress$JobCounter
15/04/17 01:21:17 INFO bsp.BSPJobClient: SUPERSTEPS=16
15/04/17 01:21:17 INFO bsp.BSPJobClient: LAUNCHED_TASKS=1
15/04/17 01:21:17 INFO bsp.BSPJobClient:
org.apache.hama.bsp.BSPPeerImpl$PeerCounter
15/04/17 01:21:17 INFO bsp.BSPJobClient: SUPERSTEP_SUM=17
15/04/17 01:21:17 INFO bsp.BSPJobClient: IO_BYTES_READ=7189
15/04/17 01:21:17 INFO bsp.BSPJobClient: TIME_IN_SYNC_MS=1
15/04/17 01:21:17 INFO bsp.BSPJobClient: TOTAL_MESSAGES_SENT=166121
15/04/17 01:21:17 INFO bsp.BSPJobClient: TASK_INPUT_RECORDS=100
15/04/17 01:21:17 INFO bsp.BSPJobClient: TOTAL_MESSAGES_RECEIVED=1530
15/04/17 01:21:17 INFO bsp.BSPJobClient: TASK_OUTPUT_RECORDS=100
Job Finished in 3.419 seconds
C1691 = [44, 48, 49, 41, 47, 42, 45, 46, 40, 43]
C1598 = [18, 12, 16, 19, 11, 14, 17, 13, 15, 10]
C1784 = [70, 73, 71, 72, 75, 74, 76, 77, 79, 78]
C1722 = [53, 50, 55, 51, 56, 57, 54, 59, 58, 52]
C1815 = [87, 85, 80, 88, 89, 82, 81, 84, 83, 86]
C79 = [4, 9, 5, 2, 3, 7, 6, 1, 0, 8]
C1753 = [65, 63, 68, 64, 67, 61, 69, 62, 66, 60]
C1629 = [24, 27, 22, 25, 28, 26, 23, 20, 21, 29]
C1846 = [95, 96, 97, 91, 98, 90, 99, 93, 92, 94]
C1660 = [36, 31, 37, 34, 32, 35, 30, 33, 38, 39]
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
Results :
Failed tests:
Tests run: 23, Failures: 1, Errors: 0, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hama parent POM ............................ SUCCESS [28.211s]
[INFO] pipes ............................................. SUCCESS [22.869s]
[INFO] commons ........................................... SUCCESS [10.360s]
[INFO] core .............................................. SUCCESS [3:10.918s]
[INFO] graph ............................................. SUCCESS [17.316s]
[INFO] machine learning .................................. SUCCESS [1:57.688s]
[INFO] examples .......................................... FAILURE [1:36.247s]
[INFO] mesos ............................................. SKIPPED
[INFO] hama-dist ......................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 8:05.908s
[INFO] Finished at: Fri Apr 17 01:21:17 UTC 2015
[INFO] Final Memory: 126M/382M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on
project hama-examples: There are test failures.
[ERROR]
[ERROR] Please refer to
<https://builds.apache.org/job/Hama-trunk/ws/trunk/examples/target/surefire-reports>
for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hama-examples
Build step 'Invoke top-level Maven targets' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hama-trunk #382
Archived 147 artifacts
Archive block size is 32768
Received 1912 blocks and 430431 bytes
Compression is 99.3%
Took 21 sec
Recording test results
Updating HAMA-951