See
<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters-II/516/changes>
Changes:
[robinanil] Randomized test for VectorBinaryAggregate
------------------------------------------
[...truncated 5407 lines...]
INFO: Task 'attempt_local_0015_r_000000_0' done.
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0015
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=389
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=1274348775
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=1285878485
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=152
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=61
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=120
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=3249930240
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=119
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=20
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=20
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jun 18, 2013 6:26:11 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 18, 2013 6:26:11 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run iteration 16 of 20
Jun 18, 2013 6:26:11 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run: Iteration 16 of 20, input path:
/tmp/mahout-work-hudson/reuters-lda-model/model-15
Jun 18, 2013 6:26:13 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Jun 18, 2013 6:26:13 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0016
Jun 18, 2013 6:26:13 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 18, 2013 6:26:13 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 18, 2013 6:26:14 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 18, 2013 6:26:14 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Retrieving configuration
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing read model
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing write model
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing model trainer
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Starting training threadpool with 4 threads
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Stopping model trainer
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initiating stopping of training threadpool
Jun 18, 2013 6:26:14 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: threadpool took: 0.752647ms
Jun 18, 2013 6:26:14 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 18, 2013 6:26:15 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: readModel.stop() took 1002.078932ms
Jun 18, 2013 6:26:16 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: writeModel.stop() took 1010.00808ms
Jun 18, 2013 6:26:16 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Writing model
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer
sortAndSpill
INFO: Finished spill 0
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0016_m_000000_0 is done. And is in the process of
commiting
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0016_m_000000_0' done.
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 57 bytes
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0016_r_000000_0 is done. And is in the process of
commiting
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0016_r_000000_0 is allowed to commit now
Jun 18, 2013 6:26:16 PM
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0016_r_000000_0' to
/tmp/mahout-work-hudson/reuters-lda-model/model-16
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0016_r_000000_0' done.
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0016
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=389
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=1359305403
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=1371603799
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=152
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=61
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=120
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=3451256832
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=119
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=20
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=20
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jun 18, 2013 6:26:16 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 18, 2013 6:26:16 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run iteration 17 of 20
Jun 18, 2013 6:26:16 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run: Iteration 17 of 20, input path:
/tmp/mahout-work-hudson/reuters-lda-model/model-16
Jun 18, 2013 6:26:18 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Jun 18, 2013 6:26:19 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0017
Jun 18, 2013 6:26:19 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 18, 2013 6:26:19 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 18, 2013 6:26:20 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 18, 2013 6:26:20 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 18, 2013 6:26:20 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Retrieving configuration
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing read model
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing write model
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing model trainer
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Starting training threadpool with 4 threads
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Stopping model trainer
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initiating stopping of training threadpool
Jun 18, 2013 6:26:20 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: threadpool took: 0.566278ms
Jun 18, 2013 6:26:21 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: readModel.stop() took 1006.769348ms
Jun 18, 2013 6:26:22 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: writeModel.stop() took 1010.149339ms
Jun 18, 2013 6:26:22 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Writing model
Jun 18, 2013 6:26:22 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 18, 2013 6:26:22 PM org.apache.hadoop.mapred.LocalJobRunner$Job run
WARNING: job_local_0017
org.apache.hadoop.fs.FSError: java.io.IOException: No space left on device
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:200)
at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
at java.io.FilterOutputStream.close(FilterOutputStream.java:140)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:61)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:86)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1469)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:699)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)
Caused by: java.io.IOException: No space left on device
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:282)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:198)
... 11 more
Jun 18, 2013 6:26:23 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0017
Jun 18, 2013 6:26:23 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 0
Exception in thread "main" java.lang.InterruptedException: Failed to complete
iteration 17 stage 1
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.runIteration(CVB0Driver.java:502)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.run(CVB0Driver.java:319)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.run(CVB0Driver.java:198)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.main(CVB0Driver.java:534)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure
