See
<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters-II/513/changes>
Changes:
[smarthi] MAHOUT-1263: Serialize/Deserialize Lambda value for
OnlineLogisticRegression - code cleanup
[smarthi] MAHOUT-1263:Serialise/Deserialise Lambda value for
OnlineLogisticRegression
------------------------------------------
[...truncated 4932 lines...]
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0011
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=389
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=934490720
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=942934047
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=152
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=166
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=120
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=2350645248
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=119
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=20
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=20
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jun 15, 2013 6:23:21 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 15, 2013 6:23:21 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run iteration 12 of 20
Jun 15, 2013 6:23:21 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run: Iteration 12 of 20, input path:
/tmp/mahout-work-hudson/reuters-lda-model/model-11
Jun 15, 2013 6:23:23 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Jun 15, 2013 6:23:23 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0012
Jun 15, 2013 6:23:23 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 15, 2013 6:23:23 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 15, 2013 6:23:24 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 15, 2013 6:23:24 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 15, 2013 6:23:24 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Retrieving configuration
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing read model
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing write model
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing model trainer
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Starting training threadpool with 4 threads
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Stopping model trainer
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initiating stopping of training threadpool
Jun 15, 2013 6:23:24 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: threadpool took: 21.402996ms
Jun 15, 2013 6:23:25 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: readModel.stop() took 979.77167ms
Jun 15, 2013 6:23:26 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: writeModel.stop() took 1009.913802ms
Jun 15, 2013 6:23:26 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Writing model
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer
sortAndSpill
INFO: Finished spill 0
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0012_m_000000_0 is done. And is in the process of
commiting
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0012_m_000000_0' done.
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 162 bytes
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0012_r_000000_0 is done. And is in the process of
commiting
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0012_r_000000_0 is allowed to commit now
Jun 15, 2013 6:23:26 PM
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0012_r_000000_0' to
/tmp/mahout-work-hudson/reuters-lda-model/model-12
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 15, 2013 6:23:26 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0012_r_000000_0' done.
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0012
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 17
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=389
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=1019444490
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=1028655439
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=152
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=166
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=120
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=2549088256
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=119
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=20
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=20
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jun 15, 2013 6:23:27 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 15, 2013 6:23:27 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run iteration 13 of 20
Jun 15, 2013 6:23:27 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: About to run: Iteration 13 of 20, input path:
/tmp/mahout-work-hudson/reuters-lda-model/model-12
Jun 15, 2013 6:23:28 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat
listStatus
INFO: Total input paths to process : 1
Jun 15, 2013 6:23:29 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0013
Jun 15, 2013 6:23:29 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : null
Jun 15, 2013 6:23:29 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 15, 2013 6:23:30 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 15, 2013 6:23:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 15, 2013 6:23:30 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Retrieving configuration
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing read model
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing write model
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initializing model trainer
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Starting training threadpool with 4 threads
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Stopping model trainer
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Initiating stopping of training threadpool
Jun 15, 2013 6:23:30 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: threadpool took: 0.698839ms
Jun 15, 2013 6:23:31 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: readModel.stop() took 1003.23432ms
Jun 15, 2013 6:23:32 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: writeModel.stop() took 1010.3657ms
Jun 15, 2013 6:23:32 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Writing model
Jun 15, 2013 6:23:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 15, 2013 6:23:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job run
WARNING: job_local_0013
org.apache.hadoop.fs.FSError: java.io.IOException: No space left on device
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:200)
at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
at java.io.FilterOutputStream.flush(FilterOutputStream.java:123)
at java.io.DataOutputStream.flush(DataOutputStream.java:106)
at java.io.FilterOutputStream.flush(FilterOutputStream.java:123)
at java.io.FilterOutputStream.flush(FilterOutputStream.java:123)
at java.io.DataOutputStream.flush(DataOutputStream.java:106)
at org.apache.hadoop.mapred.IFile$Writer.close(IFile.java:131)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1441)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:699)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)
Caused by: java.io.IOException: No space left on device
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:282)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.write(RawLocalFileSystem.java:198)
... 14 more
Jun 15, 2013 6:23:34 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0013
Jun 15, 2013 6:23:34 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 0
Exception in thread "main" java.lang.InterruptedException: Failed to complete
iteration 13 stage 1
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.runIteration(CVB0Driver.java:517)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.run(CVB0Driver.java:305)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.run(CVB0Driver.java:187)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.clustering.lda.cvb.CVB0Driver.main(CVB0Driver.java:549)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure
