See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/43/changes
Changes: [yhemanth] MAPREDUCE-779. Added node health failure counts into JobTrackerStatistics. Contributed by Sreekanth Ramakrishnan. ------------------------------------------ [...truncated 131624 lines...] [junit] 2009-08-09 15:27:44,596 INFO mapred.JvmManager (JvmManager.java:<init>(383)) - In JvmRunner constructed JVM ID: jvm_200908091526_0002_m_280682767 [junit] 2009-08-09 15:27:44,597 INFO mapred.JvmManager (JvmManager.java:spawnNewJvm(351)) - JVM Runner jvm_200908091526_0002_m_280682767 spawned. [junit] 2009-08-09 15:27:44,732 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1350)) - Task Id : attempt_200908091526_0002_r_000000_0, Status : SUCCEEDED [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,253 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=SHUFFLE, sessionId= [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,381 INFO mapred.ReduceTask (ReduceTask.java:<init>(1011)) - ShuffleRamManager: MemoryLimit=141387360, MaxSingleShuffleLimit=35346840 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,388 INFO mapred.ReduceTask (ReduceTask.java:run(2486)) - attempt_200908091526_0002_r_000000_0 Thread started: Thread for merging on-disk files [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,388 INFO mapred.ReduceTask (ReduceTask.java:run(2585)) - attempt_200908091526_0002_r_000000_0 Thread started: Thread for merging in memory files [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,388 INFO mapred.ReduceTask (ReduceTask.java:run(2491)) - attempt_200908091526_0002_r_000000_0 Thread waiting: Thread for merging on-disk files [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,390 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(1893)) - attempt_200908091526_0002_r_000000_0 Need another 3 map output(s) where 0 is already in progress [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,390 INFO mapred.ReduceTask (ReduceTask.java:run(2687)) - attempt_200908091526_0002_r_000000_0 Thread started: Thread for polling Map Completion Events [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,390 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2006)) - attempt_200908091526_0002_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:33,396 INFO mapred.ReduceTask (ReduceTask.java:run(2693)) - attempt_200908091526_0002_r_000000_0: Got 2 new map-outputs [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:37,401 INFO mapred.ReduceTask (ReduceTask.java:run(2693)) - attempt_200908091526_0002_r_000000_0: Got 1 new map-outputs [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,391 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2006)) - attempt_200908091526_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,428 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1424)) - header: attempt_200908091526_0002_m_000000_0, compressed len: 11, decompressed len: 7 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,429 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1438)) - Shuffling 7 bytes (11 raw bytes) into RAM from attempt_200908091526_0002_m_000000_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,433 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1567)) - Read 7 bytes from map-output for attempt_200908091526_0002_m_000000_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,433 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1626)) - Rec #1 from attempt_200908091526_0002_m_000000_0 -> (2, 1) from localhost [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,435 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2006)) - attempt_200908091526_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,438 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1424)) - header: attempt_200908091526_0002_m_000001_0, compressed len: 11, decompressed len: 7 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,438 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1438)) - Shuffling 7 bytes (11 raw bytes) into RAM from attempt_200908091526_0002_m_000001_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,438 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1567)) - Read 7 bytes from map-output for attempt_200908091526_0002_m_000001_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,438 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1626)) - Rec #1 from attempt_200908091526_0002_m_000001_0 -> (2, 1) from localhost [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,441 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2006)) - attempt_200908091526_0002_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,444 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1424)) - header: attempt_200908091526_0002_m_000002_0, compressed len: 11, decompressed len: 7 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,445 INFO mapred.ReduceTask (ReduceTask.java:getMapOutput(1438)) - Shuffling 7 bytes (11 raw bytes) into RAM from attempt_200908091526_0002_m_000002_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,445 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1567)) - Read 7 bytes from map-output for attempt_200908091526_0002_m_000002_0 [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:38,445 INFO mapred.ReduceTask (ReduceTask.java:shuffleInMemory(1626)) - Rec #1 from attempt_200908091526_0002_m_000002_0 -> (2, 1) from localhost [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,402 INFO mapred.ReduceTask (ReduceTask.java:run(2711)) - GetMapEventsThread exiting [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,402 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2204)) - getMapsEventsThread joined. [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,403 INFO mapred.ReduceTask (ReduceTask.java:close(1117)) - Closed ram manager [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,404 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2232)) - Interleaved on-disk merge complete: 0 files left. [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,404 INFO mapred.ReduceTask (ReduceTask.java:fetchOutputs(2237)) - In-memory merge complete: 3 files left. [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,426 INFO mapred.Merger (Merger.java:merge(469)) - Merging 3 sorted segments [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,427 INFO mapred.Merger (Merger.java:merge(568)) - Down to the last merge-pass, with 3 segments left of total size: 9 bytes [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,437 INFO mapred.ReduceTask (ReduceTask.java:createKVIterator(2350)) - Merged 3 segments, 21 bytes to disk to satisfy reduce memory limit [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,438 INFO mapred.ReduceTask (ReduceTask.java:createKVIterator(2370)) - Merging 1 files, 21 bytes from disk [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,439 INFO mapred.ReduceTask (ReduceTask.java:createKVIterator(2384)) - Merging 0 segments, 0 bytes from memory into reduce [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,439 INFO mapred.Merger (Merger.java:merge(469)) - Merging 1 sorted segments [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,443 INFO mapred.Merger (Merger.java:merge(568)) - Down to the last merge-pass, with 1 segments left of total size: 13 bytes [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:39,677 INFO mapred.Task (Task.java:done(645)) - Task:attempt_200908091526_0002_r_000000_0 is done. And is in the process of commiting [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:41,685 INFO mapred.Task (Task.java:commit(745)) - Task attempt_200908091526_0002_r_000000_0 is allowed to commit now [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:41,865 INFO mapred.FileOutputCommitter (FileOutputCommitter.java:commitTask(92)) - Saved output of task 'attempt_200908091526_0002_r_000000_0' to hdfs://localhost:35048/user/hudson/mapout [junit] attempt_200908091526_0002_r_000000_0: 2009-08-09 15:27:41,869 INFO mapred.Task (Task.java:sendDone(716)) - Task 'attempt_200908091526_0002_r_000000_0' done. [junit] 2009-08-09 15:27:45,140 INFO mapred.TaskTracker (TaskTracker.java:getTask(2548)) - JVM with ID: jvm_200908091526_0002_m_280682767 given task: attempt_200908091526_0002_m_000003_0 [junit] 2009-08-09 15:27:45,515 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2000)) - attempt_200908091526_0002_m_000003_0 0.0% [junit] 2009-08-09 15:27:45,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=delete src=/user/hudson/mapout/_temporary dst=null perm=null [junit] 2009-08-09 15:27:45,572 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(2000)) - attempt_200908091526_0002_m_000003_0 0.0% cleanup > map [junit] 2009-08-09 15:27:45,573 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2081)) - Task attempt_200908091526_0002_m_000003_0 is done. [junit] 2009-08-09 15:27:45,573 INFO mapred.TaskTracker (TaskTracker.java:reportDone(2082)) - reported output size for attempt_200908091526_0002_m_000003_0 was 0 [junit] 2009-08-09 15:27:45,575 INFO mapred.TaskTracker (TaskTracker.java:addFreeSlots(1632)) - addFreeSlot : current free slots : 2 [junit] 2009-08-09 15:27:45,658 WARN util.ProcessTree (ProcessTree.java:terminateProcessGroup(136)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill: No such process [junit] [junit] 2009-08-09 15:27:45,658 INFO util.ProcessTree (ProcessTree.java:terminateProcessGroup(138)) - Killing all processes in the process group 16685 with SIGTERM. Exit code 1 [junit] 2009-08-09 15:27:45,737 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1301)) - map 100% reduce 100% [junit] 2009-08-09 15:27:47,026 INFO mapred.JvmManager (JvmManager.java:runChild(411)) - JVM : jvm_200908091526_0002_r_973015634 exited. Number of tasks it ran: 1 [junit] 2009-08-09 15:27:47,551 INFO mapred.TaskTracker (TaskTracker.java:tryToGetOutputSize(1584)) - org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_200908091526_0002/attempt_200908091526_0002_m_000003_0/output/file.out in any of the configured local directories [junit] 2009-08-09 15:27:47,555 INFO mapred.JobInProgress (JobInProgress.java:completedTask(2447)) - Task 'attempt_200908091526_0002_m_000003_0' has completed task_200908091526_0002_m_000003 successfully. [junit] 2009-08-09 15:27:47,556 INFO mapred.JobInProgress (JobInProgress.java:jobComplete(2612)) - Job job_200908091526_0002 has completed successfully. [junit] 2009-08-09 15:27:47,556 INFO mapred.JobInProgress$JobSummary (JobInProgress.java:logJobSummary(3280)) - jobId=job_200908091526_0002,submitTime=1249831645506,launchTime=1249831645704,finishTime=1249831667556,numMaps=3,numSlotsPerMap=1,numReduces=1,numSlotsPerReduce=1,user=hudson,queue=default,status=SUCCEEDED,mapSlotSeconds=5,reduceSlotsSeconds=9,clusterMapCapacity=4,clusterReduceCapacity=4 [junit] 2009-08-09 15:27:47,559 INFO hdfs.StateChange (FSNamesystem.java:allocateBlock(1286)) - BLOCK* NameSystem.allocateBlock: /user/hudson/mapout/_logs/history/localhost_1249831608371_job_200908091526_0002_hudson_NA. blk_-1148657827430303377_1015 [junit] 2009-08-09 15:27:47,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(240)) - Receiving block blk_-1148657827430303377_1015 src: /127.0.0.1:53366 dest: /127.0.0.1:56091 [junit] 2009-08-09 15:27:47,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(240)) - Receiving block blk_-1148657827430303377_1015 src: /127.0.0.1:34471 dest: /127.0.0.1:60717 [junit] 2009-08-09 15:27:47,600 INFO DataNode.clienttrace (BlockReceiver.java:lastDataNodeRun(807)) - src: /127.0.0.1:34471, dest: /127.0.0.1:60717, bytes: 11831, op: HDFS_WRITE, cliID: DFSClient_1936515861, offset: 0, srvID: DS-114608151-67.195.138.9-60717-1249831608172, blockid: blk_-1148657827430303377_1015, duration: 2228435 [junit] 2009-08-09 15:27:47,601 INFO datanode.DataNode (BlockReceiver.java:lastDataNodeRun(831)) - PacketResponder 0 for block blk_-1148657827430303377_1015 terminating [junit] 2009-08-09 15:27:47,601 INFO hdfs.StateChange (BlockManager.java:addStoredBlock(955)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:60717 is added to blk_-1148657827430303377_1015 size 11831 [junit] 2009-08-09 15:27:47,602 INFO DataNode.clienttrace (BlockReceiver.java:run(933)) - src: /127.0.0.1:53366, dest: /127.0.0.1:56091, bytes: 11831, op: HDFS_WRITE, cliID: DFSClient_1936515861, offset: 0, srvID: DS-1780293026-67.195.138.9-56091-1249831607448, blockid: blk_-1148657827430303377_1015, duration: 3147699 [junit] 2009-08-09 15:27:47,602 INFO datanode.DataNode (BlockReceiver.java:run(997)) - PacketResponder 1 for block blk_-1148657827430303377_1015 terminating [junit] 2009-08-09 15:27:47,602 INFO hdfs.StateChange (BlockManager.java:addStoredBlock(955)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:56091 is added to blk_-1148657827430303377_1015 size 11831 [junit] 2009-08-09 15:27:47,604 INFO hdfs.StateChange (FSNamesystem.java:completeFileInternal(1252)) - DIR* NameSystem.completeFile: file /user/hudson/mapout/_logs/history/localhost_1249831608371_job_200908091526_0002_hudson_NA is closed by DFSClient_1936515861 [junit] 2009-08-09 15:27:47,604 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(876)) - Number of transactions: 87 Total time for transactions(ms): 2Number of transactions batched in Syncs: 5 Number of syncs: 61 SyncTimes(ms): 743 511 [junit] 2009-08-09 15:27:47,683 INFO mapred.JobHistory (JobHistory.java:markCompleted(969)) - Moving completed job from http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/logs/history/localhost_1249831608371_job_200908091526_0002_hudson_NA to http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/logs/history/done/localhost_1249831608371_job_200908091526_0002_hudson_NA [junit] 2009-08-09 15:27:47,684 INFO mapred.JobHistory (JobHistory.java:markCompleted(979)) - Moving configuration of completed job from http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/logs/history/localhost_1249831608371_job_200908091526_0002_conf.xml to http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/logs/history/done/localhost_1249831608371_job_200908091526_0002_conf.xml [junit] 2009-08-09 15:27:47,687 INFO hdfs.StateChange (BlockManager.java:addToInvalidates(365)) - BLOCK* NameSystem.addToInvalidates: blk_-1991692403534823387 is added to invalidSet of 127.0.0.1:56091 [junit] 2009-08-09 15:27:47,687 INFO hdfs.StateChange (BlockManager.java:addToInvalidates(365)) - BLOCK* NameSystem.addToInvalidates: blk_-1991692403534823387 is added to invalidSet of 127.0.0.1:60717 [junit] 2009-08-09 15:27:47,687 INFO hdfs.StateChange (BlockManager.java:addToInvalidates(365)) - BLOCK* NameSystem.addToInvalidates: blk_-694604399710282663 is added to invalidSet of 127.0.0.1:60717 [junit] 2009-08-09 15:27:47,687 INFO hdfs.StateChange (BlockManager.java:addToInvalidates(365)) - BLOCK* NameSystem.addToInvalidates: blk_-694604399710282663 is added to invalidSet of 127.0.0.1:56091 [junit] 2009-08-09 15:27:47,688 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_m_000000_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:54786' [junit] 2009-08-09 15:27:47,688 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_m_000001_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:54786' [junit] 2009-08-09 15:27:47,688 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_m_000003_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:54786' [junit] 2009-08-09 15:27:47,688 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_m_000004_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:54786' [junit] 2009-08-09 15:27:47,689 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_r_000000_0' from 'tracker_host1.foo.com:localhost/127.0.0.1:54786' [junit] 2009-08-09 15:27:47,689 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(1380)) - Received 'KillJobAction' for job: job_200908091526_0002 [junit] 2009-08-09 15:27:47,689 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200908091526_0002_m_000001_0 done; removing files. [junit] 2009-08-09 15:27:47,690 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200908091526_0002_m_000003_0 done; removing files. [junit] 2009-08-09 15:27:47,691 INFO mapred.IndexCache (IndexCache.java:removeMap(140)) - Map ID attempt_200908091526_0002_m_000003_0 not found in cache [junit] 2009-08-09 15:27:47,691 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200908091526_0002_m_000000_0 done; removing files. [junit] 2009-08-09 15:27:47,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-hudson/mapred/system/job_200908091526_0002 dst=null perm=null [junit] 2009-08-09 15:27:47,742 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1350)) - Task Id : attempt_200908091526_0002_m_000003_0, Status : SUCCEEDED [junit] attempt_200908091526_0002_m_000003_0: 2009-08-09 15:27:45,397 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=MAP, sessionId= [junit] attempt_200908091526_0002_m_000003_0: 2009-08-09 15:27:45,569 INFO mapred.Task (Task.java:done(645)) - Task:attempt_200908091526_0002_m_000003_0 is done. And is in the process of commiting [junit] attempt_200908091526_0002_m_000003_0: 2009-08-09 15:27:45,574 INFO mapred.Task (Task.java:sendDone(716)) - Task 'attempt_200908091526_0002_m_000003_0' done. [junit] 2009-08-09 15:27:47,745 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1356)) - Job complete: job_200908091526_0002 [junit] 2009-08-09 15:27:47,747 INFO mapred.JobClient (Counters.java:log(534)) - Counters: 22 [junit] 2009-08-09 15:27:47,747 INFO mapred.JobClient (Counters.java:log(536)) - Job Counters [junit] 2009-08-09 15:27:47,747 INFO mapred.JobClient (Counters.java:log(538)) - Launched reduce tasks=1 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - SLOTS_MILLIS_MAPS=5364 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - Total time spent by all reduces waiting after reserving slots (ms)=0 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - Total time spent by all maps waiting after reserving slots (ms)=0 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - Rack-local map tasks=3 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - Launched map tasks=3 [junit] 2009-08-09 15:27:47,748 INFO mapred.JobClient (Counters.java:log(538)) - SLOTS_MILLIS_REDUCES=9286 [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(536)) - FileInputFormatCounters [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(538)) - BYTES_READ=3 [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(536)) - FileSystemCounters [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(538)) - FILE_BYTES_READ=21 [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(538)) - HDFS_BYTES_READ=828 [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(538)) - FILE_BYTES_WRITTEN=150 [junit] 2009-08-09 15:27:47,749 INFO mapred.JobClient (Counters.java:log(538)) - HDFS_BYTES_WRITTEN=6 [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(536)) - Map-Reduce Framework [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(538)) - Reduce input groups=3 [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(538)) - Combine output records=0 [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(538)) - Map input records=3 [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(538)) - Reduce shuffle bytes=22 [junit] 2009-08-09 15:27:47,750 INFO mapred.JobClient (Counters.java:log(538)) - Reduce output records=3 [junit] 2009-08-09 15:27:47,751 INFO mapred.JobClient (Counters.java:log(538)) - Spilled Records=6 [junit] 2009-08-09 15:27:47,751 INFO mapred.JobClient (Counters.java:log(538)) - Map output bytes=9 [junit] 2009-08-09 15:27:47,751 INFO mapred.JobClient (Counters.java:log(538)) - Combine input records=0 [junit] 2009-08-09 15:27:47,751 INFO mapred.JobClient (Counters.java:log(538)) - Map output records=3 [junit] 2009-08-09 15:27:47,751 INFO mapred.JobClient (Counters.java:log(538)) - Reduce input records=3 [junit] 2009-08-09 15:27:47,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=listStatus src=/user/hudson/mapout dst=null perm=null [junit] Found 2 items [junit] drwxr-xr-x - hudson supergroup 0 2009-08-09 15:27 /user/hudson/mapout/_logs [junit] -rw-r--r-- 3 hudson supergroup 6 2009-08-09 15:27 /user/hudson/mapout/part-00000 [junit] 2009-08-09 15:27:47,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=listStatus src=/user/hudson/mapout dst=null perm=null [junit] 2009-08-09 15:27:47,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(114)) - ugi=hudson,hudson ip=/127.0.0.1 cmd=open src=/user/hudson/mapout/part-00000 dst=null perm=null [junit] 2009-08-09 15:27:47,759 INFO DataNode.clienttrace (BlockSender.java:sendBlock(417)) - src: /127.0.0.1:56091, dest: /127.0.0.1:53368, bytes: 10, op: HDFS_READ, cliID: DFSClient_1936515861, offset: 0, srvID: DS-1780293026-67.195.138.9-56091-1249831607448, blockid: blk_-7540666018455287715_1015, duration: 230226 [junit] 2009-08-09 15:27:47,759 INFO mapred.MiniMRCluster (MiniMRCluster.java:waitTaskTrackers(306)) - Waiting for task tracker tracker_host0.foo.com:localhost/127.0.0.1:46463 to be idle. [junit] 2009-08-09 15:27:48,470 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(2327)) - Removed completed task 'attempt_200908091526_0002_m_000002_0' from 'tracker_host0.foo.com:localhost/127.0.0.1:46463' [junit] 2009-08-09 15:27:48,471 INFO mapred.TaskTracker (TaskTracker.java:purgeJob(1380)) - Received 'KillJobAction' for job: job_200908091526_0002 [junit] 2009-08-09 15:27:48,471 INFO mapred.TaskRunner (MapTaskRunner.java:close(43)) - attempt_200908091526_0002_m_000002_0 done; removing files. [junit] 2009-08-09 15:27:48,760 INFO mapred.TaskTracker (TaskTracker.java:run(637)) - Shutting down: Map-events fetcher for all reduce tasks on tracker_host0.foo.com:localhost/127.0.0.1:46463 [junit] 2009-08-09 15:27:48,761 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 46463 [junit] 2009-08-09 15:27:48,761 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 46463: exiting [junit] 2009-08-09 15:27:48,761 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 46463: exiting [junit] 2009-08-09 15:27:48,761 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 46463: exiting [junit] 2009-08-09 15:27:48,761 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 3 on 46463: exiting [junit] 2009-08-09 15:27:48,762 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 46463 [junit] 2009-08-09 15:27:48,762 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:48,762 INFO mapred.TaskTracker (TaskTracker.java:shutdown(869)) - Shutting down StatusHttpServer [junit] 2009-08-09 15:27:48,905 INFO mapred.TaskTracker (TaskTracker.java:offerService(1148)) - Interrupted. Closing down. [junit] 2009-08-09 15:27:48,906 INFO mapred.TaskTracker (TaskTracker.java:run(637)) - Shutting down: Map-events fetcher for all reduce tasks on tracker_host1.foo.com:localhost/127.0.0.1:54786 [junit] 2009-08-09 15:27:48,906 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 54786 [junit] 2009-08-09 15:27:48,907 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 54786: exiting [junit] 2009-08-09 15:27:48,907 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 54786: exiting [junit] 2009-08-09 15:27:48,908 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:48,908 INFO mapred.TaskTracker (TaskTracker.java:shutdown(869)) - Shutting down StatusHttpServer [junit] 2009-08-09 15:27:48,907 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 54786 [junit] 2009-08-09 15:27:48,907 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 3 on 54786: exiting [junit] 2009-08-09 15:27:48,907 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 54786: exiting [junit] 2009-08-09 15:27:49,010 INFO mapred.TaskTracker (TaskTracker.java:offerService(1148)) - Interrupted. Closing down. [junit] 2009-08-09 15:27:49,011 INFO mapred.JobTracker (JobTracker.java:close(2145)) - Stopping infoServer [junit] 2009-08-09 15:27:49,015 INFO mapred.JobTracker (JobTracker.java:close(2153)) - Stopping interTrackerServer [junit] 2009-08-09 15:27:49,015 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 57664 [junit] 2009-08-09 15:27:49,015 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 57664: exiting [junit] 2009-08-09 15:27:49,015 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 57664 [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 9 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 4 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 8 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 7 on 57664: exiting [junit] 2009-08-09 15:27:49,016 INFO mapred.JobTracker (JobTracker.java:offerService(2140)) - Stopped interTrackerServer [junit] 2009-08-09 15:27:49,016 INFO mapred.JobTracker (JobTracker.java:stopExpireTrackersThread(2196)) - Stopping expireTrackers [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:49,016 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 5 on 57664: exiting [junit] 2009-08-09 15:27:49,015 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 3 on 57664: exiting [junit] 2009-08-09 15:27:49,015 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 6 on 57664: exiting [junit] 2009-08-09 15:27:49,018 INFO mapred.JobTracker (JobTracker.java:close(2160)) - Stopping retirer [junit] 2009-08-09 15:27:49,019 INFO mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:terminate(106)) - Stopping Job Init Manager thread [junit] 2009-08-09 15:27:49,019 INFO mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(60)) - JobInitManagerThread interrupted. [junit] 2009-08-09 15:27:49,019 INFO mapred.EagerTaskInitializationListener (EagerTaskInitializationListener.java:run(64)) - Shutting down thread pool [junit] 2009-08-09 15:27:49,020 INFO mapred.JobTracker (JobTracker.java:close(2172)) - Stopping expireLaunchingTasks [junit] 2009-08-09 15:27:49,020 INFO mapred.JobTracker (JobTracker.java:close(2190)) - stopped all jobtracker services [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 1 [junit] 2009-08-09 15:27:49,122 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 49294 [junit] 2009-08-09 15:27:49,122 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 49294: exiting [junit] 2009-08-09 15:27:49,122 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:49,122 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2009-08-09 15:27:49,122 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 49294: exiting [junit] 2009-08-09 15:27:49,123 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:60717, storageID=DS-114608151-67.195.138.9-60717-1249831608172, infoPort=49571, ipcPort=49294):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-09 15:27:49,123 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 49294: exiting [junit] 2009-08-09 15:27:49,123 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 49294 [junit] 2009-08-09 15:27:49,125 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-08-09 15:27:49,125 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread. [junit] 2009-08-09 15:27:49,125 INFO datanode.DataNode (DataNode.java:run(1285)) - DatanodeRegistration(127.0.0.1:60717, storageID=DS-114608151-67.195.138.9-60717-1249831608172, infoPort=49571, ipcPort=49294):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/data/dfs/data/data3/current,/home/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/test/data/dfs/data/data4/current'} [junit] 2009-08-09 15:27:49,125 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 49294 [junit] 2009-08-09 15:27:49,126 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 0 [junit] Shutting down DataNode 0 [junit] 2009-08-09 15:27:49,227 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 44989 [junit] 2009-08-09 15:27:49,228 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 44989: exiting [junit] 2009-08-09 15:27:49,228 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 44989: exiting [junit] 2009-08-09 15:27:49,228 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2009-08-09 15:27:49,228 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:49,228 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 44989 [junit] 2009-08-09 15:27:49,229 WARN datanode.DataNode (DataXceiverServer.java:run(137)) - DatanodeRegistration(127.0.0.1:56091, storageID=DS-1780293026-67.195.138.9-56091-1249831607448, infoPort=54188, ipcPort=44989):DataXceiveServer: java.nio.channels.AsynchronousCloseException [junit] at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185) [junit] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152) [junit] at sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84) [junit] at org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130) [junit] at java.lang.Thread.run(Thread.java:619) [junit] [junit] 2009-08-09 15:27:49,228 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 44989: exiting [junit] 2009-08-09 15:27:49,231 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-08-09 15:27:49,231 INFO datanode.DataBlockScanner (DataBlockScanner.java:run(616)) - Exiting DataBlockScanner thread. [junit] 2009-08-09 15:27:49,231 INFO datanode.DataNode (DataNode.java:run(1285)) - DatanodeRegistration(127.0.0.1:56091, storageID=DS-1780293026-67.195.138.9-56091-1249831607448, infoPort=54188, ipcPort=44989):Finishing DataNode in: FSDataset{dirpath='http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/data/dfs/data/data1/current,/home/hudson/hudson-slave/workspace/Hadoop-Mapreduce-trunk/trunk/build/test/data/dfs/data/data2/current'} [junit] 2009-08-09 15:27:49,232 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 44989 [junit] 2009-08-09 15:27:49,232 INFO datanode.DataNode (DataNode.java:shutdown(639)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2009-08-09 15:27:49,336 WARN namenode.FSNamesystem (FSNamesystem.java:run(2057)) - ReplicationMonitor thread received InterruptedException.java.lang.InterruptedException: sleep interrupted [junit] 2009-08-09 15:27:49,337 WARN namenode.DecommissionManager (DecommissionManager.java:run(67)) - Monitor interrupted: java.lang.InterruptedException: sleep interrupted [junit] 2009-08-09 15:27:49,337 INFO namenode.FSNamesystem (FSEditLog.java:printStatistics(876)) - Number of transactions: 88 Total time for transactions(ms): 2Number of transactions batched in Syncs: 5 Number of syncs: 63 SyncTimes(ms): 791 523 [junit] 2009-08-09 15:27:49,352 INFO ipc.Server (Server.java:stop(1103)) - Stopping server on 35048 [junit] 2009-08-09 15:27:49,352 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 0 on 35048: exiting [junit] 2009-08-09 15:27:49,352 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 3 on 35048: exiting [junit] 2009-08-09 15:27:49,352 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 2 on 35048: exiting [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 4 on 35048: exiting [junit] 2009-08-09 15:27:49,352 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 1 on 35048: exiting [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 5 on 35048: exiting [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 7 on 35048: exiting [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 9 on 35048: exiting [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 6 on 35048: exiting [junit] 2009-08-09 15:27:49,354 INFO ipc.Server (Server.java:run(352)) - Stopping IPC Server listener on 35048 [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(539)) - Stopping IPC Server Responder [junit] 2009-08-09 15:27:49,353 INFO ipc.Server (Server.java:run(997)) - IPC Server handler 8 on 35048: exiting [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 103.874 sec [junit] Running org.apache.hadoop.util.TestReflectionUtils [junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.573 sec [junit] Running org.apache.hadoop.util.TestRunJar [junit] Creating filehttp://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/data/out [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.166 sec checkfailure: [touch] Creating http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build/test/testsfailed BUILD FAILED http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/ws/trunk/build.xml :630: Tests failed! Total time: 141 minutes 38 seconds Publishing Javadoc Recording test results Recording fingerprints Publishing Clover coverage report...