See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/309/changes
Changes:
[nigel] Preparing for release 0.15.1
[nigel] Preparing for release 0.14.4
[dhruba] HADOOP-713. Reduce CPU usage on namenode while listing directories.
FileSystem.listPaths does not return the size of the entire subtree.
Introduced a new API ClientProtocol.getContentLength that returns the
size of the subtree. (Dhruba Borthakur via dhruba)
------------------------------------------
[...truncated 34810 lines...]
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:02,966 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(897)) -
task_200711201249_0004_r_000000_0 Need 1 map output(s)
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:02,969 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(916)) -
task_200711201249_0004_r_000000_0: Got 1 new map-outputs & 0 obsolete
map-outputs from tasktracker and 0 map-outputs from previous failures
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:02,970 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(937)) -
task_200711201249_0004_r_000000_0 Got 1 known map output location(s);
scheduling...
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:02,970 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(977)) -
task_200711201249_0004_r_000000_0 Scheduled 1 of 1 known outputs (0 slow hosts
and 0 dup hosts)
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:02,971 INFO
mapred.ReduceTask (ReduceTask.java:copyOutput(703)) -
task_200711201249_0004_r_000000_0 Copying task_200711201249_0004_m_000001_0
output from lucene.zones.apache.org.
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,016 INFO
mapred.ReduceTask (ReduceTask.java:copyOutput(751)) -
task_200711201249_0004_r_000000_0 done copying
task_200711201249_0004_m_000001_0 output from lucene.zones.apache.org.
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,023 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(1121)) -
task_200711201249_0004_r_000000_0 Copying of all map outputs complete.
Initiating the last merge on the remaining files in ramfs://mapoutput29420695
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,411 INFO
mapred.ReduceTask (ReduceTask.java:fetchOutputs(1165)) -
task_200711201249_0004_r_000000_0 Merge of the 2 files in InMemoryFileSystem
complete. Local file is
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/mapred/local/1_0/task_200711201249_0004_r_000000_0/map_1.out
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,437 INFO
pipes.PipesReducer (PipesReducer.java:startApplication(68)) - starting
application
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,584 INFO
pipes.PipesReducer (PipesReducer.java:close(102)) - waiting for finish
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,587 INFO
pipes.PipesReducer (PipesReducer.java:close(104)) - got done
[junit] task_200711201249_0004_r_000000_0: 2007-11-20 12:51:03,601 INFO
mapred.TaskRunner (Task.java:done(382)) - Task
'task_200711201249_0004_r_000000_0' done.
[junit] 2007-11-20 12:51:05,836 INFO mapred.JobClient
(JobClient.java:runJob(833)) - Job complete: job_200711201249_0004
[junit] 2007-11-20 12:51:05,839 INFO mapred.JobClient
(Counters.java:log(367)) - Counters: 6
[junit] 2007-11-20 12:51:05,840 INFO mapred.JobClient
(Counters.java:log(371)) - Job Counters
[junit] 2007-11-20 12:51:05,841 INFO mapred.JobClient
(Counters.java:log(373)) - Launched map tasks=2
[junit] 2007-11-20 12:51:05,842 INFO mapred.JobClient
(Counters.java:log(373)) - Launched reduce tasks=2
[junit] 2007-11-20 12:51:05,842 INFO mapred.JobClient
(Counters.java:log(371)) - Map-Reduce Framework
[junit] 2007-11-20 12:51:05,843 INFO mapred.JobClient
(Counters.java:log(373)) - Map output records=13
[junit] 2007-11-20 12:51:05,843 INFO mapred.JobClient
(Counters.java:log(373)) - Map output bytes=86
[junit] 2007-11-20 12:51:05,844 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input groups=11
[junit] 2007-11-20 12:51:05,845 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input records=13
[junit] 2007-11-20 12:51:05,847 INFO mapred.MiniMRCluster
(MiniMRCluster.java:waitUntilIdle(206)) - Waiting for task tracker
tracker_lucene.zones.apache.org:/127.0.0.1:34325 to be idle.
[junit] 2007-11-20 12:51:06,507 INFO dfs.StateChange
(FSNamesystem.java:blocksToInvalidate(2821)) - BLOCK*
NameSystem.blockToInvalidate: ask 127.0.0.1:50011 to delete
blk_6452750878646700743 blk_-4499479336382118021
[junit] 2007-11-20 12:51:06,508 INFO dfs.StateChange
(FSNamesystem.java:blocksToInvalidate(2821)) - BLOCK*
NameSystem.blockToInvalidate: ask 127.0.0.1:50010 to delete
blk_6452750878646700743 blk_-4499479336382118021
[junit] 2007-11-20 12:51:06,518 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_6452750878646700743 file
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1/current/blk_6452750878646700743
[junit] 2007-11-20 12:51:06,519 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_-4499479336382118021 file
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data2/current/blk_-4499479336382118021
[junit] 2007-11-20 12:51:06,607 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_6452750878646700743 file
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3/current/blk_6452750878646700743
[junit] 2007-11-20 12:51:06,608 INFO dfs.DataNode
(FSDataset.java:invalidate(740)) - Deleting block blk_-4499479336382118021 file
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data4/current/blk_-4499479336382118021
[junit] 2007-11-20 12:51:06,855 INFO mapred.MiniMRCluster
(MiniMRCluster.java:waitUntilIdle(206)) - Waiting for task tracker
tracker_lucene.zones.apache.org:/127.0.0.1:34325 to be idle.
[junit] 2007-11-20 12:51:07,296 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(901)) - Removed completed task
'task_200711201249_0004_m_000001_0' from
'tracker_lucene.zones.apache.org:/127.0.0.1:34325'
[junit] 2007-11-20 12:51:07,297 INFO mapred.JobTracker
(JobTracker.java:removeMarkedTasks(901)) - Removed completed task
'task_200711201249_0004_r_000001_0' from
'tracker_lucene.zones.apache.org:/127.0.0.1:34325'
[junit] 2007-11-20 12:51:07,299 INFO mapred.TaskTracker
(TaskTracker.java:purgeJob(994)) - Received 'KillJobAction' for job:
job_200711201249_0004
[junit] 2007-11-20 12:51:07,300 INFO mapred.TaskRunner
(ReduceTaskRunner.java:close(45)) - task_200711201249_0004_r_000001_0 done;
removing files.
[junit] 2007-11-20 12:51:07,303 INFO mapred.TaskRunner
(MapTaskRunner.java:close(41)) - task_200711201249_0004_m_000001_0 done;
removing files.
[junit] 2007-11-20 12:51:07,869 INFO ipc.Server (Server.java:stop(677)) -
Stopping server on 34325
[junit] 2007-11-20 12:51:07,870 INFO mapred.TaskTracker
(TaskTracker.java:shutdown(649)) - Shutting down StatusHttpServer
[junit] 2007-11-20 12:51:07,871 INFO mapred.TaskTracker
(TaskTracker.java:run(496)) - Shutting down: Map-events fetcher for all reduce
tasks on tracker_lucene.zones.apache.org:/127.0.0.1:34325
[junit] 2007-11-20 12:51:07,871 INFO ipc.Server (Server.java:run(316)) -
Stopping IPC Server listener on 34325
[junit] 2007-11-20 12:51:07,873 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:50060
[junit] 2007-11-20 12:51:07,871 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 1 on 34325: exiting
[junit] 2007-11-20 12:51:07,876 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:07,870 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 0 on 34325: exiting
[junit] 2007-11-20 12:51:08,172 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:08,368 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:08,496 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:08,497 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:08,498 INFO mapred.TaskTracker
(TaskTracker.java:offerService(829)) - Interrupted. Closing down.
[junit] 2007-11-20 12:51:08,516 INFO ipc.Server (Server.java:stop(677)) -
Stopping server on 34326
[junit] 2007-11-20 12:51:08,517 INFO mapred.TaskTracker
(TaskTracker.java:shutdown(649)) - Shutting down StatusHttpServer
[junit] 2007-11-20 12:51:08,517 INFO ipc.Server (Server.java:run(316)) -
Stopping IPC Server listener on 34326
[junit] 2007-11-20 12:51:08,519 INFO mapred.TaskTracker
(TaskTracker.java:run(496)) - Shutting down: Map-events fetcher for all reduce
tasks on tracker_lucene.zones.apache.org:/127.0.0.1:34326
[junit] 2007-11-20 12:51:08,519 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 0 on 34326: exiting
[junit] 2007-11-20 12:51:08,519 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:50061
[junit] 2007-11-20 12:51:08,522 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:08,663 INFO util.ThreadedServer
(ThreadedServer.java:run(656)) - Stopping Acceptor
ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=50061]
[junit] 2007-11-20 12:51:08,664 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 1 on 34326: exiting
[junit] 2007-11-20 12:51:08,663 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:08,785 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:08,916 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:08,917 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:08,917 INFO mapred.TaskTracker
(TaskTracker.java:offerService(829)) - Interrupted. Closing down.
[junit] 2007-11-20 12:51:08,918 INFO mapred.JobTracker
(JobTracker.java:close(739)) - Stopping infoServer
[junit] 2007-11-20 12:51:08,920 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:34321
[junit] 2007-11-20 12:51:08,920 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:09,043 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:09,161 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:09,285 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:09,286 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:09,286 INFO mapred.JobTracker
(JobTracker.java:close(747)) - Stopping interTrackerServer
[junit] 2007-11-20 12:51:09,286 INFO ipc.Server (Server.java:stop(677)) -
Stopping server on 34320
[junit] 2007-11-20 12:51:09,287 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 3 on 34320: exiting
[junit] 2007-11-20 12:51:09,287 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 1 on 34320: exiting
[junit] 2007-11-20 12:51:09,287 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 0 on 34320: exiting
[junit] 2007-11-20 12:51:09,288 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 2 on 34320: exiting
[junit] 2007-11-20 12:51:09,289 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 4 on 34320: exiting
[junit] 2007-11-20 12:51:09,289 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 5 on 34320: exiting
[junit] 2007-11-20 12:51:09,289 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 8 on 34320: exiting
[junit] 2007-11-20 12:51:09,289 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 7 on 34320: exiting
[junit] 2007-11-20 12:51:09,289 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 6 on 34320: exiting
[junit] 2007-11-20 12:51:09,290 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 9 on 34320: exiting
[junit] 2007-11-20 12:51:09,290 INFO ipc.Server (Server.java:run(316)) -
Stopping IPC Server listener on 34320
[junit] 2007-11-20 12:51:09,291 INFO mapred.JobTracker
(JobTracker.java:close(751)) - Stopping expireTrackers
[junit] 2007-11-20 12:51:09,291 INFO mapred.JobTracker
(JobTracker.java:offerService(734)) - Stopped interTrackerServer
[junit] 2007-11-20 12:51:09,292 ERROR mapred.JobTracker
(JobTracker.java:run(308)) - Tracker Expiry Thread got exception:
java.lang.InterruptedException: sleep interrupted
[junit] at java.lang.Thread.sleep(Native Method)
[junit] at
org.apache.hadoop.mapred.JobTracker$ExpireTrackers.run(JobTracker.java:263)
[junit] at java.lang.Thread.run(Thread.java:595)
[junit] 2007-11-20 12:51:09,292 INFO mapred.JobTracker
(JobTracker.java:close(761)) - Stopping retirer
[junit] 2007-11-20 12:51:09,293 INFO mapred.JobTracker
(JobTracker.java:close(770)) - Stopping initer
[junit] 2007-11-20 12:51:09,294 INFO mapred.JobTracker
(JobTracker.java:close(779)) - Stopping expireLaunchingTasks
[junit] 2007-11-20 12:51:09,294 INFO mapred.JobTracker
(JobTracker.java:close(789)) - Stopping TaskCommit thread
[junit] 2007-11-20 12:51:09,296 WARN mapred.JobTracker
(JobTracker.java:run(2014)) - Task Commit Thread exiting, got interrupted:
java.lang.InterruptedException
[junit] at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1815)
[junit] at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1850)
[junit] at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
[junit] at
org.apache.hadoop.mapred.JobTracker$TaskCommitQueue.run(JobTracker.java:1916)
[junit] 2007-11-20 12:51:09,296 INFO mapred.JobTracker
(JobTracker.java:close(797)) - stopped all jobtracker services
[junit] Shutting down the Mini HDFS Cluster
[junit] Shutting down DataNode 1
[junit] 2007-11-20 12:51:09,298 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:34317
[junit] 2007-11-20 12:51:09,299 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:09,424 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:09,541 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:09,654 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:09,656 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:09,658 INFO dfs.DataNode
(DataNode.java:run(1738)) - 127.0.0.1:50011:Finishing DataNode in:
FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data4/current'}
[junit] Shutting down DataNode 0
[junit] 2007-11-20 12:51:09,659 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:34314
[junit] 2007-11-20 12:51:09,660 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:09,775 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:09,893 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:10,002 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:10,003 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:10,017 INFO dfs.DataNode
(DataNode.java:run(1738)) - 127.0.0.1:50010:Finishing DataNode in:
FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data2/current'}
[junit] 2007-11-20 12:51:10,018 WARN fs.FSNamesystem
(PendingReplicationBlocks.java:run(187)) - PendingReplicationMonitor thread
received exception. java.lang.InterruptedException: sleep interrupted
[junit] 2007-11-20 12:51:10,020 INFO http.SocketListener
(SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:34310
[junit] 2007-11-20 12:51:10,020 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:10,130 INFO util.Container
(Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
[junit] 2007-11-20 12:51:10,237 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
[junit] 2007-11-20 12:51:10,363 INFO util.Container
(Container.java:stop(156)) - Stopped HttpContext[/static,/static]
[junit] 2007-11-20 12:51:10,363 INFO util.Container
(Container.java:stop(156)) - Stopped [EMAIL PROTECTED]
[junit] 2007-11-20 12:51:10,364 INFO fs.FSNamesystem
(FSEditLog.java:printStatistics(741)) - Number of transactions: 117 Total time
for transactions(ms): 4 Number of syncs: 76 SyncTimes(ms): 279 456
[junit] 2007-11-20 12:51:10,366 INFO ipc.Server (Server.java:stop(677)) -
Stopping server on 34303
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 3 on 34303: exiting
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 0 on 34303: exiting
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 7 on 34303: exiting
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 4 on 34303: exiting
[junit] 2007-11-20 12:51:10,368 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 8 on 34303: exiting
[junit] 2007-11-20 12:51:10,369 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 5 on 34303: exiting
[junit] 2007-11-20 12:51:10,369 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 1 on 34303: exiting
[junit] 2007-11-20 12:51:10,369 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 9 on 34303: exiting
[junit] 2007-11-20 12:51:10,368 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 6 on 34303: exiting
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(316)) -
Stopping IPC Server listener on 34303
[junit] 2007-11-20 12:51:10,367 INFO ipc.Server (Server.java:run(633)) -
IPC Server handler 2 on 34303: exiting
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 101.749 sec
[junit] Running org.apache.hadoop.net.TestNetworkTopology
[junit] 2007-11-20 12:51:11,668 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r1/h1:5020
[junit] 2007-11-20 12:51:11,675 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r1/h2:5020
[junit] 2007-11-20 12:51:11,676 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h3:5020
[junit] 2007-11-20 12:51:11,677 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h4:5020
[junit] 2007-11-20 12:51:11,677 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h5:5020
[junit] 2007-11-20 12:51:11,678 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d2/r3/h6:5020
[junit] 2007-11-20 12:51:11,679 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d2/r3/h7:5020
[junit] 2007-11-20 12:51:11,749 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d1/r1/h1:5020
[junit] 2007-11-20 12:51:11,751 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d1/r1/h2:5020
[junit] 2007-11-20 12:51:11,752 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d1/r2/h3:5020
[junit] 2007-11-20 12:51:11,753 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d1/r2/h4:5020
[junit] 2007-11-20 12:51:11,755 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d1/r2/h5:5020
[junit] 2007-11-20 12:51:11,756 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d2/r3/h6:5020
[junit] 2007-11-20 12:51:11,757 INFO net.NetworkTopology
(NetworkTopology.java:remove(351)) - Removing a node: /d2/r3/h7:5020
[junit] 2007-11-20 12:51:11,758 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r1/h1:5020
[junit] 2007-11-20 12:51:11,759 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r1/h2:5020
[junit] 2007-11-20 12:51:11,760 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h3:5020
[junit] 2007-11-20 12:51:11,761 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h4:5020
[junit] 2007-11-20 12:51:11,763 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d1/r2/h5:5020
[junit] 2007-11-20 12:51:11,764 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d2/r3/h6:5020
[junit] 2007-11-20 12:51:11,765 INFO net.NetworkTopology
(NetworkTopology.java:add(320)) - Adding a new node: /d2/r3/h7:5020
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.082 sec
[junit] Running org.apache.hadoop.record.TestBuffer
[junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.154 sec
[junit] Running org.apache.hadoop.record.TestRecordIO
[junit] Illustrating toString
bugT,102,4567,99344109427290,3.1449999809265137,1.5234,'random
text,#000102030405060708090a0b0c0d0e0f101112131415161718191a1b1c1d1e1f202122232425262728292a2b2c2d2e2f303132333435363738393a3b3c3d3e3f404142434445464748494a4b4c4d4e4f505152535455565758595a5b5c5d5e5f606162636465666768696a6b6c6d6e6f707172737475767778797a7b7c7d7e7f808182838485868788898a8b8c8d8e8f909192939495969798999a9b9c9d9e9fa0a1a2a3a4a5a6a7a8a9aaabacadaeafb0b1b2b3b4b5b6b7b8b9babbbcbdbebfc0c1c2c3c4c5c6c7c8c9cacbcccdcecfd0d1d2d3d4d5d6d7d8d9dadbdcdddedfe0e1e2e3e4e5e6e7e8e9eaebecedeeeff0f1f2f3f4f5f6f7f8f9fafbfcfdfeff,v{},m{},s{'other
random text}
[junit] Illustrating toString
bugT,102,4567,99344109427290,3.1449999809265137,1.5234,'random
text,#000102030405060708090a0b0c0d0e0f101112131415161718191a1b1c1d1e1f202122232425262728292a2b2c2d2e2f303132333435363738393a3b3c3d3e3f404142434445464748494a4b4c4d4e4f505152535455565758595a5b5c5d5e5f606162636465666768696a6b6c6d6e6f707172737475767778797a7b7c7d7e7f808182838485868788898a8b8c8d8e8f909192939495969798999a9b9c9d9e9fa0a1a2a3a4a5a6a7a8a9aaabacadaeafb0b1b2b3b4b5b6b7b8b9babbbcbdbebfc0c1c2c3c4c5c6c7c8c9cacbcccdcecfd0d1d2d3d4d5d6d7d8d9dadbdcdddedfe0e1e2e3e4e5e6e7e8e9eaebecedeeeff0f1f2f3f4f5f6f7f8f9fafbfcfdfeff,v{},m{},s{'other
random text}
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 0.557 sec
[junit] Running org.apache.hadoop.record.TestRecordMR
[junit] 2007-11-20 12:51:15,316 INFO jvm.JvmMetrics
(JvmMetrics.java:init(56)) - Initializing JVM Metrics with
processName=JobTracker, sessionId=
[junit] 2007-11-20 12:51:15,389 WARN mapred.JobClient
(JobClient.java:submitJob(496)) - No job jar file set. User classes may not be
found. See JobConf(Class) or JobConf#setJar(String).
[junit] 2007-11-20 12:51:15,416 INFO mapred.FileInputFormat
(FileInputFormat.java:validateInput(157)) - Total input paths to process : 1
[junit] 2007-11-20 12:51:15,723 WARN conf.Configuration
(Configuration.java:loadResource(877)) -
build/test/mapred/local/localRunner/job_local_1.xml:a attempt to override final
parameter: hadoop.tmp.dir; Ignoring.
[junit] 2007-11-20 12:51:15,757 INFO mapred.JobClient
(JobClient.java:runJob(755)) - Running job: job_local_1
[junit] 2007-11-20 12:51:15,812 INFO mapred.MapTask
(MapTask.java:run(127)) - numReduceTasks: 1
[junit] 2007-11-20 12:51:16,020 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) -
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/genins/answer.key
:0+190
[junit] 2007-11-20 12:51:16,026 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'map_0000' done.
[junit] 2007-11-20 12:51:16,136 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) - reduce > reduce
[junit] 2007-11-20 12:51:16,138 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'reduce_r0l5fx' done.
[junit] 2007-11-20 12:51:16,147 INFO mapred.TaskRunner
(Task.java:saveTaskOutput(434)) - Saved output of task 'reduce_r0l5fx' to
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/genouts
[junit] 2007-11-20 12:51:16,769 INFO mapred.JobClient
(JobClient.java:runJob(833)) - Job complete: job_local_1
[junit] 2007-11-20 12:51:16,770 INFO mapred.JobClient
(Counters.java:log(367)) - Counters: 7
[junit] 2007-11-20 12:51:16,780 INFO mapred.JobClient
(Counters.java:log(371)) - Map-Reduce Framework
[junit] 2007-11-20 12:51:16,781 INFO mapred.JobClient
(Counters.java:log(373)) - Map input records=10
[junit] 2007-11-20 12:51:16,783 INFO mapred.JobClient
(Counters.java:log(373)) - Map output records=100
[junit] 2007-11-20 12:51:16,785 INFO mapred.JobClient
(Counters.java:log(373)) - Map input bytes=100
[junit] 2007-11-20 12:51:16,786 INFO mapred.JobClient
(Counters.java:log(373)) - Map output bytes=697
[junit] 2007-11-20 12:51:16,788 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input groups=100
[junit] 2007-11-20 12:51:16,789 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input records=100
[junit] 2007-11-20 12:51:16,789 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce output records=100
[junit] 2007-11-20 12:51:16,856 INFO jvm.JvmMetrics
(JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= - already initialized
[junit] 2007-11-20 12:51:16,859 WARN mapred.JobClient
(JobClient.java:submitJob(496)) - No job jar file set. User classes may not be
found. See JobConf(Class) or JobConf#setJar(String).
[junit] 2007-11-20 12:51:16,862 INFO mapred.FileInputFormat
(FileInputFormat.java:validateInput(157)) - Total input paths to process : 1
[junit] 2007-11-20 12:51:17,273 WARN conf.Configuration
(Configuration.java:loadResource(877)) -
build/test/mapred/local/localRunner/job_local_2.xml:a attempt to override final
parameter: hadoop.tmp.dir; Ignoring.
[junit] 2007-11-20 12:51:17,286 INFO mapred.JobClient
(JobClient.java:runJob(755)) - Running job: job_local_2
[junit] 2007-11-20 12:51:17,307 INFO mapred.MapTask
(MapTask.java:run(127)) - numReduceTasks: 1
[junit] 2007-11-20 12:51:17,358 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) -
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/genouts/part-00000
:0+1093
[junit] 2007-11-20 12:51:17,358 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'map_0000' done.
[junit] 2007-11-20 12:51:17,384 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) - reduce > reduce
[junit] 2007-11-20 12:51:17,384 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'reduce_q8xbvf' done.
[junit] 2007-11-20 12:51:17,389 INFO mapred.TaskRunner
(Task.java:saveTaskOutput(434)) - Saved output of task 'reduce_q8xbvf' to
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/intermediateouts
[junit] 2007-11-20 12:51:18,294 INFO mapred.JobClient
(JobClient.java:runJob(833)) - Job complete: job_local_2
[junit] 2007-11-20 12:51:18,295 INFO mapred.JobClient
(Counters.java:log(367)) - Counters: 7
[junit] 2007-11-20 12:51:18,296 INFO mapred.JobClient
(Counters.java:log(371)) - Map-Reduce Framework
[junit] 2007-11-20 12:51:18,296 INFO mapred.JobClient
(Counters.java:log(373)) - Map input records=100
[junit] 2007-11-20 12:51:18,297 INFO mapred.JobClient
(Counters.java:log(373)) - Map output records=100
[junit] 2007-11-20 12:51:18,297 INFO mapred.JobClient
(Counters.java:log(373)) - Map input bytes=1000
[junit] 2007-11-20 12:51:18,298 INFO mapred.JobClient
(Counters.java:log(373)) - Map output bytes=300
[junit] 2007-11-20 12:51:18,298 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input groups=10
[junit] 2007-11-20 12:51:18,299 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input records=100
[junit] 2007-11-20 12:51:18,299 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce output records=10
[junit] 2007-11-20 12:51:18,328 INFO jvm.JvmMetrics
(JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= - already initialized
[junit] 2007-11-20 12:51:18,330 WARN mapred.JobClient
(JobClient.java:submitJob(496)) - No job jar file set. User classes may not be
found. See JobConf(Class) or JobConf#setJar(String).
[junit] 2007-11-20 12:51:18,331 INFO mapred.FileInputFormat
(FileInputFormat.java:validateInput(157)) - Total input paths to process : 1
[junit] 2007-11-20 12:51:18,403 WARN conf.Configuration
(Configuration.java:loadResource(877)) -
build/test/mapred/local/localRunner/job_local_3.xml:a attempt to override final
parameter: hadoop.tmp.dir; Ignoring.
[junit] 2007-11-20 12:51:18,406 INFO mapred.JobClient
(JobClient.java:runJob(755)) - Running job: job_local_3
[junit] 2007-11-20 12:51:18,412 INFO mapred.MapTask
(MapTask.java:run(127)) - numReduceTasks: 1
[junit] 2007-11-20 12:51:18,433 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) -
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/intermediateouts/part-00000
:0+205
[junit] 2007-11-20 12:51:18,434 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'map_0000' done.
[junit] 2007-11-20 12:51:18,447 INFO mapred.LocalJobRunner
(LocalJobRunner.java:statusUpdate(210)) - reduce > reduce
[junit] 2007-11-20 12:51:18,448 INFO mapred.TaskRunner
(Task.java:done(382)) - Task 'reduce_y03zl2' done.
[junit] 2007-11-20 12:51:18,452 INFO mapred.TaskRunner
(Task.java:saveTaskOutput(434)) - Saved output of task 'reduce_y03zl2' to
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/mapred.loadtest/finalouts
[junit] 2007-11-20 12:51:19,414 INFO mapred.JobClient
(JobClient.java:runJob(833)) - Job complete: job_local_3
[junit] 2007-11-20 12:51:19,416 INFO mapred.JobClient
(Counters.java:log(367)) - Counters: 7
[junit] 2007-11-20 12:51:19,416 INFO mapred.JobClient
(Counters.java:log(371)) - Map-Reduce Framework
[junit] 2007-11-20 12:51:19,417 INFO mapred.JobClient
(Counters.java:log(373)) - Map input records=10
[junit] 2007-11-20 12:51:19,418 INFO mapred.JobClient
(Counters.java:log(373)) - Map output records=10
[junit] 2007-11-20 12:51:19,419 INFO mapred.JobClient
(Counters.java:log(373)) - Map input bytes=112
[junit] 2007-11-20 12:51:19,420 INFO mapred.JobClient
(Counters.java:log(373)) - Map output bytes=20
[junit] 2007-11-20 12:51:19,421 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input groups=10
[junit] 2007-11-20 12:51:19,422 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce input records=10
[junit] 2007-11-20 12:51:19,424 INFO mapred.JobClient
(Counters.java:log(373)) - Reduce output records=10
[junit] Original sum: 100
[junit] Recomputed sum: 100
[junit] Success=true
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 4.868 sec
[junit] Running org.apache.hadoop.record.TestRecordWritable
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 3.992 sec
[junit] Running org.apache.hadoop.util.TestReflectionUtils
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 1.367 sec
BUILD FAILED
http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build.xml
:511: Tests failed!
Total time: 65 minutes 18 seconds
Recording fingerprints
Publishing Javadoc
Recording test results
Updating HADOOP-713
