See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/371/changes
Changes: [cdouglas] HADOOP-2367. Add ability to profile a subset of map/reduce tasks and fetch the result to the local filesystem of the submitting application. Also includes a general IntegerRanges extension to Configuration for setting positive, ranged parameters. Contributed by Owen O'Malley. [jimk] HADOOP-2643 Make migration tool smarter. ------------------------------------------ [...truncated 74600 lines...] [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:195) [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:134) [junit] at org.apache.hadoop.dfs.MiniDFSCluster.<init>(MiniDFSCluster.java:106) [junit] at org.apache.hadoop.security.TestPermission.testFilePermision(TestPermission.java:111) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:585) [junit] at junit.framework.TestCase.runTest(TestCase.java:154) [junit] at junit.framework.TestCase.runBare(TestCase.java:127) [junit] at junit.framework.TestResult$1.protect(TestResult.java:106) [junit] at junit.framework.TestResult.runProtected(TestResult.java:124) [junit] at junit.framework.TestResult.run(TestResult.java:109) [junit] at junit.framework.TestCase.run(TestCase.java:118) [junit] at junit.framework.TestSuite.runTest(TestSuite.java:208) [junit] at junit.framework.TestSuite.run(TestSuite.java:203) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:297) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:672) [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:567) [junit] 2008-01-20 17:29:29,224 INFO dfs.NameNodeMetrics (NameNodeMetrics.java:<init>(74)) - Initializing NameNodeMeterics using context object:org.apache.hadoop.metrics.spi.NullContext [junit] 2008-01-20 17:29:29,259 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(321)) - fsOwner=hudson,other [junit] 2008-01-20 17:29:29,261 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(325)) - supergroup=supergroup [junit] 2008-01-20 17:29:29,262 INFO fs.FSNamesystem (FSNamesystem.java:setConfigurationParameters(326)) - isPermissionEnabled=true [junit] 2008-01-20 17:29:29,267 INFO fs.FSNamesystem (FSNamesystem.java:initialize(248)) - Finished loading FSImage in 43 msecs [junit] 2008-01-20 17:29:29,268 INFO fs.FSNamesystem (FSNamesystem.java:leave(3554)) - Leaving safemode after 44 msecs [junit] 2008-01-20 17:29:29,268 INFO dfs.StateChange (FSNamesystem.java:leave(3563)) - STATE* Network topology has 0 racks and 0 datanodes [junit] 2008-01-20 17:29:29,269 INFO dfs.StateChange (FSNamesystem.java:leave(3566)) - STATE* UnderReplicatedBlocks has 0 blocks [junit] 2008-01-20 17:29:29,273 INFO http.HttpServer (HttpServer.java:doStart(729)) - Version Jetty/5.1.4 [junit] 2008-01-20 17:29:29,379 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:29,381 INFO util.Container (Container.java:start(74)) - Started WebApplicationContext[/,/] [junit] 2008-01-20 17:29:29,382 INFO util.Container (Container.java:start(74)) - Started HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:29,382 INFO util.Container (Container.java:start(74)) - Started HttpContext[/static,/static] [junit] 2008-01-20 17:29:29,384 INFO http.SocketListener (SocketListener.java:start(204)) - Started SocketListener on 0.0.0.0:36721 [junit] 2008-01-20 17:29:29,384 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:29,384 INFO fs.FSNamesystem (FSNamesystem.java:initialize(287)) - Web-server up at: 0.0.0.0:36721 [junit] 2008-01-20 17:29:29,385 INFO ipc.Server (Server.java:run(470)) - IPC Server Responder: starting [junit] 2008-01-20 17:29:29,385 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 0 on 36720: starting [junit] 2008-01-20 17:29:29,386 INFO ipc.Server (Server.java:run(317)) - IPC Server listener on 36720: starting [junit] 2008-01-20 17:29:29,387 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 1 on 36720: starting [junit] 2008-01-20 17:29:29,387 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 5 on 36720: starting [junit] 2008-01-20 17:29:29,387 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 6 on 36720: starting [junit] 2008-01-20 17:29:29,388 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 9 on 36720: starting [junit] 2008-01-20 17:29:29,388 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 3 on 36720: starting [junit] 2008-01-20 17:29:29,388 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 7 on 36720: starting [junit] 2008-01-20 17:29:29,388 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 8 on 36720: starting [junit] 2008-01-20 17:29:29,388 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 4 on 36720: starting [junit] 2008-01-20 17:29:29,386 INFO ipc.Server (Server.java:run(872)) - IPC Server handler 2 on 36720: starting [junit] Starting DataNode 0 with dfs.data.dir: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data2 [junit] 2008-01-20 17:29:29,424 INFO jvm.JvmMetrics (JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2008-01-20 17:29:29,428 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1 is not formatted. [junit] 2008-01-20 17:29:29,429 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:29,589 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data2 is not formatted. [junit] 2008-01-20 17:29:29,590 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:29,715 INFO dfs.DataNode (DataNode.java:startDataNode(318)) - Opened server at 36724 [junit] 2008-01-20 17:29:29,723 INFO dfs.DataNode (DataNode.java:startDataNode(340)) - Balancing bandwith is 1048576 bytes/s [junit] 2008-01-20 17:29:29,725 INFO http.HttpServer (HttpServer.java:doStart(729)) - Version Jetty/5.1.4 [junit] 2008-01-20 17:29:29,804 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:29,806 INFO util.Container (Container.java:start(74)) - Started WebApplicationContext[/,/] [junit] 2008-01-20 17:29:29,807 INFO util.Container (Container.java:start(74)) - Started HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:29,807 INFO util.Container (Container.java:start(74)) - Started HttpContext[/static,/static] [junit] 2008-01-20 17:29:29,808 INFO http.SocketListener (SocketListener.java:start(204)) - Started SocketListener on 0.0.0.0:36725 [junit] 2008-01-20 17:29:29,809 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:29,810 INFO dfs.StateChange (FSNamesystem.java:registerDatanode(1850)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:36724 storage DS-1922225288-140.211.11.75-36724-1200850169809 [junit] 2008-01-20 17:29:29,811 INFO net.NetworkTopology (NetworkTopology.java:add(320)) - Adding a new node: /default-rack/127.0.0.1:36724 [junit] 2008-01-20 17:29:29,831 INFO dfs.DataNode (DataNode.java:register(500)) - New storage id DS-1922225288-140.211.11.75-36724-1200850169809 is assigned to data-node 127.0.0.1:36724 [junit] Starting DataNode 1 with dfs.data.dir: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data4 [junit] 2008-01-20 17:29:29,832 INFO dfs.DataNode (DataNode.java:run(2432)) - 127.0.0.1:36724In DataNode.run, data = FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data2/current'} [junit] 2008-01-20 17:29:29,832 INFO jvm.JvmMetrics (JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2008-01-20 17:29:29,833 INFO dfs.DataNode (DataNode.java:offerService(622)) - using BLOCKREPORT_INTERVAL of 3332577msec Initial delay: 0msec [junit] 2008-01-20 17:29:29,879 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3 is not formatted. [junit] 2008-01-20 17:29:29,880 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:30,050 INFO dfs.DataNode (DataNode.java:offerService(701)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2008-01-20 17:29:30,140 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data4 is not formatted. [junit] 2008-01-20 17:29:30,140 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:30,339 INFO dfs.DataNode (DataNode.java:startDataNode(318)) - Opened server at 36726 [junit] 2008-01-20 17:29:30,340 INFO dfs.DataNode (DataNode.java:startDataNode(340)) - Balancing bandwith is 1048576 bytes/s [junit] 2008-01-20 17:29:30,342 INFO http.HttpServer (HttpServer.java:doStart(729)) - Version Jetty/5.1.4 [junit] 2008-01-20 17:29:30,420 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:30,421 INFO util.Container (Container.java:start(74)) - Started WebApplicationContext[/,/] [junit] 2008-01-20 17:29:30,422 INFO util.Container (Container.java:start(74)) - Started HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:30,422 INFO util.Container (Container.java:start(74)) - Started HttpContext[/static,/static] [junit] 2008-01-20 17:29:30,424 INFO http.SocketListener (SocketListener.java:start(204)) - Started SocketListener on 0.0.0.0:36727 [junit] 2008-01-20 17:29:30,424 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:30,426 INFO dfs.StateChange (FSNamesystem.java:registerDatanode(1850)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:36726 storage DS-25598367-140.211.11.75-36726-1200850170425 [junit] 2008-01-20 17:29:30,426 INFO net.NetworkTopology (NetworkTopology.java:add(320)) - Adding a new node: /default-rack/127.0.0.1:36726 [junit] 2008-01-20 17:29:30,455 INFO dfs.DataNode (DataNode.java:register(500)) - New storage id DS-25598367-140.211.11.75-36726-1200850170425 is assigned to data-node 127.0.0.1:36726 [junit] 2008-01-20 17:29:30,456 INFO dfs.DataNode (DataNode.java:run(2432)) - 127.0.0.1:36726In DataNode.run, data = FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data4/current'} [junit] Starting DataNode 2 with dfs.data.dir: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data5,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data6 [junit] 2008-01-20 17:29:30,457 INFO dfs.DataNode (DataNode.java:offerService(622)) - using BLOCKREPORT_INTERVAL of 3454231msec Initial delay: 0msec [junit] 2008-01-20 17:29:30,457 INFO jvm.JvmMetrics (JvmMetrics.java:init(51)) - Cannot initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized [junit] 2008-01-20 17:29:30,491 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data5 is not formatted. [junit] 2008-01-20 17:29:30,492 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:30,634 INFO dfs.DataNode (DataNode.java:offerService(701)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2008-01-20 17:29:30,681 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(117)) - Storage directory http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data6 is not formatted. [junit] 2008-01-20 17:29:30,682 INFO dfs.Storage (DataStorage.java:recoverTransitionRead(118)) - Formatting ... [junit] 2008-01-20 17:29:30,849 INFO dfs.DataNode (DataNode.java:startDataNode(318)) - Opened server at 36728 [junit] 2008-01-20 17:29:30,850 INFO dfs.DataNode (DataNode.java:startDataNode(340)) - Balancing bandwith is 1048576 bytes/s [junit] 2008-01-20 17:29:30,853 INFO http.HttpServer (HttpServer.java:doStart(729)) - Version Jetty/5.1.4 [junit] 2008-01-20 17:29:30,928 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:30,930 INFO util.Container (Container.java:start(74)) - Started WebApplicationContext[/,/] [junit] 2008-01-20 17:29:30,930 INFO util.Container (Container.java:start(74)) - Started HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:30,931 INFO util.Container (Container.java:start(74)) - Started HttpContext[/static,/static] [junit] 2008-01-20 17:29:30,933 INFO http.SocketListener (SocketListener.java:start(204)) - Started SocketListener on 0.0.0.0:36729 [junit] 2008-01-20 17:29:30,933 INFO util.Container (Container.java:start(74)) - Started [EMAIL PROTECTED] [junit] 2008-01-20 17:29:30,935 INFO dfs.StateChange (FSNamesystem.java:registerDatanode(1850)) - BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:36728 storage DS-339789329-140.211.11.75-36728-1200850170934 [junit] 2008-01-20 17:29:30,935 INFO net.NetworkTopology (NetworkTopology.java:add(320)) - Adding a new node: /default-rack/127.0.0.1:36728 [junit] 2008-01-20 17:29:31,107 INFO dfs.DataNode (DataNode.java:register(500)) - New storage id DS-339789329-140.211.11.75-36728-1200850170934 is assigned to data-node 127.0.0.1:36728 [junit] 2008-01-20 17:29:31,108 INFO dfs.DataNode (DataNode.java:run(2432)) - 127.0.0.1:36728In DataNode.run, data = FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data5/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data6/current'} [junit] 2008-01-20 17:29:31,138 INFO dfs.DataNode (DataNode.java:offerService(622)) - using BLOCKREPORT_INTERVAL of 3520751msec Initial delay: 0msec [junit] 2008-01-20 17:29:31,324 INFO dfs.DataNode (DataNode.java:offerService(701)) - BlockReport of 0 blocks got processed in 1 msecs [junit] 2008-01-20 17:29:32,465 INFO fs.DFSClient (DFSClient.java:run(1592)) - Allocating new block [junit] 2008-01-20 17:29:32,466 INFO dfs.StateChange (FSNamesystem.java:allocateBlock(1274)) - BLOCK* NameSystem.allocateBlock: /data/file1. blk_-6601888446323993104 [junit] 2008-01-20 17:29:32,468 INFO fs.DFSClient (DFSClient.java:createBlockOutputStream(1982)) - pipeline = 127.0.0.1:36724 [junit] 2008-01-20 17:29:32,468 INFO fs.DFSClient (DFSClient.java:createBlockOutputStream(1982)) - pipeline = 127.0.0.1:36726 [junit] 2008-01-20 17:29:32,468 INFO fs.DFSClient (DFSClient.java:createBlockOutputStream(1982)) - pipeline = 127.0.0.1:36728 [junit] 2008-01-20 17:29:32,468 INFO fs.DFSClient (DFSClient.java:createBlockOutputStream(1985)) - Connecting to 127.0.0.1:36724 [junit] 2008-01-20 17:29:32,470 INFO dfs.DataNode (DataNode.java:writeBlock(1084)) - Receiving block blk_-6601888446323993104 from /127.0.0.1 [junit] 2008-01-20 17:29:32,472 INFO dfs.DataNode (DataNode.java:writeBlock(1084)) - Receiving block blk_-6601888446323993104 from /127.0.0.1 [junit] 2008-01-20 17:29:32,473 INFO dfs.DataNode (DataNode.java:writeBlock(1084)) - Receiving block blk_-6601888446323993104 from /127.0.0.1 [junit] 2008-01-20 17:29:32,474 INFO dfs.DataNode (DataNode.java:writeBlock(1169)) - Datanode 0 forwarding connect ack to upstream firstbadlink is [junit] 2008-01-20 17:29:32,474 INFO dfs.DataNode (DataNode.java:writeBlock(1150)) - Datanode 1 got response for connect ack from downstream datanode with firstbadlink as [junit] 2008-01-20 17:29:32,474 INFO dfs.DataNode (DataNode.java:writeBlock(1169)) - Datanode 1 forwarding connect ack to upstream firstbadlink is [junit] 2008-01-20 17:29:32,475 INFO dfs.DataNode (DataNode.java:writeBlock(1150)) - Datanode 2 got response for connect ack from downstream datanode with firstbadlink as [junit] 2008-01-20 17:29:32,475 INFO dfs.DataNode (DataNode.java:writeBlock(1169)) - Datanode 2 forwarding connect ack to upstream firstbadlink is [junit] 2008-01-20 17:29:32,550 INFO dfs.DataNode (DataNode.java:lastDataNodeRun(1802)) - Received block blk_-6601888446323993104 of size 100 from /127.0.0.1 [junit] 2008-01-20 17:29:32,551 INFO dfs.DataNode (DataNode.java:lastDataNodeRun(1819)) - PacketResponder 0 for block blk_-6601888446323993104 terminating [junit] 2008-01-20 17:29:32,552 INFO dfs.StateChange (FSNamesystem.java:addStoredBlock(2467)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:36728 is added to blk_-6601888446323993104 size 100 [junit] 2008-01-20 17:29:32,700 INFO dfs.DataNode (DataNode.java:run(1886)) - Received block blk_-6601888446323993104 of size 100 from /127.0.0.1 [junit] 2008-01-20 17:29:32,700 INFO dfs.DataNode (DataNode.java:run(1944)) - PacketResponder 1 for block blk_-6601888446323993104 terminating [junit] 2008-01-20 17:29:32,701 INFO dfs.StateChange (FSNamesystem.java:addStoredBlock(2467)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:36726 is added to blk_-6601888446323993104 size 100 [junit] 2008-01-20 17:29:32,874 INFO dfs.DataNode (DataNode.java:run(1886)) - Received block blk_-6601888446323993104 of size 100 from /127.0.0.1 [junit] 2008-01-20 17:29:32,875 INFO dfs.DataNode (DataNode.java:run(1944)) - PacketResponder 2 for block blk_-6601888446323993104 terminating [junit] 2008-01-20 17:29:32,875 INFO fs.DFSClient (DFSClient.java:run(1653)) - Closing old block blk_-6601888446323993104 [junit] 2008-01-20 17:29:32,877 INFO dfs.StateChange (FSNamesystem.java:addStoredBlock(2467)) - BLOCK* NameSystem.addStoredBlock: blockMap updated: 127.0.0.1:36724 is added to blk_-6601888446323993104 size 100 [junit] 2008-01-20 17:29:33,031 INFO dfs.DataNode (DataNode.java:readBlock(1051)) - 127.0.0.1:36726 Served block blk_-6601888446323993104 to /127.0.0.1 [junit] 2008-01-20 17:29:33,479 INFO ipc.Server (Server.java:run(910)) - IPC Server handler 0 on 36720, call mkdirs(/data/web2, rwxr-xr-x) from 127.0.0.1:36736: error: org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] at org.apache.hadoop.dfs.PermissionChecker.check(PermissionChecker.java:171) [junit] at org.apache.hadoop.dfs.PermissionChecker.check(PermissionChecker.java:152) [junit] at org.apache.hadoop.dfs.PermissionChecker.checkPermission(PermissionChecker.java:100) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkPermission(FSNamesystem.java:3954) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkAncestorAccess(FSNamesystem.java:3934) [junit] at org.apache.hadoop.dfs.FSNamesystem.mkdirsInternal(FSNamesystem.java:1541) [junit] at org.apache.hadoop.dfs.FSNamesystem.mkdirs(FSNamesystem.java:1524) [junit] at org.apache.hadoop.dfs.NameNode.mkdirs(NameNode.java:413) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:585) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) [junit] 2008-01-20 17:29:33,495 INFO ipc.Server (Server.java:run(910)) - IPC Server handler 1 on 36720, call create(/data/file2, rwxr-xr-x, DFSClient_858921736, true, 3, 67108864) from 127.0.0.1:36736: error: org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=WRITE, inode="data":hudson:supergroup:rwxr-xr-x [junit] at org.apache.hadoop.dfs.PermissionChecker.check(PermissionChecker.java:171) [junit] at org.apache.hadoop.dfs.PermissionChecker.check(PermissionChecker.java:152) [junit] at org.apache.hadoop.dfs.PermissionChecker.checkPermission(PermissionChecker.java:100) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkPermission(FSNamesystem.java:3954) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkAncestorAccess(FSNamesystem.java:3934) [junit] at org.apache.hadoop.dfs.FSNamesystem.startFileInternal(FSNamesystem.java:940) [junit] at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:915) [junit] at org.apache.hadoop.dfs.NameNode.create(NameNode.java:273) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:585) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) [junit] 2008-01-20 17:29:33,497 INFO ipc.Server (Server.java:run(910)) - IPC Server handler 5 on 36720, call open(/data/file1, 0, 671088640) from 127.0.0.1:36736: error: org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=READ, inode="file1":hudson:supergroup:rw------- [junit] org.apache.hadoop.fs.permission.AccessControlException: Permission denied: user=Who, access=READ, inode="file1":hudson:supergroup:rw------- [junit] at org.apache.hadoop.dfs.PermissionChecker.check(PermissionChecker.java:171) [junit] at org.apache.hadoop.dfs.PermissionChecker.checkPermission(PermissionChecker.java:106) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkPermission(FSNamesystem.java:3954) [junit] at org.apache.hadoop.dfs.FSNamesystem.checkPathAccess(FSNamesystem.java:3924) [junit] at org.apache.hadoop.dfs.FSNamesystem.getBlockLocations(FSNamesystem.java:732) [junit] at org.apache.hadoop.dfs.NameNode.getBlockLocations(NameNode.java:246) [junit] at org.apache.hadoop.dfs.NameNode.open(NameNode.java:233) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit] at java.lang.reflect.Method.invoke(Method.java:585) [junit] at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409) [junit] at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908) [junit] Shutting down the Mini HDFS Cluster [junit] Shutting down DataNode 2 [junit] 2008-01-20 17:29:34,472 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:36729 [junit] 2008-01-20 17:29:34,472 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:34,596 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-01-20 17:29:34,704 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:34,809 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-01-20 17:29:34,810 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:34,811 INFO dfs.DataNode (DataNode.java:shutdown(540)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-01-20 17:29:34,812 INFO dfs.DataBlockScanner (DataBlockScanner.java:run(561)) - Exiting DataBlockScanner thread. [junit] 2008-01-20 17:29:34,812 INFO dfs.DataNode (DataNode.java:run(2463)) - 127.0.0.1:36728:Finishing DataNode in: FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data5/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data6/current'} [junit] Shutting down DataNode 1 [junit] 2008-01-20 17:29:34,814 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:36727 [junit] 2008-01-20 17:29:34,814 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:34,914 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-01-20 17:29:35,012 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:35,109 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-01-20 17:29:35,109 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:35,110 INFO dfs.DataNode (DataNode.java:shutdown(540)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-01-20 17:29:35,600 INFO dfs.DataBlockScanner (DataBlockScanner.java:run(561)) - Exiting DataBlockScanner thread. [junit] 2008-01-20 17:29:36,120 INFO dfs.DataNode (DataNode.java:shutdown(540)) - Waiting for threadgroup to exit, active threads is 0 [junit] 2008-01-20 17:29:36,121 INFO dfs.DataNode (DataNode.java:run(2463)) - 127.0.0.1:36726:Finishing DataNode in: FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data3/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data4/current'} [junit] Shutting down DataNode 0 [junit] 2008-01-20 17:29:36,122 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:36725 [junit] 2008-01-20 17:29:36,123 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:36,220 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-01-20 17:29:36,312 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:36,404 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-01-20 17:29:36,405 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:36,406 INFO dfs.DataNode (DataNode.java:shutdown(540)) - Waiting for threadgroup to exit, active threads is 1 [junit] 2008-01-20 17:29:36,407 INFO dfs.DataBlockScanner (DataBlockScanner.java:run(561)) - Exiting DataBlockScanner thread. [junit] 2008-01-20 17:29:36,407 INFO dfs.DataNode (DataNode.java:run(2463)) - 127.0.0.1:36724:Finishing DataNode in: FSDataset{dirpath='http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build/test/data/dfs/data/data1/current,/export/home/hudson/hudson/jobs/Hadoop-Nightly/workspace/trunk/build/test/data/dfs/data/data2/current'} [junit] 2008-01-20 17:29:36,409 INFO http.SocketListener (SocketListener.java:stop(212)) - Stopped SocketListener on 0.0.0.0:36721 [junit] 2008-01-20 17:29:36,409 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:36,504 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/] [junit] 2008-01-20 17:29:36,592 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs] [junit] 2008-01-20 17:29:36,681 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static] [junit] 2008-01-20 17:29:36,682 INFO util.Container (Container.java:stop(156)) - Stopped [EMAIL PROTECTED] [junit] 2008-01-20 17:29:36,683 INFO fs.FSNamesystem (FSEditLog.java:printStatistics(772)) - Number of transactions: 6 Total time for transactions(ms): 1 Number of syncs: 4 SyncTimes(ms): 228 175 [junit] 2008-01-20 17:29:36,723 INFO ipc.Server (Server.java:stop(999)) - Stopping server on 36720 [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 1 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 8 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 0 on 36720: exiting [junit] 2008-01-20 17:29:36,725 INFO ipc.Server (Server.java:run(525)) - Stopping IPC Server Responder [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 19.376 sec [junit] 2008-01-20 17:29:36,725 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 2 on 36720: exiting [junit] 2008-01-20 17:29:36,725 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 6 on 36720: exiting [junit] 2008-01-20 17:29:36,725 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 5 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 4 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(353)) - Stopping IPC Server listener on 36720 [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 9 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 7 on 36720: exiting [junit] 2008-01-20 17:29:36,724 INFO ipc.Server (Server.java:run(939)) - IPC Server handler 3 on 36720: exiting [junit] Running org.apache.hadoop.security.TestUnixUserGroupInformation [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.393 sec [junit] Running org.apache.hadoop.util.TestReflectionUtils [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.632 sec BUILD FAILED http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/ws/trunk/build.xml :532: Tests failed! Total time: 165 minutes 2 seconds Recording fingerprints Publishing Javadoc Recording test results Updating HADOOP-2367 Updating HADOOP-2643