See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/187/changes>
Changes:
[junping_du] YARN-3505 addendum: fix an issue in previous patch.
[jlowe] YARN-2421. RM still allocates containers to an app in the FINISHING
state. Contributed by Chang Li
[jing9] HDFS-8397. Refactor the error handling code in DataStreamer.
Contributed by Tsz Wo Nicholas Sze.
[wheat9] HDFS-8394. Move getAdditionalBlock() and related functionalities into
a separate class. Contributed by Haohui Mai.
[wheat9] HDFS-8403. Eliminate retries in
TestFileCreation#testOverwriteOpenForWrite. Contributed by Arpit Agarwal.
[xgong] YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on
a QJM cluster. Contributed by Weiwei Yang
------------------------------------------
[...truncated 8404 lines...]
[exec] 2015-05-16 14:24:38,418 INFO web.DatanodeHttpServer
(DatanodeHttpServer.java:start(150)) - Listening HTTP traffic on
/127.0.0.1:49753
[exec] 2015-05-16 14:24:38,420 INFO datanode.DataNode
(DataNode.java:startDataNode(1144)) - dnUserName = jenkins
[exec] 2015-05-16 14:24:38,420 INFO datanode.DataNode
(DataNode.java:startDataNode(1145)) - supergroup = supergroup
[exec] 2015-05-16 14:24:38,435 INFO ipc.CallQueueManager
(CallQueueManager.java:<init>(56)) - Using callQueue class
java.util.concurrent.LinkedBlockingQueue
[exec] 2015-05-16 14:24:38,437 INFO ipc.Server (Server.java:run(622)) -
Starting Socket Reader #1 for port 46057
[exec] 2015-05-16 14:24:38,445 INFO datanode.DataNode
(DataNode.java:initIpcServer(844)) - Opened IPC server at /127.0.0.1:46057
[exec] 2015-05-16 14:24:38,454 INFO datanode.DataNode
(BlockPoolManager.java:refreshNamenodes(149)) - Refresh request received for
nameservices: null
[exec] 2015-05-16 14:24:38,456 INFO datanode.DataNode
(BlockPoolManager.java:doRefreshNamenodes(194)) - Starting BPOfferServices for
nameservices: <default>
[exec] 2015-05-16 14:24:38,466 INFO datanode.DataNode
(BPServiceActor.java:run(791)) - Block pool <registering> (Datanode Uuid
unassigned) service to localhost/127.0.0.1:50740 starting to offer service
[exec] 2015-05-16 14:24:38,471 INFO ipc.Server (Server.java:run(852)) -
IPC Server Responder: starting
[exec] 2015-05-16 14:24:38,472 INFO ipc.Server (Server.java:run(692)) -
IPC Server listener on 46057: starting
[exec] 2015-05-16 14:24:39,000 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/in_use.lock>
acquired by nodename 30...@asf905.gq1.ygridcore.net
[exec] 2015-05-16 14:24:39,001 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1>
is not formatted for BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,001 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-16 14:24:39,026 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,026 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1287623031-67.195.81.149-1431786276561>
[exec] 2015-05-16 14:24:39,026 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1287623031-67.195.81.149-1431786276561>
is not formatted for BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,027 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-16 14:24:39,027 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1287623031-67.195.81.149-1431786276561 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1287623031-67.195.81.149-1431786276561/current>
[exec] 2015-05-16 14:24:39,028 INFO common.Storage
(Storage.java:tryLock(715)) - Lock on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/in_use.lock>
acquired by nodename 30...@asf905.gq1.ygridcore.net
[exec] 2015-05-16 14:24:39,029 INFO common.Storage
(DataStorage.java:loadStorageDirectory(272)) - Storage directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2>
is not formatted for BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,029 INFO common.Storage
(DataStorage.java:loadStorageDirectory(274)) - Formatting ...
[exec] 2015-05-16 14:24:39,044 INFO common.Storage
(BlockPoolSliceStorage.java:recoverTransitionRead(241)) - Analyzing storage
directories for bpid BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,044 INFO common.Storage
(Storage.java:lock(675)) - Locking is disabled for
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1287623031-67.195.81.149-1431786276561>
[exec] 2015-05-16 14:24:39,044 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(158)) - Block pool storage
directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1287623031-67.195.81.149-1431786276561>
is not formatted for BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,044 INFO common.Storage
(BlockPoolSliceStorage.java:loadStorageDirectory(160)) - Formatting ...
[exec] 2015-05-16 14:24:39,045 INFO common.Storage
(BlockPoolSliceStorage.java:format(267)) - Formatting block pool
BP-1287623031-67.195.81.149-1431786276561 directory
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1287623031-67.195.81.149-1431786276561/current>
[exec] 2015-05-16 14:24:39,046 INFO datanode.DataNode
(DataNode.java:initStorage(1405)) - Setting up storage:
nsid=27271002;bpid=BP-1287623031-67.195.81.149-1431786276561;lv=-56;nsInfo=lv=-63;cid=testClusterID;nsid=27271002;c=0;bpid=BP-1287623031-67.195.81.149-1431786276561;dnuuid=null
[exec] 2015-05-16 14:24:39,047 INFO datanode.DataNode
(DataNode.java:checkDatanodeUuid(1234)) - Generated and persisted new Datanode
UUID c1aadfec-8cd5-4532-977a-af2f205fc750
[exec] 2015-05-16 14:24:39,068 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-69eaf48f-8fab-4201-9aed-a47725af80bd
[exec] 2015-05-16 14:24:39,068 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current,>
StorageType: DISK
[exec] 2015-05-16 14:24:39,069 INFO impl.FsDatasetImpl
(FsVolumeList.java:addVolume(305)) - Added new volume:
DS-3a859749-c8a6-428c-9a8f-7bd52999a0fe
[exec] 2015-05-16 14:24:39,069 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addVolume(393)) - Added volume -
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current,>
StorageType: DISK
[exec] 2015-05-16 14:24:39,073 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:registerMBean(2060)) - Registered FSDatasetState MBean
[exec] 2015-05-16 14:24:39,081 INFO datanode.DirectoryScanner
(DirectoryScanner.java:start(332)) - Periodic Directory Tree Verification scan
starting at 1431799618081 with interval 21600000
[exec] 2015-05-16 14:24:39,081 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:addBlockPool(2508)) - Adding block pool
BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,082 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-16 14:24:39,083 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(404)) - Scanning block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-16 14:24:39,109 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1287623031-67.195.81.149-1431786276561 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
27ms
[exec] 2015-05-16 14:24:39,109 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(409)) - Time taken to scan block pool
BP-1287623031-67.195.81.149-1431786276561 on
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
27ms
[exec] 2015-05-16 14:24:39,110 INFO impl.FsDatasetImpl
(FsVolumeList.java:addBlockPool(435)) - Total time to scan all replicas for
block pool BP-1287623031-67.195.81.149-1431786276561: 28ms
[exec] 2015-05-16 14:24:39,111 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current...>
[exec] 2015-05-16 14:24:39,111 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(190)) - Adding replicas to map for block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current...>
[exec] 2015-05-16 14:24:39,111 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current/BP-1287623031-67.195.81.149-1431786276561/current/replicas>
doesn't exist
[exec] 2015-05-16 14:24:39,111 INFO impl.BlockPoolSlice
(BlockPoolSlice.java:readReplicasFromCache(688)) - Replica Cache file:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current/BP-1287623031-67.195.81.149-1431786276561/current/replicas>
doesn't exist
[exec] 2015-05-16 14:24:39,112 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data2/current>:
1ms
[exec] 2015-05-16 14:24:39,112 INFO impl.FsDatasetImpl
(FsVolumeList.java:run(195)) - Time to add replicas to map for block pool
BP-1287623031-67.195.81.149-1431786276561 on volume
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/data/data1/current>:
1ms
[exec] 2015-05-16 14:24:39,113 INFO impl.FsDatasetImpl
(FsVolumeList.java:getAllVolumesMap(221)) - Total time to add all replicas to
map: 3ms
[exec] 2015-05-16 14:24:39,115 INFO datanode.DataNode
(BPServiceActor.java:register(746)) - Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
beginning handshake with NN
[exec] 2015-05-16 14:24:39,115 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shouldWait(2316)) - dnInfo.length != numDataNodes
[exec] 2015-05-16 14:24:39,115 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2268)) - Waiting for cluster to become active
[exec] 2015-05-16 14:24:39,125 INFO hdfs.StateChange
(DatanodeManager.java:registerDatanode(883)) - BLOCK* registerDatanode: from
DatanodeRegistration(127.0.0.1:43168,
datanodeUuid=c1aadfec-8cd5-4532-977a-af2f205fc750, infoPort=49753,
infoSecurePort=0, ipcPort=46057,
storageInfo=lv=-56;cid=testClusterID;nsid=27271002;c=0) storage
c1aadfec-8cd5-4532-977a-af2f205fc750
[exec] 2015-05-16 14:24:39,126 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-16 14:24:39,127 INFO net.NetworkTopology
(NetworkTopology.java:add(418)) - Adding a new node:
/default-rack/127.0.0.1:43168
[exec] 2015-05-16 14:24:39,132 INFO datanode.DataNode
(BPServiceActor.java:register(764)) - Block pool Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
successfully registered with NN
[exec] 2015-05-16 14:24:39,132 INFO datanode.DataNode
(BPServiceActor.java:offerService(625)) - For namenode
localhost/127.0.0.1:50740 using BLOCKREPORT_INTERVAL of 21600000msec
CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000
[exec] 2015-05-16 14:24:39,141 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateHeartbeatState(448)) - Number of failed storage
changes from 0 to 0
[exec] 2015-05-16 14:24:39,142 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-69eaf48f-8fab-4201-9aed-a47725af80bd for DN 127.0.0.1:43168
[exec] 2015-05-16 14:24:39,143 INFO blockmanagement.DatanodeDescriptor
(DatanodeDescriptor.java:updateStorage(859)) - Adding new storage ID
DS-3a859749-c8a6-428c-9a8f-7bd52999a0fe for DN 127.0.0.1:43168
[exec] 2015-05-16 14:24:39,152 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(511)) - Namenode Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
trying to claim ACTIVE state with txid=1
[exec] 2015-05-16 14:24:39,152 INFO datanode.DataNode
(BPOfferService.java:updateActorStatesFromHeartbeat(523)) - Acknowledging
ACTIVE Namenode Block pool BP-1287623031-67.195.81.149-1431786276561 (Datanode
Uuid c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
[exec] 2015-05-16 14:24:39,164 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-3a859749-c8a6-428c-9a8f-7bd52999a0fe from datanode
c1aadfec-8cd5-4532-977a-af2f205fc750
[exec] 2015-05-16 14:24:39,164 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-3a859749-c8a6-428c-9a8f-7bd52999a0fe node
DatanodeRegistration(127.0.0.1:43168,
datanodeUuid=c1aadfec-8cd5-4532-977a-af2f205fc750, infoPort=49753,
infoSecurePort=0, ipcPort=46057,
storageInfo=lv=-56;cid=testClusterID;nsid=27271002;c=0), blocks: 0,
hasStaleStorage: true, processing time: 0 msecs
[exec] 2015-05-16 14:24:39,164 INFO blockmanagement.BlockManager
(BlockManager.java:processReport(1816)) - Processing first storage report for
DS-69eaf48f-8fab-4201-9aed-a47725af80bd from datanode
c1aadfec-8cd5-4532-977a-af2f205fc750
[exec] 2015-05-16 14:24:39,165 INFO BlockStateChange
(BlockManager.java:processReport(1865)) - BLOCK* processReport: from storage
DS-69eaf48f-8fab-4201-9aed-a47725af80bd node
DatanodeRegistration(127.0.0.1:43168,
datanodeUuid=c1aadfec-8cd5-4532-977a-af2f205fc750, infoPort=49753,
infoSecurePort=0, ipcPort=46057,
storageInfo=lv=-56;cid=testClusterID;nsid=27271002;c=0), blocks: 0,
hasStaleStorage: false, processing time: 1 msecs
[exec] 2015-05-16 14:24:39,181 INFO datanode.DataNode
(BPServiceActor.java:blockReport(490)) - Successfully sent block report
0xceea525ac5a6cf, containing 2 storage report(s), of which we sent 2. The
reports had 0 total blocks and used 1 RPC(s). This took 3 msec to generate and
26 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5.
[exec] 2015-05-16 14:24:39,181 INFO datanode.DataNode
(BPOfferService.java:processCommandFromActive(693)) - Got finalize command for
block pool BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,225 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2299)) - Cluster is active
[exec] 2015-05-16 14:24:39,231 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdown(1728)) - Shutting down the Mini HDFS Cluster
[exec] 2015-05-16 14:24:39,231 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(1773)) - Shutting down DataNode 0
[exec] 2015-05-16 14:24:39,231 WARN datanode.DirectoryScanner
(DirectoryScanner.java:shutdown(378)) - DirectoryScanner: shutdown has been
called
[exec] 2015-05-16 14:24:39,232 INFO datanode.DataNode
(DataXceiverServer.java:closeAllPeers(263)) - Closing all peers.
[exec] 2015-05-16 14:24:39,235 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-16 14:24:39,348 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 46057
[exec] 2015-05-16 14:24:39,348 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 46057
[exec] 2015-05-16 14:24:39,348 WARN datanode.DataNode
(BPServiceActor.java:offerService(701)) - BPOfferService for Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
interrupted
[exec] 2015-05-16 14:24:39,349 WARN datanode.DataNode
(BPServiceActor.java:run(831)) - Ending block pool service for: Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750) service to localhost/127.0.0.1:50740
[exec] 2015-05-16 14:24:39,349 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-16 14:24:39,450 INFO datanode.DataNode
(BlockPoolManager.java:remove(102)) - Removed Block pool
BP-1287623031-67.195.81.149-1431786276561 (Datanode Uuid
c1aadfec-8cd5-4532-977a-af2f205fc750)
[exec] 2015-05-16 14:24:39,451 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:shutdownBlockPool(2518)) - Removing block pool
BP-1287623031-67.195.81.149-1431786276561
[exec] 2015-05-16 14:24:39,452 INFO impl.FsDatasetImpl
(FsDatasetImpl.java:run(2989)) - LazyWriter was interrupted, exiting
[exec] 2015-05-16 14:24:39,453 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(184)) - Shutting down all async disk
service threads
[exec] 2015-05-16 14:24:39,453 INFO impl.FsDatasetAsyncDiskService
(FsDatasetAsyncDiskService.java:shutdown(192)) - All async disk service threads
have been shut down
[exec] 2015-05-16 14:24:39,453 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(165)) - Shutting down all async
lazy persist service threads
[exec] 2015-05-16 14:24:39,453 INFO impl.RamDiskAsyncLazyPersistService
(RamDiskAsyncLazyPersistService.java:shutdown(172)) - All async lazy persist
service threads have been shut down
[exec] 2015-05-16 14:24:39,457 INFO datanode.DataNode
(DataNode.java:shutdown(1821)) - Shutdown complete.
[exec] 2015-05-16 14:24:39,458 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-16 14:24:39,458 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4405)) - LazyPersistFileScrubber was interrupted, exiting
[exec] 2015-05-16 14:24:39,458 INFO namenode.FSEditLog
(FSEditLog.java:endCurrentLogSegment(1291)) - Ending log segment 1
[exec] 2015-05-16 14:24:39,459 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(698)) - Number of transactions: 2 Total time
for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of
syncs: 3 SyncTimes(ms): 2 1
[exec] 2015-05-16 14:24:39,460 INFO namenode.FSNamesystem
(FSNamesystem.java:run(4325)) - NameNodeEditLogRoller was interrupted, exiting
[exec] 2015-05-16 14:24:39,462 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name1/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-16 14:24:39,463 INFO namenode.FileJournalManager
(FileJournalManager.java:finalizeLogSegment(134)) - Finalizing edits file
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_inprogress_0000000000000000001>
->
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/native/build/test/data/dfs/name2/current/edits_0000000000000000001-0000000000000000002>
[exec] 2015-05-16 14:24:39,465 INFO ipc.Server (Server.java:stop(2569)) -
Stopping server on 50740
[exec] 2015-05-16 14:24:39,466 INFO ipc.Server (Server.java:run(724)) -
Stopping IPC Server listener on 50740
[exec] 2015-05-16 14:24:39,467 INFO ipc.Server (Server.java:run(857)) -
Stopping IPC Server Responder
[exec] 2015-05-16 14:24:39,467 INFO blockmanagement.BlockManager
(BlockManager.java:run(3686)) - Stopping ReplicationMonitor.
[exec] 2015-05-16 14:24:39,508 INFO namenode.FSNamesystem
(FSNamesystem.java:stopActiveServices(1221)) - Stopping services started for
active state
[exec] 2015-05-16 14:24:39,509 INFO namenode.FSNamesystem
(FSNamesystem.java:stopStandbyServices(1311)) - Stopping services started for
standby state
[exec] 2015-05-16 14:24:39,510 INFO mortbay.log (Slf4jLog.java:info(67))
- Stopped SelectChannelConnector@localhost:0
[exec] 2015-05-16 14:24:39,611 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(211)) - Stopping DataNode metrics system...
[exec] 2015-05-16 14:24:39,612 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:stop(217)) - DataNode metrics system stopped.
[exec] 2015-05-16 14:24:39,612 INFO impl.MetricsSystemImpl
(MetricsSystemImpl.java:shutdown(601)) - DataNode metrics system shutdown
complete.
[echo] Finished test_native_mini_dfs
[INFO] Executed tasks
[INFO]
[INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-jar-plugin:2.5:test-jar (prepare-test-jar) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-sources.jar>
[INFO]
[INFO] >>> maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs >>>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[INFO] Executed tasks
[INFO]
[INFO] --- hadoop-maven-plugins:3.0.0-SNAPSHOT:protoc (compile-protoc) @
hadoop-hdfs ---
[INFO]
[INFO] <<< maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs <<<
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar (default) @ hadoop-hdfs ---
[INFO] Building jar:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-hdfs-3.0.0-SNAPSHOT-test-sources.jar>
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default) @ hadoop-hdfs ---
[INFO] Fork Value is true
[java] Warnings generated: 1
[INFO] Done FindBugs Analysis....
[INFO]
[INFO] --- maven-dependency-plugin:2.2:copy (site) @ hadoop-hdfs ---
[INFO] Configured Artifact: jdiff:jdiff:1.0.9:jar
[INFO] Configured Artifact:
org.apache.hadoop:hadoop-annotations:3.0.0-SNAPSHOT:jar
[INFO] Configured Artifact: xerces:xercesImpl:2.11.0:jar
[INFO] Copying jdiff-1.0.9.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/jdiff.jar>
[INFO] Copying hadoop-annotations-3.0.0-SNAPSHOT.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/hadoop-annotations.jar>
[INFO] Copying xercesImpl-2.11.0.jar to
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/xerces.jar>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (site) @ hadoop-hdfs ---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src>
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project
---
[INFO] Deleting
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target>
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project
---
[INFO] Executing tasks
main:
[mkdir] Created dir:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO]
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @
hadoop-hdfs-project ---
[INFO] Not executing Javadoc as the project is not a Java classpath-capable
package
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project
---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @
hadoop-hdfs-project ---
[INFO]
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @
hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 56.380 s]
[INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:51 h]
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.042 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:52 h
[INFO] Finished at: 2015-05-16T14:26:48+00:00
[INFO] Final Memory: 54M/158M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-antrun-plugin:1.7:run (site) on project
hadoop-hdfs: An Ant BuildException has occured:
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/src/main/docs>
does not exist.
[ERROR] around Ant part ...<copy
todir="<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/docs-src";>...>
@ 5:127 in
<https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/antrun/build-main.xml>
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #175
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 797615 bytes
Compression is 0.0%
Took 31 sec
Recording test results
Updating HDFS-8394
Updating HDFS-8403
Updating HDFS-8397
Updating YARN-3505
Updating YARN-3526
Updating YARN-2421
