Hadoop-Hdfs-trunk - Build # 526 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/526/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 998 lines...] [echo] contrib: thriftfs clean-fi: clean-sign: clean: clean-contrib: clean: check-libhdfs-fuse: clean: Trying to override old definition of task macro_tar clean: [echo] contrib: hdfsproxy clean: [echo] contrib: thriftfs clean-fi: clean-sign: clean: clean-cache: [delete] Deleting directory /homes/hudson/.ivy2/cache/org.apache.hadoop BUILD FAILED /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build.xml:1211: Unable to delete file /homes/hudson/.ivy2/cache/org.apache.hadoop/avro/jars/.nfs054220080003 Total time: 1 second == == STORE: saving artifacts == == mv: cannot stat `build/*.tar.gz': No such file or directory mv: cannot stat `build/*.jar': No such file or directory mv: cannot stat `build/test/findbugs': No such file or directory mv: cannot stat `build/docs/api': No such file or directory Build Failed [FINDBUGS] Skipping publisher since build result is FAILURE Publishing Javadoc Archiving artifacts Recording test results Recording fingerprints Publishing Clover coverage report... No Clover report will be published due to a Build Failure Email was triggered for: Failure Sending email for trigger: Failure ### ## FAILED TESTS (if any) ## No tests ran.
[jira] Resolved: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22
[ https://issues.apache.org/jira/browse/HDFS-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1511. --- Resolution: Fixed Assignee: Jakob Homan Hadoop Flags: [Reviewed] I've committed this to trunk. Resolving as fixed. 98 Release Audit warnings on trunk and branch-0.22 -- Key: HDFS-1511 URL: https://issues.apache.org/jira/browse/HDFS-1511 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0, 0.23.0 Reporter: Nigel Daley Assignee: Jakob Homan Priority: Blocker Fix For: 0.22.0, 0.23.0 Attachments: HDFS-1511.patch, HDFS-1511.patch, releaseauditWarnings.txt There are 98 release audit warnings on trunk. See attached txt file. These must be fixed or filtered out to get back to a reasonably small number of warnings. The OK_RELEASEAUDIT_WARNINGS property in src/test/test-patch.properties should also be set appropriately in the patch that fixes this issue. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Hadoop-Hdfs-trunk-Commit - Build # 493 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/493/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 140756 lines...]
[junit] 2010-12-20 15:03:59,265 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2010-12-20 15:03:59,266 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(786)) - Shutting down DataNode 0
[junit] 2010-12-20 15:03:59,367 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 52203
[junit] 2010-12-20 15:03:59,368 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 52203: exiting
[junit] 2010-12-20 15:03:59,368 INFO ipc.Server (Server.java:run(475)) -
Stopping IPC Server listener on 52203
[junit] 2010-12-20 15:03:59,368 INFO ipc.Server (Server.java:run(675)) -
Stopping IPC Server Responder
[junit] 2010-12-20 15:03:59,368 WARN datanode.DataNode
(DataXceiverServer.java:run(141)) - DatanodeRegistration(127.0.0.1:33187,
storageID=DS-1110103111-127.0.1.1-33187-1292857438383, infoPort=58795,
ipcPort=52203):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:134)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2010-12-20 15:03:59,368 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2010-12-20 15:03:59,368 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 2 on 52203: exiting
[junit] 2010-12-20 15:03:59,368 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 1 on 52203: exiting
[junit] 2010-12-20 15:03:59,369 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(622)) - Exiting DataBlockScanner thread.
[junit] 2010-12-20 15:03:59,370 INFO datanode.DataNode
(DataNode.java:run(1445)) - DatanodeRegistration(127.0.0.1:33187,
storageID=DS-1110103111-127.0.1.1-33187-1292857438383, infoPort=58795,
ipcPort=52203):Finishing DataNode in:
FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data2/current/finalized'}
[junit] 2010-12-20 15:03:59,370 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 52203
[junit] 2010-12-20 15:03:59,370 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2010-12-20 15:03:59,370 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk
service threads...
[junit] 2010-12-20 15:03:59,370 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads
have been shut down.
[junit] 2010-12-20 15:03:59,371 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2010-12-20 15:03:59,472 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2822)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-20 15:03:59,472 WARN namenode.DecommissionManager
(DecommissionManager.java:run(70)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-20 15:03:59,473 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(631)) - Number of transactions: 12 Total time
for transactions(ms): 0Number of transactions batched in Syncs: 1 Number of
syncs: 9 SyncTimes(ms): 9 6
[junit] 2010-12-20 15:03:59,474 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 55985
[junit] 2010-12-20 15:03:59,474 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 1 on 55985: exiting
[junit] 2010-12-20 15:03:59,475 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 55985: exiting
[junit] 2010-12-20 15:03:59,475 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 2 on 55985: exiting
[junit] 2010-12-20 15:03:59,475 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 7 on 55985: exiting
[junit] 2010-12-20 15:03:59,475 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 9 on 55985: exiting
[junit] 2010-12-20 15:03:59,475 INFO ipc.Server (Server.java:run(475)) -
[jira] Created: (HDFS-1547) Improve decommission mechanism
Improve decommission mechanism -- Key: HDFS-1547 URL: https://issues.apache.org/jira/browse/HDFS-1547 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.23.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.23.0 Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment for more details. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Hadoop-Hdfs-trunk-Commit - Build # 494 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/494/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 137288 lines...]
[junit] 2010-12-21 00:33:20,495 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2010-12-21 00:33:20,495 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(786)) - Shutting down DataNode 0
[junit] 2010-12-21 00:33:20,610 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 38250
[junit] 2010-12-21 00:33:20,611 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 38250: exiting
[junit] 2010-12-21 00:33:20,611 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 1 on 38250: exiting
[junit] 2010-12-21 00:33:20,611 WARN datanode.DataNode
(DataXceiverServer.java:run(141)) - DatanodeRegistration(127.0.0.1:52644,
storageID=DS-596423927-127.0.1.1-52644-1292891599452, infoPort=41489,
ipcPort=38250):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:134)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2010-12-21 00:33:20,611 INFO ipc.Server (Server.java:run(675)) -
Stopping IPC Server Responder
[junit] 2010-12-21 00:33:20,611 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 2 on 38250: exiting
[junit] 2010-12-21 00:33:20,612 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2010-12-21 00:33:20,612 INFO ipc.Server (Server.java:run(475)) -
Stopping IPC Server listener on 38250
[junit] 2010-12-21 00:33:20,613 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(622)) - Exiting DataBlockScanner thread.
[junit] 2010-12-21 00:33:20,613 INFO datanode.DataNode
(DataNode.java:run(1445)) - DatanodeRegistration(127.0.0.1:52644,
storageID=DS-596423927-127.0.1.1-52644-1292891599452, infoPort=41489,
ipcPort=38250):Finishing DataNode in:
FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data2/current/finalized'}
[junit] 2010-12-21 00:33:20,613 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 38250
[junit] 2010-12-21 00:33:20,613 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2010-12-21 00:33:20,614 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk
service threads...
[junit] 2010-12-21 00:33:20,614 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads
have been shut down.
[junit] 2010-12-21 00:33:20,614 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2010-12-21 00:33:20,716 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2822)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-21 00:33:20,716 WARN namenode.DecommissionManager
(DecommissionManager.java:run(70)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-21 00:33:20,716 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(631)) - Number of transactions: 12 Total time
for transactions(ms): 0Number of transactions batched in Syncs: 1 Number of
syncs: 9 SyncTimes(ms): 6 7
[junit] 2010-12-21 00:33:20,717 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 47473
[junit] 2010-12-21 00:33:20,718 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 47473: exiting
[junit] 2010-12-21 00:33:20,718 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 8 on 47473: exiting
[junit] 2010-12-21 00:33:20,718 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 5 on 47473: exiting
[junit] 2010-12-21 00:33:20,718 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 7 on 47473: exiting
[junit] 2010-12-21 00:33:20,719 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 6 on 47473: exiting
[junit] 2010-12-21 00:33:20,718 INFO ipc.Server (Server.java:run(1444)) -
IPC
[jira] Resolved: (HDFS-1406) TestCLI fails on Ubuntu with default /etc/hosts
[ https://issues.apache.org/jira/browse/HDFS-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik resolved HDFS-1406. -- Resolution: Fixed Fix Version/s: (was: 0.23.0) (was: 0.21.1) (was: 0.22.0) Hadoop Flags: [Reviewed] I have committed this all the was from 0.20.3 and up. TestCLI fails on Ubuntu with default /etc/hosts --- Key: HDFS-1406 URL: https://issues.apache.org/jira/browse/HDFS-1406 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Todd Lipcon Assignee: Konstantin Boudnik Priority: Minor Fix For: 0.20.3 Attachments: HDFS-1406.0.20.patch, HDFS-1406.patch, Test.java Depending on the order of entries in /etc/hosts, TestCLI can fail. This is because it sets fs.default.name to localhost, and then the bound IPC socket on the NN side reports its hostname as foobar-host if the entry for 127.0.0.1 lists foobar-host before localhost. This seems to be the default in some versions of Ubuntu. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Hadoop-Hdfs-trunk-Commit - Build # 495 - Still Failing
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/495/
###
## LAST 60 LINES OF THE CONSOLE
###
[...truncated 140929 lines...]
[junit] 2010-12-21 00:45:53,108 INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdownDataNodes(786)) - Shutting down DataNode 0
[junit] 2010-12-21 00:45:53,209 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 41550
[junit] 2010-12-21 00:45:53,209 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 41550: exiting
[junit] 2010-12-21 00:45:53,209 INFO ipc.Server (Server.java:run(475)) -
Stopping IPC Server listener on 41550
[junit] 2010-12-21 00:45:53,209 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 1
[junit] 2010-12-21 00:45:53,210 INFO ipc.Server (Server.java:run(675)) -
Stopping IPC Server Responder
[junit] 2010-12-21 00:45:53,210 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 2 on 41550: exiting
[junit] 2010-12-21 00:45:53,210 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 1 on 41550: exiting
[junit] 2010-12-21 00:45:53,209 WARN datanode.DataNode
(DataXceiverServer.java:run(141)) - DatanodeRegistration(127.0.0.1:43800,
storageID=DS-968232197-127.0.1.1-43800-1292892352218, infoPort=46970,
ipcPort=41550):DataXceiveServer: java.nio.channels.AsynchronousCloseException
[junit] at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
[junit] at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
[junit] at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
[junit] at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:134)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit]
[junit] 2010-12-21 00:45:53,212 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2010-12-21 00:45:53,212 INFO datanode.DataBlockScanner
(DataBlockScanner.java:run(622)) - Exiting DataBlockScanner thread.
[junit] 2010-12-21 00:45:53,213 INFO datanode.DataNode
(DataNode.java:run(1445)) - DatanodeRegistration(127.0.0.1:43800,
storageID=DS-968232197-127.0.1.1-43800-1292892352218, infoPort=46970,
ipcPort=41550):Finishing DataNode in:
FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk-Commit/trunk/build/test/data/dfs/data/data2/current/finalized'}
[junit] 2010-12-21 00:45:53,213 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 41550
[junit] 2010-12-21 00:45:53,213 INFO datanode.DataNode
(DataNode.java:shutdown(771)) - Waiting for threadgroup to exit, active threads
is 0
[junit] 2010-12-21 00:45:53,213 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(133)) - Shutting down all async disk
service threads...
[junit] 2010-12-21 00:45:53,213 INFO datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(142)) - All async disk service threads
have been shut down.
[junit] 2010-12-21 00:45:53,213 WARN datanode.FSDatasetAsyncDiskService
(FSDatasetAsyncDiskService.java:shutdown(130)) - AsyncDiskService has already
shut down.
[junit] 2010-12-21 00:45:53,315 WARN namenode.FSNamesystem
(FSNamesystem.java:run(2822)) - ReplicationMonitor thread received
InterruptedException.java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-21 00:45:53,315 WARN namenode.DecommissionManager
(DecommissionManager.java:run(70)) - Monitor interrupted:
java.lang.InterruptedException: sleep interrupted
[junit] 2010-12-21 00:45:53,315 INFO namenode.FSEditLog
(FSEditLog.java:printStatistics(631)) - Number of transactions: 12 Total time
for transactions(ms): 0Number of transactions batched in Syncs: 1 Number of
syncs: 9 SyncTimes(ms): 9 5
[junit] 2010-12-21 00:45:53,317 INFO ipc.Server (Server.java:stop(1611)) -
Stopping server on 48472
[junit] 2010-12-21 00:45:53,317 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 0 on 48472: exiting
[junit] 2010-12-21 00:45:53,317 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 1 on 48472: exiting
[junit] 2010-12-21 00:45:53,318 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 2 on 48472: exiting
[junit] 2010-12-21 00:45:53,318 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 3 on 48472: exiting
[junit] 2010-12-21 00:45:53,318 INFO ipc.Server (Server.java:run(1444)) -
IPC Server handler 6 on 48472: exiting
[junit] 2010-12-21 00:45:53,318 INFO ipc.Server (Server.java:run(475)) -
Stopping IPC Server
