[
https://issues.apache.org/jira/browse/HDFS-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421045#comment-15421045
]
Kihwal Lee commented on HDFS-5770:
----------------------------------
Saw this in a precommit build.
{noformat}
2016-08-12 23:40:13,900 [main] INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:waitActive(2543)) - Cluster is active
2016-08-12 23:40:13,901 [IPC Server handler 7 on 57494] INFO
FSNamesystem.audit (FSNamesystem.java:logAuditMessage(7028)) - allowed=true
ugi=jenkins (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo
src=/data dst=null perm=null proto=rpc
2016-08-12 23:40:13,906 [main] INFO hdfs.MiniDFSCluster
(MiniDFSCluster.java:shutdown(1907)) - Shutting down the Mini HDFS Cluster
2016-08-12 23:40:13,906 [main] ERROR hdfs.DFSClient
(DFSClient.java:closeAllFilesBeingWritten(579)) - Failed to close file: /data
with inode: 16386
java.io.EOFException: End of File Exception between local host is:
"6fa8fece0684/172.17.0.3"; destination host is: "localhost":57494; :
java.io.EOFException;
For more details see: http://wiki.apache.org/hadoop/EOFException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:815)
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:779)
at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1499)
at org.apache.hadoop.ipc.Client.call(Client.java:1441)
at org.apache.hadoop.ipc.Client.call(Client.java:1351)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:234)
at com.sun.proxy.$Proxy19.addBlock(Unknown Source)
{noformat}
Compared to a successful run, only 4 blocks made to the edit log instead of 5.
Then after the NN restart, the test did {{getFileIno()}} and started shutting
down the cluster without writing more data or closing the file. It might have
failed the assert, but don't see it in the log. The above exception seems to
be generated during this shutdown.
> Exception hit in TestPersistBlocks
> ----------------------------------
>
> Key: HDFS-5770
> URL: https://issues.apache.org/jira/browse/HDFS-5770
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
> Affects Versions: 3.0.0-alpha1
> Reporter: Arpit Agarwal
>
> Hit the following exception in {{TestPersistBlocks}} after running a few
> hundred iterations of the test in a loop.
> {code}
> java.io.IOException: Failed on local exception: java.io.EOFException; Host
> Details : local host is: "Arpit-MB-Pro.local/192.168.0.103"; destination host
> is: "localhost":57470;
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:764)
> at org.apache.hadoop.ipc.Client.call(Client.java:1410)
> at org.apache.hadoop.ipc.Client.call(Client.java:1359)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)
> at com.sun.proxy.$Proxy12.addBlock(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:185)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:101)
> at com.sun.proxy.$Proxy12.addBlock(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:348)
> at
> org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1259)
> at
> org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1107)
> at
> org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:515)
> Caused by: java.io.EOFException: null
> at java.io.DataInputStream.readInt(DataInputStream.java:375)
> at
> org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1050)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:945)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
