[jira] [Resolved] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12821. --- Resolution: Duplicate > Block invalid IOException causes the DFSClient domain socket being disab

[jira] [Created] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-15 Thread Gang Xie (JIRA)
Gang Xie created HDFS-12821: --- Summary: Block invalid IOException causes the DFSClient domain socket being disabled Key: HDFS-12821 URL: https://issues.apache.org/jira/browse/HDFS-12821 Project: Hadoop HDFS

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-26 Thread John Zhuge
Please go ahead. On Thu, Oct 26, 2017 at 6:12 PM, Xie Gang wrote: > Shall I create the jira directly? > > On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > > > Hi, > > > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > >

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-26 Thread Xie Gang
Shall I create the jira directly? On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > Hi, > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > socket is disabled when datanode throw block invalid exception. > > The block is invalidated for some reason

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-25 Thread John Zhuge
Hi Xie Gang, Thanks for reporting the issue. How was the block invalidated on DN? I recently created a unit test that might trigger a somewhat similar symptom: 1. Read a 4000-byte file in MiniDFS. It should go thru domain socket. 2. Call input stream unbuffer. It will close the block

Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-25 Thread Xie Gang
Hi, We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain socket is disabled when datanode throw block invalid exception. The block is invalidated for some reason on datanote and it's OK. Then DFSClient tries to access this block on this datanode via domain socket. This triggers a