[jira] [Updated] (HDFS-6636) NameNode should remove block replica out from corrupted replica map when adding block under construction

2014-08-04 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6636: -- Attachment: (was: TestCompleteFileWithCorruptBlock.java) > NameNode should remove block replica out

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2014-07-31 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081972#comment-14081972 ] Gordon Wang commented on HDFS-6804: --- Some thoughts about how to fix this issue. In my min

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2014-07-31 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14081955#comment-14081955 ] Gordon Wang commented on HDFS-6804: --- After checking the code of Datanode block transferri

[jira] [Created] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2014-07-31 Thread Gordon Wang (JIRA)
Gordon Wang created HDFS-6804: - Summary: race condition between transferring block and appending block causes "Unexpected checksum mismatch exception" Key: HDFS-6804 URL: https://issues.apache.org/jira/browse/HDFS-68

[jira] [Updated] (HDFS-6636) NameNode should remove block replica out from corrupted replica map when adding block under construction

2014-07-07 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6636: -- Attachment: TestCompleteFileWithCorruptBlock.java attach the UT for reproducing this issue. > NameNode

[jira] [Commented] (HDFS-6636) NameNode should remove block replica out from corrupted replica map when adding block under construction

2014-07-07 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054447#comment-14054447 ] Gordon Wang commented on HDFS-6636: --- IMO, NameNode should check the corrupted block map w

[jira] [Updated] (HDFS-6636) NameNode should remove block replica out from corrupted replica map when adding block under construction

2014-07-07 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6636: -- Description: In our test environment, we found the namenode can not handle incremental block report cor

[jira] [Created] (HDFS-6636) NameNode should remove block replica out from corrupted replica map when adding block under construction

2014-07-07 Thread Gordon Wang (JIRA)
Gordon Wang created HDFS-6636: - Summary: NameNode should remove block replica out from corrupted replica map when adding block under construction Key: HDFS-6636 URL: https://issues.apache.org/jira/browse/HDFS-6636

[jira] [Updated] (HDFS-6505) file is corrupt due to last block is marked as corrupt by mistake

2014-06-17 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6505: -- Summary: file is corrupt due to last block is marked as corrupt by mistake (was: Can not close file and

[jira] [Updated] (HDFS-6505) Can not close file and file is corrupt due to last block is marked as corrupt

2014-06-09 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gordon Wang updated HDFS-6505: -- Summary: Can not close file and file is corrupt due to last block is marked as corrupt (was: Can not cl

[jira] [Commented] (HDFS-6505) Can not close file due to last block is marked as corrupt

2014-06-09 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026085#comment-14026085 ] Gordon Wang commented on HDFS-6505: --- This issue causes the last block is missing and the

[jira] [Created] (HDFS-6505) Can not close file due to last block is marked as corrupt

2014-06-09 Thread Gordon Wang (JIRA)
Gordon Wang created HDFS-6505: - Summary: Can not close file due to last block is marked as corrupt Key: HDFS-6505 URL: https://issues.apache.org/jira/browse/HDFS-6505 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-5572) Hadoop NFS rpc service port is not configurable

2014-01-03 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861315#comment-13861315 ] Gordon Wang commented on HDFS-5572: --- [~brandonli]], I see the changes in trunk code. The

[jira] [Commented] (HDFS-5572) Hadoop NFS rpc service port is not configurable

2014-01-02 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861103#comment-13861103 ] Gordon Wang commented on HDFS-5572: --- [~brandonli], actually I have formatted a patch for

[jira] [Commented] (HDFS-5572) Hadoop NFS rpc service port is not configurable

2014-01-02 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13860102#comment-13860102 ] Gordon Wang commented on HDFS-5572: --- @Brandon Li , I double checked the source code. In h

[jira] [Commented] (HDFS-5246) Make Hadoop nfs server port and mount daemon port configurable

2013-12-03 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838447#comment-13838447 ] Gordon Wang commented on HDFS-5246: --- I find NFS service port is not configurable in hadoo

[jira] [Commented] (HDFS-5572) Hadoop NFS rpc service port is not configurable

2013-11-26 Thread Gordon Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1384#comment-1384 ] Gordon Wang commented on HDFS-5572: --- I find the root cause of this bug. The rpc port in N

[jira] [Created] (HDFS-5572) Hadoop NFS rpc service port is not configurable

2013-11-26 Thread Gordon Wang (JIRA)
Gordon Wang created HDFS-5572: - Summary: Hadoop NFS rpc service port is not configurable Key: HDFS-5572 URL: https://issues.apache.org/jira/browse/HDFS-5572 Project: Hadoop HDFS Issue Type: Bug