[jira] [Commented] (HDFS-1595) DFSClient may incorrectly detect datanode failure

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060275#comment-15060275 ] Kihwal Lee commented on HDFS-1595: -- It has been improved in HDFS-9178. This takes care of the most common

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12988161#action_12988161 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- Thanks Todd, but if you are

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-27 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987916#action_12987916 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- Todd, would you like to work on

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987920#action_12987920 ] Todd Lipcon commented on HDFS-1595: --- Yea, I can take this, but it may be a bit before I

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-26 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12987118#action_12987118 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {quote} It appears that Todd's

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986554#action_12986554 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {code} +int

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986560#action_12986560 ] Todd Lipcon commented on HDFS-1595: --- I'll be honest: I don't know the new Append code in

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986589#action_12986589 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- I'll be honest: I don't know

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986612#action_12986612 ] Hairong Kuang commented on HDFS-1595: - In the case we found, F has a faulty network

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986624#action_12986624 ] Kan Zhang commented on HDFS-1595: - Looks like we have 3 options when the pipeline is reduced

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986634#action_12986634 ] Todd Lipcon commented on HDFS-1595: --- Another option not mentioned above that we use in

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986774#action_12986774 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- Resurrecting the pipeline with

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986788#action_12986788 ] Koji Noguchi commented on HDFS-1595: bq. So this faulty node F has no problem receiving

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-25 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986861#action_12986861 ] dhruba borthakur commented on HDFS-1595: It appears that Todd's proposal could work

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985898#action_12985898 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- Here is my thought for fixing

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985906#action_12985906 ] Todd Lipcon commented on HDFS-1595: --- Could we solve this with a blacklist-like feature? ie

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985929#action_12985929 ] Koji Noguchi commented on HDFS-1595: Can we describe the problem users faced before

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12985939#action_12985939 ] Todd Lipcon commented on HDFS-1595: --- {quote} How about we change DFSClient so that if the

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986035#action_12986035 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {quote} Could we solve this

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986039#action_12986039 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {quote} How about we change

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986040#action_12986040 ] Todd Lipcon commented on HDFS-1595: --- bq. Consequently, the normal cases are penalized and

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986041#action_12986041 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {quote} What about something

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986046#action_12986046 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- {quote} What about something

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986097#action_12986097 ] Todd Lipcon commented on HDFS-1595: --- bq. There is no completeBlock() call to the NN. We

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986197#action_12986197 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- Sorry, I meant completeFile()

[jira] Commented: (HDFS-1595) DFSClient may incorrectly detect datanode failure

2011-01-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12986198#action_12986198 ] Tsz Wo (Nicholas), SZE commented on HDFS-1595: -- The third solution would be: