[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026858#comment-13026858 ] dhruba borthakur commented on HDFS-1848: Hi Koji, I am fine implementing more healt

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026355#comment-13026355 ] Steve Loughran commented on HDFS-1848: -- +1 for more healthchecking, with easy ways to

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026340#comment-13026340 ] Koji Noguchi commented on HDFS-1848: bq. I am surprised that this problem is not solved

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-28 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026271#comment-13026271 ] Bharath Mundlapudi commented on HDFS-1848: -- I think, Koji's point is - should we h

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026127#comment-13026127 ] dhruba borthakur commented on HDFS-1848: > Would something like mapreduce's healthC

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026125#comment-13026125 ] Koji Noguchi commented on HDFS-1848: bq. It seems like a good idea for a cluster admini

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13026121#comment-13026121 ] dhruba borthakur commented on HDFS-1848: > Point #1 is limited to allowing an admin

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-26 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13025349#comment-13025349 ] Eli Collins commented on HDFS-1848: --- I agree the datanode should only check the validity

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-23 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023527#comment-13023527 ] dhruba borthakur commented on HDFS-1848: Thanks Eli for the explanation. It seems f

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022931#comment-13022931 ] Eli Collins commented on HDFS-1848: --- Good points Bharath. I think the DN should explicit

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022905#comment-13022905 ] Bharath Mundlapudi commented on HDFS-1848: -- Thanks Eli for explaining on the useca

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022857#comment-13022857 ] Eli Collins commented on HDFS-1848: --- The DN volume checking code tests all directories sp

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022840#comment-13022840 ] dhruba borthakur commented on HDFS-1848: thanks Eli/Koji for the explanation. are y

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022816#comment-13022816 ] Eli Collins commented on HDFS-1848: --- bq. I am wondering if this is necessary? Typically,

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022815#comment-13022815 ] Koji Noguchi commented on HDFS-1848: bq. That was the problem earlier, Koji. With the f

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022810#comment-13022810 ] Bharath Mundlapudi commented on HDFS-1848: -- That was the problem earlier, Koji. Wi

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022799#comment-13022799 ] Koji Noguchi commented on HDFS-1848: > In our tests with disk failures, We have verifie

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-21 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022686#comment-13022686 ] dhruba borthakur commented on HDFS-1848: I too am not clear why the datanode proces

[jira] [Commented] (HDFS-1848) Datanodes should shutdown when a critical volume fails

2011-04-20 Thread Bharath Mundlapudi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022628#comment-13022628 ] Bharath Mundlapudi commented on HDFS-1848: -- I am wondering if this is necessary? T