[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2020-07-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169220#comment-17169220 ] Hadoop QA commented on HDFS-13157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2020-07-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169154#comment-17169154 ] Hadoop QA commented on HDFS-13157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2020-07-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168982#comment-17168982 ] Hadoop QA commented on HDFS-13157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932488#comment-16932488 ] Stephen O'Donnell commented on HDFS-13157: -- As we uncovered quite a few issues i

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-12 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928827#comment-16928827 ] David Mollitor commented on HDFS-13157: --- [~sodonnell] Doing a 'random queue' is ve

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928431#comment-16928431 ] Stephen O'Donnell commented on HDFS-13157: -- I've been thinking about this issue

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-09 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925523#comment-16925523 ] Stephen O'Donnell commented on HDFS-13157: -- > How is it handled, iterating throu

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925176#comment-16925176 ] David Mollitor commented on HDFS-13157: --- One other thing here I don't quite underst

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925165#comment-16925165 ] David Mollitor commented on HDFS-13157: --- Thank you all for the great investigatory

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-03 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921331#comment-16921331 ] Stephen O'Donnell commented on HDFS-13157: -- {quote} # Add a configuration, whic

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-03 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921211#comment-16921211 ] Chen Zhang commented on HDFS-13157: --- Thanks [~sodonnell] for your detailed analysis, si

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921065#comment-16921065 ] Hadoop QA commented on HDFS-13157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920783#comment-16920783 ] Stephen O'Donnell commented on HDFS-13157: -- I tested my theory that this problem

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-02 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920728#comment-16920728 ] Stephen O'Donnell commented on HDFS-13157: -- I believe BlockManager.getBlocksWith

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920633#comment-16920633 ] Hadoop QA commented on HDFS-13157: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-01 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920549#comment-16920549 ] David Mollitor commented on HDFS-13157: --- OK.   I dropped the first patch.  I'm in

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-01 Thread He Xiaoqiao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920441#comment-16920441 ] He Xiaoqiao commented on HDFS-13157: Thanks [~belugabehr] for the great work and deta

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-01 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920396#comment-16920396 ] Stephen O'Donnell commented on HDFS-13157: -- The way I believe the redundancyMoni

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-09-01 Thread Chen Zhang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920359#comment-16920359 ] Chen Zhang commented on HDFS-13157: --- We've observed same problem on our production clus

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920137#comment-16920137 ] Stephen O'Donnell commented on HDFS-13157: -- Another thought - if this problem ex

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920125#comment-16920125 ] Stephen O'Donnell commented on HDFS-13157: -- Thinking about this some more, the c

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919628#comment-16919628 ] Stephen O'Donnell commented on HDFS-13157: -- This is a very interesting observati

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-30 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919609#comment-16919609 ] Wei-Chiu Chuang commented on HDFS-13157: Good work, [~belugabehr]! I think it mak

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-30 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919546#comment-16919546 ] David Mollitor commented on HDFS-13157: --- I'm pretty sure that it is the case the th

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-30 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919534#comment-16919534 ] David Mollitor commented on HDFS-13157: --- Also... One area of research...   I'm no

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-29 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918978#comment-16918978 ] David Mollitor commented on HDFS-13157: --- Yup.  That's how I plan on improving this:

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-29 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918972#comment-16918972 ] David Mollitor commented on HDFS-13157: --- Yup.  It does it in order based on Storage

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-29 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918948#comment-16918948 ] David Mollitor commented on HDFS-13157: --- Note to self:   I am confusing myself. 

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-29 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918934#comment-16918934 ] David Mollitor commented on HDFS-13157: --- Note to self: I see many places where the

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2019-08-29 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918836#comment-16918836 ] David Mollitor commented on HDFS-13157: --- I need to validate that blocks are actuall

[jira] [Commented] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2018-10-26 Thread Mark Sloan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665607#comment-16665607 ] Mark Sloan commented on HDFS-13157: --- Has anyone looked at this?   It seems like a ran