[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027676#comment-15027676 ] Staffan Friberg commented on HDFS-9260: --- Added a new benchmark that does IBRs on a bl

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102574#comment-15102574 ] Colin Patrick McCabe commented on HDFS-9260: Thanks for working on this, [~sfri

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110816#comment-15110816 ] Staffan Friberg commented on HDFS-9260: --- Thanks for the comments [~cmccabe]! Did all

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110829#comment-15110829 ] Staffan Friberg commented on HDFS-9260: --- {quote} What is the strategy for shrinking B

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1552#comment-1552 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15112866#comment-15112866 ] Colin Patrick McCabe commented on HDFS-9260: bq. This comment is simply copied

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113195#comment-15113195 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113600#comment-15113600 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115356#comment-15115356 ] Staffan Friberg commented on HDFS-9260: --- Fixed checkstyle on TreeSet. Should I conve

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115578#comment-15115578 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118269#comment-15118269 ] Colin Patrick McCabe commented on HDFS-9260: bq. Should I convert storages fiel

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120237#comment-15120237 ] Jing Zhao commented on HDFS-9260: - Thanks for the great work, [~sfriberg]. The patch looks

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120593#comment-15120593 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122433#comment-15122433 ] Staffan Friberg commented on HDFS-9260: --- Thanks for the comments Patch 15 (and 16) s

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122460#comment-15122460 ] Staffan Friberg commented on HDFS-9260: --- Hi [~jingzhao], Thank you for your comments

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122693#comment-15122693 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15122898#comment-15122898 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. bq. 7. The r

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124049#comment-15124049 ] Jing Zhao commented on HDFS-9260: - Thanks for updating the patch, [~sfriberg]. Yeah, I thi

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124260#comment-15124260 ] Colin Patrick McCabe commented on HDFS-9260: Hmm. Let's make the compaction ti

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124362#comment-15124362 ] Staffan Friberg commented on HDFS-9260: --- Patch17 Added timeout as a tuneable Sm

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124467#comment-15124467 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. {code} 4194

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124565#comment-15124565 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15126967#comment-15126967 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127238#comment-15127238 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. The unit tes

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127435#comment-15127435 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963055#comment-14963055 ] Walter Su commented on HDFS-9260: - Excellent work [~sfriberg]! 1. Per your tests, the resu

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963610#comment-14963610 ] Staffan Friberg commented on HDFS-9260: --- Hi Walter 1) I think this is part could red

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964712#comment-14964712 ] Walter Su commented on HDFS-9260: - The biggest part of BlockInfo is the implicit linked lis

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964719#comment-14964719 ] Walter Su commented on HDFS-9260: - -TreeMap- TreeSet > Improve performance and GC friendli

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965242#comment-14965242 ] Staffan Friberg commented on HDFS-9260: --- The TreeSet reduces the number of reference

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971575#comment-14971575 ] Staffan Friberg commented on HDFS-9260: --- Also handles negative non-striped (EC) entri

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971979#comment-14971979 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972281#comment-14972281 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974876#comment-14974876 ] Zhe Zhang commented on HDFS-9260: - Quick note: the patches are all named after HDFS-7435 >

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975040#comment-14975040 ] Zhe Zhang commented on HDFS-9260: - Thanks for the great work Staffan. The only change rela

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975042#comment-14975042 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975804#comment-14975804 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14977515#comment-14977515 ] Hadoop QA commented on HDFS-9260: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981442#comment-14981442 ] Staffan Friberg commented on HDFS-9260: --- I have been running through the other failed

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985524#comment-14985524 ] Daryn Sharp commented on HDFS-9260: --- I'll try to review the patch today. Only skimmed co

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986062#comment-14986062 ] Staffan Friberg commented on HDFS-9260: --- Hi Daryn, Thanks for taking a look at the p

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990758#comment-14990758 ] Staffan Friberg commented on HDFS-9260: --- Hi Daryn, Thanks for the comments and the a