[jira] [Commented] (HBASE-24583) Normalizer can't actually merge empty regions when neighbor is larger than average size
[ https://issues.apache.org/jira/browse/HBASE-24583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176964#comment-17176964 ] Hudson commented on HBASE-24583: Results for branch master [build #7 on builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/7/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/7/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/7/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/7/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (x) {color:red}-1 client integration test{color} --Failed when running client tests on top of Hadoop 2. [see log for details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/7//artifact/output-integration/hadoop-2.log]. (note that this means we didn't run on Hadoop 3) > Normalizer can't actually merge empty regions when neighbor is larger than > average size > --- > > Key: HBASE-24583 > URL: https://issues.apache.org/jira/browse/HBASE-24583 > Project: HBase > Issue Type: Bug > Components: master, Normalizer >Affects Versions: 2.3.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.1, 2.4.0 > > > There are plenty of cases where empty regions can accumulate -- incorrect > guessing at split points, old data is automatically expiring off, The > normalizer stubbornly refuses to handle this case, despite this being an > original feature it was intended to support (HBASE-6613). > Earlier discussion had concerns for a user pre-splitting a table and then the > normalizer coming along and merging those splits away before they could be > populated. Thus, right now, the default behavior via > {{hbase.normalizer.merge.min_region_size.mb=1}} is to not split any region > that's so small. Later, we added > {{hbase.normalizer.merge.min_region_age.days=3}}, which prevents us from > merging any region too young. So there's plenty of nobs for an operator to > customize their behavior. > But when I set {{hbase.normalizer.merge.min_region_size.mb=0}}, I still end > up with stubborn regions that won't merge away. Looks like a large neighbor > will prevent a merge from going through. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-24583) Normalizer can't actually merge empty regions when neighbor is larger than average size
[ https://issues.apache.org/jira/browse/HBASE-24583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176880#comment-17176880 ] Hudson commented on HBASE-24583: Results for branch branch-2.3 [build #5 on builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/5/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/5/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/5/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/5/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.3/5/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Normalizer can't actually merge empty regions when neighbor is larger than > average size > --- > > Key: HBASE-24583 > URL: https://issues.apache.org/jira/browse/HBASE-24583 > Project: HBase > Issue Type: Bug > Components: master, Normalizer >Affects Versions: 2.3.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.1, 2.4.0 > > > There are plenty of cases where empty regions can accumulate -- incorrect > guessing at split points, old data is automatically expiring off, The > normalizer stubbornly refuses to handle this case, despite this being an > original feature it was intended to support (HBASE-6613). > Earlier discussion had concerns for a user pre-splitting a table and then the > normalizer coming along and merging those splits away before they could be > populated. Thus, right now, the default behavior via > {{hbase.normalizer.merge.min_region_size.mb=1}} is to not split any region > that's so small. Later, we added > {{hbase.normalizer.merge.min_region_age.days=3}}, which prevents us from > merging any region too young. So there's plenty of nobs for an operator to > customize their behavior. > But when I set {{hbase.normalizer.merge.min_region_size.mb=0}}, I still end > up with stubborn regions that won't merge away. Looks like a large neighbor > will prevent a merge from going through. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-24583) Normalizer can't actually merge empty regions when neighbor is larger than average size
[ https://issues.apache.org/jira/browse/HBASE-24583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17176761#comment-17176761 ] Hudson commented on HBASE-24583: Results for branch branch-2 [build #6 on builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (x) {color:red}-1 client integration test{color} --Failed when running client tests on top of Hadoop 2. [see log for details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/6//artifact/output-integration/hadoop-2.log]. (note that this means we didn't run on Hadoop 3) > Normalizer can't actually merge empty regions when neighbor is larger than > average size > --- > > Key: HBASE-24583 > URL: https://issues.apache.org/jira/browse/HBASE-24583 > Project: HBase > Issue Type: Bug > Components: master, Normalizer >Affects Versions: 2.3.0 >Reporter: Nick Dimiduk >Assignee: Nick Dimiduk >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.1, 2.4.0 > > > There are plenty of cases where empty regions can accumulate -- incorrect > guessing at split points, old data is automatically expiring off, The > normalizer stubbornly refuses to handle this case, despite this being an > original feature it was intended to support (HBASE-6613). > Earlier discussion had concerns for a user pre-splitting a table and then the > normalizer coming along and merging those splits away before they could be > populated. Thus, right now, the default behavior via > {{hbase.normalizer.merge.min_region_size.mb=1}} is to not split any region > that's so small. Later, we added > {{hbase.normalizer.merge.min_region_age.days=3}}, which prevents us from > merging any region too young. So there's plenty of nobs for an operator to > customize their behavior. > But when I set {{hbase.normalizer.merge.min_region_size.mb=0}}, I still end > up with stubborn regions that won't merge away. Looks like a large neighbor > will prevent a merge from going through. -- This message was sent by Atlassian Jira (v8.3.4#803005)