[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828400#comment-17828400 ] Bryan Beaudreault commented on HBASE-26263: --- Replaced 2.6.0 fixVersion with 2.5.0, since it first landed there. > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > Fix For: 2.5.0, 3.0.0-alpha-3 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[
https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17512905#comment-17512905
]
Hudson commented on HBASE-26263:
Results for branch branch-2.5
[build #78 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
-- Something went wrong with this stage, [check relevant console
output|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2.5/78//console].
> [Rolling Upgrading] Persist the StoreFileTracker configurations to
> TableDescriptor for existing tables
> --
>
> Key: HBASE-26263
> URL: https://issues.apache.org/jira/browse/HBASE-26263
> Project: HBase
> Issue Type: Sub-task
> Components: HFile, master
>Reporter: Duo Zhang
>Assignee: Zhuoyue Huang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-3
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[
https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17468989#comment-17468989
]
Hudson commented on HBASE-26263:
Results for branch branch-2
[build #434 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/434/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/434/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/434/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/434/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/434/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Rolling Upgrading] Persist the StoreFileTracker configurations to
> TableDescriptor for existing tables
> --
>
> Key: HBASE-26263
> URL: https://issues.apache.org/jira/browse/HBASE-26263
> Project: HBase
> Issue Type: Sub-task
> Components: HFile, master
>Reporter: Duo Zhang
>Assignee: Zhuoyue Huang
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-3
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[
https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464602#comment-17464602
]
Hudson commented on HBASE-26263:
Results for branch master
[build #475 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/475/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/475/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/475/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/475/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> [Rolling Upgrading] Persist the StoreFileTracker configurations to
> TableDescriptor for existing tables
> --
>
> Key: HBASE-26263
> URL: https://issues.apache.org/jira/browse/HBASE-26263
> Project: HBase
> Issue Type: Sub-task
> Components: HFile, master
>Reporter: Duo Zhang
>Assignee: Zhuoyue Huang
>Priority: Major
> Fix For: HBASE-26067
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17447503#comment-17447503 ] Wellington Chevreuil commented on HBASE-26263: -- I was trying to backport some of the commits in this branch to our internal, branch-2 based one, and noticed this PR relies on a few commits that are only in master (HBASE-26348, HBASE-22662). Are there no plans to support those on any hbase-2 branches? > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > Fix For: HBASE-26067 > > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420457#comment-17420457 ] Duo Zhang commented on HBASE-26263: --- Yes, exactly~ > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17420455#comment-17420455 ] Zhuoyue Huang commented on HBASE-26263: --- Ok, I got it. We can update table's TableDescriptor directly on master side. For the regions on the existing regionserver, since SFT implementation of table has not been changed, there will be no problem. > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17419131#comment-17419131 ] Zhuoyue Huang commented on HBASE-26263: --- HBASE-26246 set the SFT configurations to the TableDescriptor to avoid misconfiguration. If I understand correctly, we need a background thread to update those tables that already exist but have not update the TableDescriptor to the latest SFT configuration. If we do not use ModifyTableProcedure , how can we keep the tableDescriptor on the region server side consistent with that on the master? As far as I know, region server side should reopen regions to update its tableDescriptor, which would trigger during ModifyTableProcedure processing if a table already exists. Looking forward to your answer [~zhangduo] > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17419132#comment-17419132 ] Zhuoyue Huang commented on HBASE-26263: --- HBASE-26246 set the SFT configurations to the TableDescriptor to avoid misconfiguration. If I understand correctly, we need a background thread to update those tables that already exist but have not update the TableDescriptor to the latest SFT configuration. If we do not use ModifyTableProcedure , how can we keep the tableDescriptor on the region server side consistent with that on the master? As far as I know, region server side should reopen regions to update its tableDescriptor, which would trigger during ModifyTableProcedure processing if a table already exists. Looking forward to your answer [~zhangduo] > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Assignee: Zhuoyue Huang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-26263) [Rolling Upgrading] Persist the StoreFileTracker configurations to TableDescriptor for existing tables
[ https://issues.apache.org/jira/browse/HBASE-26263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414997#comment-17414997 ] Duo Zhang commented on HBASE-26263: --- For this issue, I think we could just schedule a background task to update the TableDescriptor for all tables. And a trick here is that, we do not need to use ModifyTableProcedure, as actually, we haven't changed the store file tracker implementation. > [Rolling Upgrading] Persist the StoreFileTracker configurations to > TableDescriptor for existing tables > -- > > Key: HBASE-26263 > URL: https://issues.apache.org/jira/browse/HBASE-26263 > Project: HBase > Issue Type: Sub-task > Components: HFile, master >Reporter: Duo Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
