[jira] [Commented] (HBASE-26421) Use HFileLink file to replace entire file‘s reference when splitting
[ https://issues.apache.org/jira/browse/HBASE-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17613084#comment-17613084 ] Huaxiang Sun commented on HBASE-26421: -- Forward comments from review board here for better background of this jira. h3. *[Apache9|https://github.com/Apache9]* commented [on Nov 8, 2021|https://github.com/apache/hbase/pull/3825#issuecomment-963696081] |What is the advantage here to use HFileLink?| [!https://avatars.githubusercontent.com/u/10123703?s=80&u=6be309b7250884321e34ad1fad94072c3ddea60f&v=4|width=40,height=40!|https://github.com/sunhelly] ContributorAuthor h3. *[sunhelly|https://github.com/sunhelly]* commented [on Nov 8, 2021|https://github.com/apache/hbase/pull/3825#issuecomment-963870288] |Thanks, [@Apache9|https://github.com/Apache9] . The main advantage here is that the first compaction after split can be a minor compaction instead of old major compaction, because only reference files should be compacted before the next split. In HBASE-26422, I described the compaction after splitting using HFileLink. It also makes move hfiles between regions of the same table possible. Then the compaction is light weight, since it need not to read and rewrite the referred files.| [!https://avatars.githubusercontent.com/u/4958168?s=80&u=fc28b222c03c02201d705b025a5293d6c471f7b3&v=4|width=40,height=40!|https://github.com/Apache9] Contributor h3. *[Apache9|https://github.com/Apache9]* commented [on Nov 9, 2021|https://github.com/apache/hbase/pull/3825#issuecomment-964161491] |OK, and we do not need to use HalfStoreFileReader to read the HFile right? Sound like a good general improvement. I think this could be done on master and other active branches, not only on a feature branch. Will take a look at the PR soon.| > Use HFileLink file to replace entire file‘s reference when splitting > > > Key: HBASE-26421 > URL: https://issues.apache.org/jira/browse/HBASE-26421 > Project: HBase > Issue Type: Improvement >Reporter: Xiaolin Ha >Assignee: Xiaolin Ha >Priority: Major > Fix For: 2.5.0, 3.0.0-alpha-2 > > > ++When splitting store files, if a file should be owned by only one child > region, then there will be an entire file's reference in the child region. We > can use HFileLink files, just like those in snapshot tables, to replace the > reference files that refer to entire files. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-26421) Use HFileLink file to replace entire file‘s reference when splitting
[
https://issues.apache.org/jira/browse/HBASE-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446624#comment-17446624
]
Hudson commented on HBASE-26421:
Results for branch branch-2
[build #396 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/396/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/396/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/396/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/396/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2/396/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Use HFileLink file to replace entire file‘s reference when splitting
>
>
> Key: HBASE-26421
> URL: https://issues.apache.org/jira/browse/HBASE-26421
> Project: HBase
> Issue Type: Improvement
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> ++When splitting store files, if a file should be owned by only one child
> region, then there will be an entire file's reference in the child region. We
> can use HFileLink files, just like those in snapshot tables, to replace the
> reference files that refer to entire files.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26421) Use HFileLink file to replace entire file‘s reference when splitting
[
https://issues.apache.org/jira/browse/HBASE-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446491#comment-17446491
]
Hudson commented on HBASE-26421:
Results for branch master
[build #446 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/446/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/446/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/446/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/446/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Use HFileLink file to replace entire file‘s reference when splitting
>
>
> Key: HBASE-26421
> URL: https://issues.apache.org/jira/browse/HBASE-26421
> Project: HBase
> Issue Type: Improvement
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> ++When splitting store files, if a file should be owned by only one child
> region, then there will be an entire file's reference in the child region. We
> can use HFileLink files, just like those in snapshot tables, to replace the
> reference files that refer to entire files.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
[jira] [Commented] (HBASE-26421) Use HFileLink file to replace entire file‘s reference when splitting
[
https://issues.apache.org/jira/browse/HBASE-26421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446265#comment-17446265
]
Hudson commented on HBASE-26421:
Results for branch branch-2.4
[build #241 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/241/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/241/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/241/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/241/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.4/241/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Use HFileLink file to replace entire file‘s reference when splitting
>
>
> Key: HBASE-26421
> URL: https://issues.apache.org/jira/browse/HBASE-26421
> Project: HBase
> Issue Type: Sub-task
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> ++When splitting store files, if a file should be owned by only one child
> region, then there will be an entire file's reference in the child region. We
> can use HFileLink files, just like those in snapshot tables, to replace the
> reference files that refer to entire files.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
