[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[ https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729754#comment-16729754 ] Wei-Chiu Chuang commented on HBASE-14939: - Thanks [~ashish singhi] for the review! > Document bulk loaded hfile replication > -- > > Key: HBASE-14939 > URL: https://issues.apache.org/jira/browse/HBASE-14939 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Ashish Singhi >Assignee: Wei-Chiu Chuang >Priority: Major > Fix For: 3.0.0 > > Attachments: HBASE-14939.master.001.patch > > > After HBASE-13153 is committed we need to add that information under the > Cluster Replication section in HBase book. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[
https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729572#comment-16729572
]
Hudson commented on HBASE-14939:
Results for branch master
[build #683 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/683/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/683//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/683//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/683//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Document bulk loaded hfile replication
> --
>
> Key: HBASE-14939
> URL: https://issues.apache.org/jira/browse/HBASE-14939
> Project: HBase
> Issue Type: Task
> Components: documentation
>Reporter: Ashish Singhi
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: HBASE-14939.master.001.patch
>
>
> After HBASE-13153 is committed we need to add that information under the
> Cluster Replication section in HBase book.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[ https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725042#comment-16725042 ] Ashish Singhi commented on HBASE-14939: --- Thanks [~jojochuang]. The patch looks good to me. > Document bulk loaded hfile replication > -- > > Key: HBASE-14939 > URL: https://issues.apache.org/jira/browse/HBASE-14939 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Ashish Singhi >Assignee: Wei-Chiu Chuang >Priority: Major > Attachments: HBASE-14939.master.001.patch > > > After HBASE-13153 is committed we need to add that information under the > Cluster Replication section in HBase book. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[
https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724483#comment-16724483
]
Hadoop QA commented on HBASE-14939:
---
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
16s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
22s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 4m
58s{color} | {color:blue} branch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:blue}0{color} | {color:blue} refguide {color} | {color:blue} 4m
54s{color} | {color:blue} patch has no errors when building the reference
guide. See footer for rendered docs, which you should manually inspect. {color}
|
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
15s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 19m 1s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-14939 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12952244/HBASE-14939.master.001.patch
|
| Optional Tests | dupname asflicense refguide |
| uname | Linux 70732a00d2d1 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / c448604ceb |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| refguide |
https://builds.apache.org/job/PreCommit-HBASE-Build/15321/artifact/patchprocess/branch-site/book.html
|
| refguide |
https://builds.apache.org/job/PreCommit-HBASE-Build/15321/artifact/patchprocess/patch-site/book.html
|
| Max. process+thread count | 97 (vs. ulimit of 1) |
| modules | C: . U: . |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/15321/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Document bulk loaded hfile replication
> --
>
> Key: HBASE-14939
> URL: https://issues.apache.org/jira/browse/HBASE-14939
> Project: HBase
> Issue Type: Task
> Components: documentation
>Reporter: Ashish Singhi
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Attachments: HBASE-14939.master.001.patch
>
>
> After HBASE-13153 is committed we need to add that information under the
> Cluster Replication section in HBase book.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[
https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724475#comment-16724475
]
Wei-Chiu Chuang commented on HBASE-14939:
-
h3. 73.5. Bulk Loading Replication
HBASE-13153 adds replication support for bulk loaded HFiles, available since
HBase 1.3/2.0. This feature is enabled by setting
{{hbase.replication.bulkload.enabled}} to {{true}} (default is {{false}}). You
also need to copy the source cluster configuration files to the destination
cluster.
Additional configurations are required too:
# {{hbase.replication.source.fs.conf.provider}}
This defines the class which loads the source cluster file system client
configuration in the destination cluster. This should be configured for all the
RS in the destination cluster. Default is
{{org.apache.hadoop.hbase.replication.regionserver.DefaultSourceFSConfigurationProvider}}.
# {{hbase.replication.conf.dir}}
This represents the base directory where the file system client configurations
of the source cluster are copied to the destination cluster. This should be
configured for all the RS in the destination cluster. Default is
{{$HBASE_CONF_DIR}}.
# {{hbase.replication.cluster.id}}
This configuration is required in the cluster where replication for bulk loaded
data is enabled. A source cluster is uniquely identified by the destination
cluster using this id. This should be configured for all the RS in the source
cluster configuration file for all the RS.
For example: If source cluster FS client configurations are copied to the
destination cluster under directory {{/home/user/dc1/}}, then
{{hbase.replication.cluster.id}} should be configured as {{dc1}} and
{{hbase.replication.conf.dir}} as {{/home/user}}.
| |{{DefaultSourceFSConfigurationProvider}} supports only {{xml}} type files.
It loads source cluster FS client configuration only once, so if source cluster
FS client configuration files are updated, every peer(s) cluster RS must be
restarted to reload the configuration.|
> Document bulk loaded hfile replication
> --
>
> Key: HBASE-14939
> URL: https://issues.apache.org/jira/browse/HBASE-14939
> Project: HBase
> Issue Type: Task
> Components: documentation
>Reporter: Ashish Singhi
>Assignee: Wei-Chiu Chuang
>Priority: Major
> Attachments: HBASE-14939.master.001.patch
>
>
> After HBASE-13153 is committed we need to add that information under the
> Cluster Replication section in HBase book.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[ https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720091#comment-16720091 ] Wei-Chiu Chuang commented on HBASE-14939: - Back to this -- I was blocked by HBASE-21001. Now that it is resolved I can continue on this one. > Document bulk loaded hfile replication > -- > > Key: HBASE-14939 > URL: https://issues.apache.org/jira/browse/HBASE-14939 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Ashish Singhi >Assignee: Wei-Chiu Chuang >Priority: Major > > After HBASE-13153 is committed we need to add that information under the > Cluster Replication section in HBase book. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-14939) Document bulk loaded hfile replication
[ https://issues.apache.org/jira/browse/HBASE-14939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565367#comment-16565367 ] Wei-Chiu Chuang commented on HBASE-14939: - Assign to me. I have a doc patch ready for review. > Document bulk loaded hfile replication > -- > > Key: HBASE-14939 > URL: https://issues.apache.org/jira/browse/HBASE-14939 > Project: HBase > Issue Type: Task > Components: documentation >Reporter: Ashish Singhi >Assignee: Wei-Chiu Chuang >Priority: Major > > After HBASE-13153 is committed we need to add that information under the > Cluster Replication section in HBase book. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
