[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824040#comment-16824040
]
Hudson commented on HBASE-21445:
Results for branch master
[build #954 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/954/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/954//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/954//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/954//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682724#comment-16682724 ] Zheng Hu commented on HBASE-21445: -- Got it, Thanks [~stack] . > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682555#comment-16682555 ] stack commented on HBASE-21445: --- +1 on the patch. In future, consider leaving out reformatting changes like those in this patch... They seem arbitrary... and bulk up what could have been a two liner. Otherwise, very nice patch. Thanks [~openinx] > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682394#comment-16682394
]
Hudson commented on HBASE-21445:
Results for branch master
[build #596 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/596/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/596//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/596//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/596//JDK8_Nightly_Build_Report_(Hadoop3)/]
(x) {color:red}-1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
-- Something went wrong with this stage, [check relevant console
output|https://builds.apache.org/job/HBase%20Nightly/job/master/596//console].
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682361#comment-16682361
]
Hudson commented on HBASE-21445:
Results for branch branch-2.1
[build #593 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/593/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/593//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/593//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/593//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682356#comment-16682356
]
Hudson commented on HBASE-21445:
Results for branch branch-2.0
[build #1072 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1072/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1072//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1072//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1072//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682351#comment-16682351
]
Hudson commented on HBASE-21445:
Results for branch branch-2
[build #1494 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1494/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1494//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1494//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1494//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682349#comment-16682349
]
Hudson commented on HBASE-21445:
Results for branch branch-1.4
[build #543 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/543/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/543//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/543//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.4/543//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682320#comment-16682320
]
Hudson commented on HBASE-21445:
Results for branch branch-1.3
[build #536 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.3/536/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.3/536//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.3/536//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.3/536//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682307#comment-16682307
]
Hudson commented on HBASE-21445:
Results for branch branch-1
[build #546 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/546/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(x) {color:red}-1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/546//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/546//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1/546//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 source release artifact{color}
-- See build output for details.
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682306#comment-16682306
]
Hudson commented on HBASE-21445:
Results for branch branch-1.2
[build #545 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.2/545/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.2/545//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk7 checks{color}
-- For more information [see jdk7
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.2/545//JDK7_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-1.2/545//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> CopyTable by bulkload will write hfile into yarn's HDFS
>
>
> Key: HBASE-21445
> URL: https://issues.apache.org/jira/browse/HBASE-21445
> Project: HBase
> Issue Type: Bug
> Components: mapreduce
>Reporter: Zheng Hu
>Assignee: Zheng Hu
>Priority: Major
> Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9
>
> Attachments: HBASE-21445.v1.patch
>
>
> When using CopyTable with bulkload, I found that all hfile's are written in
> our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster,
> because we use different HDFS between yarn cluster and hbase cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682165#comment-16682165 ] Hudson commented on HBASE-21445: SUCCESS: Integrated in Jenkins build HBase-1.3-IT #502 (See [https://builds.apache.org/job/HBase-1.3-IT/502/]) HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS (openinx: rev f94b81a2db64b6fd7b40db680ea8834a5401ed22) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/CopyTable.java > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682162#comment-16682162 ] Hudson commented on HBASE-21445: SUCCESS: Integrated in Jenkins build HBase-1.2-IT #1180 (See [https://builds.apache.org/job/HBase-1.2-IT/1180/]) HBASE-21445 CopyTable by bulkload will write hfile into yarn's HDFS (openinx: rev d5fb0a58502e9880d9d2f8558bd8062f4fe79c37) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/CopyTable.java > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682158#comment-16682158 ] Zheng Hu commented on HBASE-21445: -- Pushed to all branches, Thanks [~zghaobac] for reviewing. > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2, 1.2.9 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680928#comment-16680928 ] Guanghao Zhang commented on HBASE-21445: +1 > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680739#comment-16680739 ] Zheng Hu commented on HBASE-21445: -- [~zghaobac], [~Apache9] , PTAL. > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[
https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677664#comment-16677664
]
Hadoop QA commented on HBASE-21445:
---
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
9s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:orange}-0{color} | {color:orange} test4tests {color} | {color:orange}
0m 0s{color} | {color:orange} The patch doesn't appear to include any new or
modified tests. Please justify why no new tests are needed for this patch. Also
please list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
5s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
31s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
18s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
18s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
39s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
15s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 5m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
32s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
17s{color} | {color:green} hbase-mapreduce: The patch generated 0 new + 13
unchanged - 1 fixed = 13 total (was 14) {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
46s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
11m 59s{color} | {color:green} Patch does not cause any errors with Hadoop
2.7.4 or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
17s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 20m
20s{color} | {color:green} hbase-mapreduce in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
14s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 56m 17s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21445 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12947170/HBASE-21445.v1.patch |
| Optional Tests | dupname asflicense javac javadoc unit findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 2047739a6b86 3.13.0-139-generic #188-Ubuntu SMP Tue Jan 9
14:43:09 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build@2/component/dev-support/hbase-personality.sh
|
| git revision | master / 86cbbdea9e |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC3 |
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/14974/testReport/ |
| Max. process+thread count | 5011 (vs. ulimit of 1) |
| modules | C: hbase-mapreduce U: hbase-mapreduce |
|
[jira] [Commented] (HBASE-21445) CopyTable by bulkload will write hfile into yarn's HDFS
[ https://issues.apache.org/jira/browse/HBASE-21445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677620#comment-16677620 ] Zheng Hu commented on HBASE-21445: -- Patch is quite simple, Just use the HBase's filesystem instead of the default file system when operating the bulk load's relative path. because when CopyTable, we'll move the yarn's conf files into hbase conf directory, the hbase's defaultFs will may be overrided by yarn's defaultFs. > CopyTable by bulkload will write hfile into yarn's HDFS > > > Key: HBASE-21445 > URL: https://issues.apache.org/jira/browse/HBASE-21445 > Project: HBase > Issue Type: Bug > Components: mapreduce >Reporter: Zheng Hu >Assignee: Zheng Hu >Priority: Major > Fix For: 1.5.0, 1.3.3, 2.2.0, 2.0.3, 1.4.9, 2.1.2 > > Attachments: HBASE-21445.v1.patch > > > When using CopyTable with bulkload, I found that all hfile's are written in > our Yarn's HDFS cluster. and failed to load hfiles into HBase cluster, > because we use different HDFS between yarn cluster and hbase cluster. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
