[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744135#comment-16744135 ] Liu Shaohui commented on KYLIN-3613: + 1 for encountering the same problem. Thanks for fixing it~ > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683459#comment-16683459 ] Jacky Woo commented on KYLIN-3613: -- There is the issue [KYLIN-3675|https://issues.apache.org/jira/browse/KYLIN-3675] > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683458#comment-16683458 ] Jacky Woo commented on KYLIN-3613: -- Hi, I also met the same problem. I add some logs and found kylin use wrong hdfs when deploying coprocessor. But According the logic of "HBaseConnection.java", all values of "configThreadLocal" come from "newHBaseConfiguration" method, and "newHBaseConfiguration" method produces configuration with right hdfs. What I wandering is why "HBaseConnection.getCurrentHBaseConfiguration" method get a configuration with wrong hdfs sometimes. > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663291#comment-16663291 ] Shaofeng SHI commented on KYLIN-3613: - Also merged in 2.4.x and 2.5.x branch; > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663287#comment-16663287 ] ASF subversion and git services commented on KYLIN-3613: Commit 5c107865db8e46de9e5a4ef61ac4aa1f0e3c476c in kylin's branch refs/heads/2.4.x from wangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5c10786 ] KYLIN-3613, UnknownHostException at 'Create HTable' step when use standalone hbase cluster > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663284#comment-16663284 ] Shaofeng SHI commented on KYLIN-3613: - It looks good; Merged in master; Thank you wangsheng! > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663283#comment-16663283 ] ASF subversion and git services commented on KYLIN-3613: Commit 2fd01c3f888c14cf484dbcb26bcb365d95cdca15 in kylin's branch refs/heads/master from wangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2fd01c3 ] KYLIN-3613, UnknownHostException at 'Create HTable' step when use standalone hbase cluster > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663101#comment-16663101 ] WangSheng commented on KYLIN-3613: -- [~Shaofengshi] I've already validate this patch in my cluster, please check it, thanks~ > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: KYLIN-3613.patch, Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662147#comment-16662147 ] jiahua.hu commented on KYLIN-3613: -- i checkout kylin,and modify HBaseConnection.java as [~skyyws] said. then compile HBaseConnection.java to class file. lastest replace HBaseConnection.class、HBaseConnection$1.class、HBaseConnection$2.class in /apache-kylin-2.5.0-bin-hbase1x/tomcat/webapps/kylin/WEB-INF/lib/kylin-storage-hbase-2.5.0.jar. then it work well. > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662055#comment-16662055 ] jiahua.hu commented on KYLIN-3613: -- thanks [~Shaofengshi] and [~skyyws] > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662053#comment-16662053 ] WangSheng commented on KYLIN-3613: -- Thanks for [~Shaofengshi], I will upload a patch later~ > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0, v2.4.1, v2.5.0 >Reporter: powerinf >Assignee: WangSheng >Priority: Major > Fix For: v2.4.2, v2.5.1 > > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[
https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662020#comment-16662020
]
WangSheng commented on KYLIN-3613:
--
By the way, remove configThreadLocal may work:
{code:java}
// HBaseConnection.java
public static Configuration getCurrentHBaseConfiguration() {
StorageURL storageUrl =
KylinConfig.getInstanceFromEnv().getStorageUrl();
return newHBaseConfiguration(storageUrl);
}
{code}
> Kylin with Standalone HBase Cluster (enabled kerberos) could not find the
> main cluster namespace at "Create HTable" step
> -
>
> Key: KYLIN-3613
> URL: https://issues.apache.org/jira/browse/KYLIN-3613
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v2.4.0
>Reporter: powerinf
>Priority: Major
> Attachments: Kylin_standalone_hbase.log
>
>
> I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust)
> the main cluster and hbase cluster,Kylin Server can access both clusters
> using hdfs shell with fully qualifiered path ,can submit MR job to main
> cluster, and can use hive shell to access data warehouse
> on Kylin Server, the configurations of hadoop and hive points to main
> cluster,and can access hbase cluster using hbase shell.
> when I build the cube, at "Create HTable" step, it reported the error
> "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to
> false
> at conf or table descriptor if you want to bypass sanity checks",but after I
> restart Kylin serer , resume it can run normally,Why?
> more detail message on Kylin_standalone_hbase.log
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[
https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662015#comment-16662015
]
WangSheng commented on KYLIN-3613:
--
Hi, I met the same problem, I found that when deploy coprocessor, kylin get
wrong hbase conf
{code:java}
// DeployCoprocessorCLI.java
private static void initHTableCoprocessor(HTableDescriptor desc) throws
IOException {
KylinConfig kylinConfig = KylinConfig.getInstanceFromEnv();
// here, hbase conf is not corrent
Configuration hconf = HBaseConnection.getCurrentHBaseConfiguration();
FileSystem fileSystem = FileSystem.get(hconf);
String localCoprocessorJar = kylinConfig.getCoprocessorLocalJar();
Path hdfsCoprocessorJar =
DeployCoprocessorCLI.uploadCoprocessorJar(localCoprocessorJar, fileSystem,
null);
DeployCoprocessorCLI.addCoprocessorOnHTable(desc, hdfsCoprocessorJar);
}
// HBaseConnection.java
public static Configuration getCurrentHBaseConfiguration() {
if (configThreadLocal.get() == null) {
// when restart kylin, here is correct
StorageURL storageUrl =
KylinConfig.getInstanceFromEnv().getStorageUrl();
configThreadLocal.set(newHBaseConfiguration(storageUrl));
}
// after a while, here get wrong config
return configThreadLocal.get();
}
{code}
When restart kylin, configThreadLocal.get().get("fs.defaultFS") is hbase
cluster nameservice, so everything is normal. But after a while,
configThreadLocal.get().get("fs.defaultFS") became kylin local cluster
nameservice, so build error, but I not sure why, still debug..
> Kylin with Standalone HBase Cluster (enabled kerberos) could not find the
> main cluster namespace at "Create HTable" step
> -
>
> Key: KYLIN-3613
> URL: https://issues.apache.org/jira/browse/KYLIN-3613
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v2.4.0
>Reporter: powerinf
>Priority: Major
> Attachments: Kylin_standalone_hbase.log
>
>
> I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust)
> the main cluster and hbase cluster,Kylin Server can access both clusters
> using hdfs shell with fully qualifiered path ,can submit MR job to main
> cluster, and can use hive shell to access data warehouse
> on Kylin Server, the configurations of hadoop and hive points to main
> cluster,and can access hbase cluster using hbase shell.
> when I build the cube, at "Create HTable" step, it reported the error
> "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to
> false
> at conf or table descriptor if you want to bypass sanity checks",but after I
> restart Kylin serer , resume it can run normally,Why?
> more detail message on Kylin_standalone_hbase.log
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658665#comment-16658665 ] powerinf commented on KYLIN-3613: - [~Shaofengshi]，from the describe the hbase table in hbase shell，can you find any problems ？ > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0 >Reporter: powerinf >Priority: Major > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647544#comment-16647544 ] powerinf commented on KYLIN-3613: - I do not understand why After restarted the Kylin server , resume the it ,it can work well ,don 't report this ERROR 。 > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0 >Reporter: powerinf >Priority: Major > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[
https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647539#comment-16647539
]
powerinf commented on KYLIN-3613:
-
[~Shaofengshi]
$ hbase shell
2018-10-12 14:32:00,378 INFO [main] Configuration.deprecation
(Configuration.java:warnOnceIfDeprecated(1174)) - hadoop.native.lib is
deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help' for list of supported commands.
Type "exit" to leave the HBase Shell
Version 1.2.0-cdh5.8.3, rUnknown, Wed Oct 12 20:28:39 PDT 2016
hbase(main):001:0> describe 'kylin_test:KYLIN_test_36XHMDVWGR'
Table kylin_test:KYLIN_test_36XHMDVWGR is ENABLED
kylin_test:KYLIN_test_36XHMDVWGR, {TABLE_ATTRIBUTES => {coprocessor$1 =>
'|org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint|1073741823|',
coprocessor$2 => 'hdfs://
cphbase/user/protravel/kylin_test/kylin_test-kylin_metadata/coprocessor/kylin-coprocessor-2.4.0-0.jar|org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitServic
e|1001|', METADATA => {'CREATION_TIME' => '1537870040616', 'GIT_COMMIT' =>
'b450cc52f976ddafba7c6625d2440670af94332b;', 'KYLIN_HOST' =>
'kylin_test:kylin_metadata', 'OWNER' => '
who...@kylin.apache.org', 'SEGMENT' =>
'city_day_cube[2018080200_20180902235959]', 'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.DisabledRegionSplitPolicy', 'USER'
=> 'ADMIN'}}
COLUMN FAMILIES DESCRIPTION
{NAME => 'F1', DATA_BLOCK_ENCODING => 'FAST_DIFF', BLOOMFILTER => 'NONE',
REPLICATION_SCOPE => '0', VERSIONS => '1', COMPRESSION => 'NONE', MIN_VERSIONS
=> '0', TTL => 'FOREVER'
, KEEP_DELETED_CELLS => 'FALSE', BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}
1 row(s) in 0.7540 seconds
> Kylin with Standalone HBase Cluster (enabled kerberos) could not find the
> main cluster namespace at "Create HTable" step
> -
>
> Key: KYLIN-3613
> URL: https://issues.apache.org/jira/browse/KYLIN-3613
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v2.4.0
>Reporter: powerinf
>Priority: Major
> Attachments: Kylin_standalone_hbase.log
>
>
> I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust)
> the main cluster and hbase cluster,Kylin Server can access both clusters
> using hdfs shell with fully qualifiered path ,can submit MR job to main
> cluster, and can use hive shell to access data warehouse
> on Kylin Server, the configurations of hadoop and hive points to main
> cluster,and can access hbase cluster using hbase shell.
> when I build the cube, at "Create HTable" step, it reported the error
> "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to
> false
> at conf or table descriptor if you want to bypass sanity checks",but after I
> restart Kylin serer , resume it can run normally,Why?
> more detail message on Kylin_standalone_hbase.log
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647535#comment-16647535 ] Shaofeng SHI commented on KYLIN-3613: - [~powerinf] can you describe the hbase table in hbase shell, and paste the full concent? It seems that some main cluster info appeared in the hbase table metadata, making the checking failed. > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0 >Reporter: powerinf >Priority: Major > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647531#comment-16647531 ] powerinf commented on KYLIN-3613: - [~Shaofengshi] "ctyunbigdata" is the main cluster ' s namespace ,I set "kylin.storage.hbase.cluster-fs" in kylin.properties well . It point the hbase cluster hdfs dir ，and is same as the "hbase.rootdir" in hbase-site.xml . when the problem appear，I restart the server，it can work well; but After a while，it reappear again. > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0 >Reporter: powerinf >Priority: Major > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3613) Kylin with Standalone HBase Cluster (enabled kerberos) could not find the main cluster namespace at "Create HTable" step
[ https://issues.apache.org/jira/browse/KYLIN-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16647514#comment-16647514 ] Shaofeng SHI commented on KYLIN-3613: - Hi powerinf, what's the host of "ctyunbigdata", is it the main cluster, or the hbase cluster? Did you configure the "kylin.storage.hbase.cluster-fs" in kylin.properties? > Kylin with Standalone HBase Cluster (enabled kerberos) could not find the > main cluster namespace at "Create HTable" step > - > > Key: KYLIN-3613 > URL: https://issues.apache.org/jira/browse/KYLIN-3613 > Project: Kylin > Issue Type: Bug > Components: Environment >Affects Versions: v2.4.0 >Reporter: powerinf >Priority: Major > Attachments: Kylin_standalone_hbase.log > > > I deployed two hadoop cluster(also enabled kerberos ,with cross-realm trust) > the main cluster and hbase cluster,Kylin Server can access both clusters > using hdfs shell with fully qualifiered path ,can submit MR job to main > cluster, and can use hive shell to access data warehouse > on Kylin Server, the configurations of hadoop and hive points to main > cluster,and can access hbase cluster using hbase shell. > when I build the cube, at "Create HTable" step, it reported the error > "java.net.UnknownHostException: ctyunbigdata Set hbase.table.sanity.checks to > false > at conf or table descriptor if you want to bypass sanity checks",but after I > restart Kylin serer , resume it can run normally,Why? > more detail message on Kylin_standalone_hbase.log -- This message was sent by Atlassian JIRA (v7.6.3#76005)
