[
https://issues.apache.org/jira/browse/KYLIN-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041157#comment-17041157
]
Tian Shi commented on KYLIN-4383:
---------------------------------
The error message showed in kylin.out:
---
Caused by: java.lang.IllegalStateException: Unable to create MetaStoreClient
for gluecatalog
at
org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreClientFactory.java:55)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:164)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:118)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:51)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:286)
~[kylin-server-base-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196)
~[kylin-server-base-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
... 76 more
Caused by: java.lang.NoSuchMethodException:
org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient()
at java.lang.Class.getDeclaredMethod(Class.java:2130) ~[?:1.8.0_242]
at
org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreClientFactory.java:52)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient(CLIHiveClient.java:164)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames(CLIHiveClient.java:118)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases(HiveMetadataExplorer.java:51)
~[kylin-source-hive-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:286)
~[kylin-server-base-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
at
org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:196)
~[kylin-server-base-3.1.0-SNAPSHOT.jar:3.1.0-SNAPSHOT]
... 76 more
---
It turns out 52 line in
"source-hive/src/main/java/org/apache/kylin/source/hive/HiveMetaStoreClientFactory.java"
is
---
Method getHiveMetastoreClientMethod =
clazz.getDeclaredMethod("getHiveMetastoreClient");
---
The methed getHiveMetastoreClient should have parameter hiveconf, and the code
should be:
---
Method getHiveMetastoreClientMethod =
clazz.getDeclaredMethod("getHiveMetastoreClient",
{color:#FF0000}HiveConf.class{color});
---
After another complile, the integration with AWS Glue works well.
P.S. Excuse me not have too much experience in GitHub and Jira... Thanks.
> Kylin Integrated Issue with Amazon EMR and AWS Glue in
> HiveMetaStoreClientFactory.java
> --------------------------------------------------------------------------------------
>
> Key: KYLIN-4383
> URL: https://issues.apache.org/jira/browse/KYLIN-4383
> Project: Kylin
> Issue Type: Bug
> Components: Integration
> Affects Versions: v3.0.0
> Environment: Amazon EMR 5.29.0 + AWS Glue
> Reporter: Tian Shi
> Priority: Blocker
> Labels: AWS, easyfix
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> Following the official docs with [link Install Kylin on AWS
> EMR|http://kylin.apache.org/docs31/install/kylin_aws_emr.html], when choosing
> AWS Glue as Hive metastore, it does not take effect with the configuration
> "kylin.source.hive.metadata-type=gluecatalog".
> Then I clone the master branch and compile Kylin from the source code
> (3.1.0-SNAPSHOT) and deploy it on EMR with Glue, when "Load table from the
> tree", I encountered with error "cannot create metastore client gluecatalog".
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
