skyfeng created KYLIN-5160:
------------------------------
Summary: kylin4无法连接AWS Glue元数据存储
Key: KYLIN-5160
URL: https://issues.apache.org/jira/browse/KYLIN-5160
Project: Kylin
Issue Type: New Feature
Components: Metadata
Reporter: skyfeng
在AWS EMR5.33版本中，连接AWS Glue时，报无法连接错误，在kylin3中使用是ok的。信息如下：
2021-11-23 02:35:05,254 ERROR [pool-5-thread-1] metadata.Hive : Unable to
instantiate a metastore client factory
com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory due
to: java.lang.ClassNotFoundException: Class
com.amazonaws.glue.catalog.metastore .AWSGlueDataCatalogHiveClientFactory not
found java.lang.ClassNotFoundException: Class
com.amazonaws.glue.catalog.metastore.AWSGlueDataCatalogHiveClientFactory not
found at
org.apache.hadoop.conf.Configuration.getClassByName([Configuration.java:2273
|http://configuration.java:2273/]) at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClientFactory([Hive.java:3015
|http://hive.java:3015/]) at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient([Hive.java:3006
|http://hive.java:3006/])
另一个日志如下：
2021-11-25 07:07:57,025 ERROR [http-bio-7070-exec-5]
controller.TableController:200 : Unable to create M etaStoreClient for
gluecatalog java.lang.IllegalStateException: Unable to create MetaStoreClient
for gluecatalog at
org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC
[lientFactory.java:55 |http://lientfactory.java:55/]) at
org.apache.kylin.source.hive.CLIHiveClient.getMetaStoreClient([CLIHiveClient.java:164
|http://clihiveclient.java:164/]) at
org.apache.kylin.source.hive.CLIHiveClient.getHiveDbNames([CLIHiveClient.java:118
|http://clihiveclient.java:118/]) at
org.apache.kylin.source.hive.HiveMetadataExplorer.listDatabases([HiveMetadataExplorer.java:51
|http://hivemetadataexplorer.java:51/]) at
org.apache.kylin.rest.service.TableService.getSourceDbNames([TableService.java:274
|http://tableservice.java:274/]) at
org.apache.kylin.rest.controller.TableController.showHiveDatabases([TableController.java:198
|http://tablecontroller.java:198/]) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62
|http://nativemethodaccessorimpl.java:62/]) at
sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43
|http://delegatingmethodaccessorimpl.java:43/]) at
java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at
org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod
.java:205) at
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandl
[erMethod.java:133 |http://ermethod.java:133/]) at
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAnd
Handle([ServletInvocableHandlerMethod.java:97
|http://servletinvocablehandlermethod.java:97/]) at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHand
lerMethod([RequestMappingHandlerAdapter.java:854
|http://requestmappinghandleradapter.java:854/]) at
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInte
rnal([RequestMappingHandlerAdapter.java:765
|http://requestmappinghandleradapter.java:765/]) at
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandle
[rMethodAdapter.java:85 |http://rmethodadapter.java:85/]) at
org.springframework.web.servlet.DispatcherServlet.doDispatch([DispatcherServlet.java:967
|http://dispatcherservlet.java:967/]) at
org.springframework.web.servlet.DispatcherServlet.doService([DispatcherServlet.java:901
|http://dispatcherservlet.java:901/]) at
org.springframework.web.servlet.FrameworkServlet.processRequest([FrameworkServlet.java:970
|http://frameworkservlet.java:970/]) at
org.springframework.web.servlet.FrameworkServlet.doGet([FrameworkServlet.java:861
|http://frameworkservlet.java:861/]) at
javax.servlet.http.HttpServlet.service([HttpServlet.java:621
|http://httpservlet.java:621/]) at
org.springframework.web.servlet.FrameworkServlet.service([FrameworkServlet.java:846
|http://frameworkservlet.java:846/]) at
javax.servlet.http.HttpServlet.service([HttpServlet.java:728
|http://httpservlet.java:728/]) at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter([ApplicationFilterChain.java
|http://applicationfilterchain.java/]: 303) ..... at
[org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run
|http://org.apache.tomcat.util.net.jioendpoint%24socketprocessor.run/]([JIoEndpoint.java:317
|http://jioendpoint.java:317/]) at
java.util.concurrent.ThreadPoolExecutor.runWorker([ThreadPoolExecutor.java:1149
|http://threadpoolexecutor.java:1149/]) at
[java.util.concurrent.ThreadPoolExecutor$Worker.run
|http://java.util.concurrent.threadpoolexecutor%24worker.run/]([ThreadPoolExecutor.java:624
|http://threadpoolexecutor.java:624/]) at
[org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run
|http://org.apache.tomcat.util.threads.taskthread%24wrappingrunnable.run/]([TaskThread.java:61
|http://taskthread.java:61/]) at [java.lang.Thread.run
|http://java.lang.thread.run/]([Thread.java:748 |http://thread.java:748/])
Caused by: java.lang.reflect.InvocationTargetException at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke([NativeMethodAccessorImpl.java:62
|http://nativemethodaccessorimpl.java:62/]) at
sun.reflect.DelegatingMethodAccessorImpl.invoke([DelegatingMethodAccessorImpl.java:43
|http://delegatingmethodaccessorimpl.java:43/]) at
java.lang.reflect.Method.invoke([Method.java:498 |http://method.java:498/]) at
org.apache.kylin.source.hive.HiveMetaStoreClientFactory.getHiveMetaStoreClient(HiveMetaStoreC
[lientFactory.java:53 |http://lientfactory.java:53/]) ... 81 more Caused by:
com.google.common.util.concurrent.ExecutionError: java.lang.NoSuchFieldError:
INSTANCE at
com.google.common.cache.LocalCache$Segment.get([LocalCache.java:2261
|http://localcache.java:2261/]) at
com.google.common.cache.LocalCache.get([LocalCache.java:4000
|http://localcache.java:4000/]) at
com.google.common.cache.LocalCache$LocalManualCache.get([LocalCache.java:4789
|http://localcache.java:4789/]) at
org.apache.hive.hcatalog.common.HiveClientCache.getOrCreate([HiveClientCache.java:316
|http://hiveclientcache.java:316/]) at
org.apache.hive.hcatalog.common.HiveClientCache.get([HiveClientCache.java:278
|http://hiveclientcache.java:278/]) at
org.apache.hive.hcatalog.common.HCatUtil.getHiveMetastoreClient([HCatUtil.java:558
|http://hcatutil.java:558/]) ... 86 more Caused by:
java.lang.NoSuchFieldError: INSTANCE at
org.apache.http.conn.ssl.SSLConnectionSocketFactory.<clinit>([SSLConnectionSocketFactory.java
|http://sslconnectionsocketfactory.java/]: 151) at
com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.getPreferredSocketFactor
y([ApacheConnectionManagerFactory.java:89
|http://apacheconnectionmanagerfactory.java:89/]) at
com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM
[anagerFactory.java:66 |http://anagerfactory.java:66/]) at
com.amazonaws.http.apache.client.impl.ApacheConnectionManagerFactory.create(ApacheConnectionM
[anagerFactory.java:59 |http://anagerfactory.java:59/]) at
com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory.
java:50) at
com.amazonaws.http.apache.client.impl.ApacheHttpClientFactory.create(ApacheHttpClientFactory.
java:38)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
