kangkaisen created KYLIN-2647:
---------------------------------
Summary: Should get FileSystem from HBaseConfiguration in
HBaseResourceStore
Key: KYLIN-2647
URL: https://issues.apache.org/jira/browse/KYLIN-2647
Project: Kylin
Issue Type: Bug
Components: Metadata
Affects Versions: v2.0.0
Reporter: kangkaisen
Assignee: kangkaisen
Priority: Critical
KYLIN-2351 introduced a bug if User use Standalone HBase Cluster.
{code:java}
Error while executing SQL "SELECT SUM(revenue) AS revenue, SUM(profit) AS
profit, SUM(repay_profit) AS repayProfit, SUM(fraud_profit) AS fraudProfit,
SUM(share_profit) AS shareProfit, SUM(consume) AS consume, SUM(repay_consume)
AS repayConsume, SUM(fraud_consume) AS fraudConsume, SUM(share_consume) AS
shareConsume, SUM(cost) AS cost, SUM(fraud_cost) AS fraudCost, SUM(repay_cost)
AS repayCost, poi_cate2_id AS poiCategory2Id, poi_cate2_name AS
poiCategory2Name, main_poi_id AS orgId, main_poi_name AS orgName,
COUNT(DISTINCT NEW_OBJECT) AS newDeal, COUNT(DISTINCT ONLINE_OBJECT) AS
onlineDeal, partition_date AS dateStr FROM mart_catering.app_shu_v5_trade_view
WHERE (bd_id = 2084324 AND c_platform IN ('mt', 'dp') AND partition_date =
'2017-05-24') GROUP BY poi_cate2_id, poi_cate2_name, partition_date,
main_poi_id, main_poi_name LIMIT 50000": java.io.FileNotFoundException: File
does not exist:
/user/kylin2x/prod/kylin2x_metadata_prod/resources/dict/MART_CATERING.APP_SHU_V5_TRADE_VIEW/C_OBJECT_ID/854df823-abc8-4e19-9035-def12f8af3e2.dict
at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1850)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1821)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1729)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:589)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)
at
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at
org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:415) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:299)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:793)
at
org.apache.kylin.storage.hbase.HBaseResourceStore.getInputStream(HBaseResourceStore.java:206)
at
org.apache.kylin.storage.hbase.HBaseResourceStore.getResourceImpl(HBaseResourceStore.java:226)
at
org.apache.kylin.common.persistence.ResourceStore.getResource(ResourceStore.java:148)
at
org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:448)
at
org.apache.kylin.dict.DictionaryManager$1.load(DictionaryManager.java:105)
at
org.apache.kylin.dict.DictionaryManager$1.load(DictionaryManager.java:102)
at
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
at
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
at
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257)
at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004)
at
com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874)
at
org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:122)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
