dcswinner created KYLIN-1784:
--------------------------------
Summary: When Kylin Load HFile to HBase Table,the Hfiles have
incorrect permission
Key: KYLIN-1784
URL: https://issues.apache.org/jira/browse/KYLIN-1784
Project: Kylin
Issue Type: Bug
Components: Job Engine
Affects Versions: v1.5.2
Environment: hadoop: 2.4.0.5
hive:0.13.0.5
hbase:0.98.8
jdk:1.7.0_60-ea
Reporter: dcswinner
Assignee: Dong Li
Fix For: Future
when build a cube,the job running to Load HFile to HBase Table'step,I found
that all of these hfiles's owner were belong to user:kylin and group:kylin on
hdfs.
eg:
[bigdata@kylin02-pre ~]$ hadoop fs -ls
/hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1
Found 2 items
-rwxrwxrwx 2 kylin kylin 6965632 2016-06-12 11:06
/hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/13f7a13f6f754f2f8a15e0efe60dac1d_SeqId_2_
-rwxrwxrwx 2 kylin kylin 7544515 2016-06-12 11:06
/hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
the owner were belong to user:kylin and group:kylin like above.
then,when HBase run archive chore in backgroud,will throw an error:
Caused by:
org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
Permission denied: user=hbase, access=WRITE,
inode="/hbase/.tmp/data/default/KYLIN_9RJA24O
ZEM/4f54f38dc4b96a04a82bdb780fef77c4/F2/3b9adb66f50e42918a9b6c4f67cb0261_SeqId_2_":kylin:kylin:-rw-r--r--
I have a solution is change these hfiles's permission 777 before bulkload
hfile to hbase:
hadoop fs -chmod 777
/hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
or change these hfiles's owner and group:
hadoop fs -chown hbase:hbase
/hbase/data/default/KYLIN_556NF0D6BV/03bb84673d43e66c5ac2eeabe6df4020/F1/dcf03d3be6ae4dd4a93b7a05cdf00382_SeqId_2_
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
