Hi, shaofeng & yang
I try to modiry property "kylin.env.hdfs-working-dir" to full qualified path
" hdfs://cdh5/kylin-83-hadoop",
and found it can't work around.
The error stacktrace is similar as before:
"Wrong FS:
hdfs://cdh5/kylin-83-hadoop/kylin_metadata/kylin-9e6272e3-d813-481d-82c0-182b85a0ad8f,
expected: hdfs://cdh5-mini"
I checked kylin source, in HDFSPathGarbageCollectionStep.java func doWork:
*dropHdfsPathOnCluster(toDeletePaths, HadoopUtil.getWorkingFileSystem());
if
(StringUtils.isNotEmpty(context.getConfig().getHBaseClusterFs())) {
dropHdfsPathOnCluster(toDeletePaths,
FileSystem.get(HBaseConnection.getCurrentHBaseConfiguration()));
}*
As long as the property kylin.storage.hbase.cluster-fs(which I set to
hdfs://cdh5-mini) has been set,
Kylin will always try to find and delete the "toDeletePaths" on hbase
cluster,and if we use full qualified path like
"hdfs://cdh5/kylin-83-hadoop",in function dropHdfsPathOnCluster, exception
will be thrown out by the checkpath function since the authority of
hdfs://cdh5/kylin-83-hadoop/xxx was not equal to the authority of
hdfs://cdh5-mini".So I think it should be a relative path,so kylin check on
both hadoop cluster?
Do we have some other work around way? Or what your standard deploy method
when hbase cluster seperate from main cluster?
I was trying to check if kylin can meet our olap demand,and stuck on this
for a long time, really need your help, thank you!
full log as follows:
err_stacktrace.txt
<http://apache-kylin.74782.x6.nabble.com/file/n8121/err_stacktrace.txt>
Best wishes!
--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-2648-Encounter-cube-merge-error-when-deploy-kylin-on-stand-alone-hbase-cluster-tp8096p8121.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
