Let's avoid due post and keep discussion in JIRA. Thanks.
Yang On Mon, May 29, 2017 at 2:52 PM, suheng.cloud <[email protected]> wrote: > Hi, shaofeng & yang > I try to modiry property "kylin.env.hdfs-working-dir" to full qualified > path > " hdfs://cdh5/kylin-83-hadoop", > and found it can't work around. > The error stacktrace is similar as before: > "Wrong FS: > hdfs://cdh5/kylin-83-hadoop/kylin_metadata/kylin-9e6272e3- > d813-481d-82c0-182b85a0ad8f, > expected: hdfs://cdh5-mini" > > I checked kylin source, in HDFSPathGarbageCollectionStep.java func doWork: > > *dropHdfsPathOnCluster(toDeletePaths, HadoopUtil.getWorkingFileSystem()); > if > (StringUtils.isNotEmpty(context.getConfig().getHBaseClusterFs())) { > dropHdfsPathOnCluster(toDeletePaths, > FileSystem.get(HBaseConnection.getCurrentHBaseConfiguration())); > }* > As long as the property kylin.storage.hbase.cluster-fs(which I set to > hdfs://cdh5-mini) has been set, > Kylin will always try to find and delete the "toDeletePaths" on hbase > cluster,and if we use full qualified path like > "hdfs://cdh5/kylin-83-hadoop",in function dropHdfsPathOnCluster, exception > will be thrown out by the checkpath function since the authority of > hdfs://cdh5/kylin-83-hadoop/xxx was not equal to the authority of > hdfs://cdh5-mini".So I think it should be a relative path,so kylin check on > both hadoop cluster? > > Do we have some other work around way? Or what your standard deploy method > when hbase cluster seperate from main cluster? > > I was trying to check if kylin can meet our olap demand,and stuck on this > for a long time, really need your help, thank you! > > full log as follows: > err_stacktrace.txt > <http://apache-kylin.74782.x6.nabble.com/file/n8121/err_stacktrace.txt> > > Best wishes! > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/jira-Created-KYLIN-2648-Encounter-cube-merge- > error-when-deploy-kylin-on-stand-alone-hbase-cluster-tp8096p8121.html > Sent from the Apache Kylin mailing list archive at Nabble.com. >
