Hi, experts We are now deploying standalone Hbase out of the hadoop cluster to improve the query performance. http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/
The new Hbase cluster use seperate zookeeper nodes from the main cluster. Kylin server can access both the Hbase, hadoop & hive resource. But in this configuration, cude build failed in the first step: There are 3 hive commands in the first step: DROP TABLE IF EXISTS kylin_intermediate_test1_ba3c5910_ff7d_4669_b28a_4ec2736d60dc; CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_test1_ba3c5910_ff7d_4669_b28a_4ec2736d60dc ... INSERT OVERWRITE TABLE kylin_intermediate_test1_ba3c5910_ff7d_4669_b28a_4ec2736d60dc SELECT ...... drop & create table are OK, but failed on "insert overwrite" with the following exception. FAILED: IllegalArgumentException java.net.UnknownHostException: maincluster at org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:92) at org.apache.kylin.source.hive.CreateFlatHiveTableStep.createFlatHiveTable(CreateFlatHiveTableStep.java:52) at org.apache.kylin.source.hive.CreateFlatHiveTableStep.doWork(CreateFlatHiveTableStep.java:70) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:142) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) It seems MR job are failed to submit to YARN. In our debug, seems job is not submitted to main cluster. So my question is: 1. Is it OK to deploy StandAlone Hbase cluster with seperate Zookeeper different from the main cluster? 2. How Kylin get yarn config when submmiting job? I can only find hive & hbase config, but not yarn related config. Thanks a lot. -- Yuxiang Mai
