For Q3, you can try to make soft links for both hdfs-site.xml and 
mapred-site.xml. 

2017-06-16 

skyyws 



发件人:"lxw" <[email protected]>
发送时间:2017-06-13 11:41
主题:Some questions about Kylin2.0 
收件人:"dev"<[email protected]>,"user"<[email protected]>
抄送:

Hi,All : 

   I have some questions about Kylin2.0, and my environment: 
    hadoop-2.6.0-cdh5.8.3 
    hbase-1.2.0-cdh5.8.3 
    apache-kylin-2.0.0-bin-cdh57 
    spark-2.1.0-bin-hadoop2.6 


Q1: Kylin2.0 not support Spark2.0? 
      
     find-spark-dependency.sh:  
     spark_dependency=`find -L $spark_home -name 
'spark-assembly-[a-z0-9A-Z\.-]*.jar' .... 


Q2: I want to use Kylin2.0 without Spark Cubing, but failed. 


     kylin.sh: 
     function retrieveDependency() { 
         #retrive $hive_dependency and $hbase_dependency 
         source ${dir}/find-hive-dependency.sh 
         source ${dir}/find-hbase-dependency.sh 
         source ${dir}/find-hadoop-conf-dir.sh 
         source ${dir}/find-kafka-dependency.sh 
         source ${dir}/find-spark-dependency.sh 


     If not found spark dependencies, Kylin can not start : 
     
     [hadoop@hadoop10 bin]$ ./kylin.sh start 
     Retrieving hadoop conf dir... 
     KYLIN_HOME is set to /home/hadoop/bigdata/kylin/current 
     Retrieving hive dependency... 
     Retrieving hbase dependency... 
     Retrieving hadoop conf dir... 
     Retrieving kafka dependency... 
     Retrieving Spark dependency... 
     spark assembly lib not found. 


     after modify kylin.sh “####source ${dir}/find-spark-dependency.sh”, Kylin 
start success .. 


Q3: Abount kylin_hadoop_conf_dir ? 
  
     I make some soft link under $KYLIN_HOME/hadoop-conf 
(core-site.xml、yarn-site.xml、hbase-site.xml、hive-site.xml),  
     and set 
"kylin.env.hadoop-conf-dir=/home/bigdata/kylin/current/hadoop-conf", when I 
execute ./check-env.sh,  


     [hadoop@hadoop10 bin]$ ./check-env.sh  
     Retrieving hadoop conf dir... 
    /home/bigdata/kylin/current/hadoop-conf is override as the 
kylin_hadoop_conf_dir 
    KYLIN_HOME is set to /home/hadoop/bigdata/kylin/current 
    -mkdir: java.net.UnknownHostException: cdh5 
    Usage: hadoop fs [generic options] -mkdir [-p] <path> ... 
    Failed to create /kylin20. Please make sure the user has right to access 
/kylin20 


    My HDFS with HA, fs.defaultFS is "cdh5",when I don't set 
"kylin.env.hadoop-conf-dir", and use HADOOP_CONF_DIR, HIVE_CONF, HBASE_CONF_DIR 
from envionment variables (/etc/profile), it was correct.  
      
         
Best Regards! 
lxw 

Reply via email to