Re: User access rights to HDFS, HDInsight

[Billy(Yiming) Liu]

There is one managed Kylin service on HDInsight, check it out
https://azuremarketplace.microsoft.com/en-us/marketplace/apps/kyligence.kyligence
With Warm regards

Yiming Liu (刘一鸣)

hammad  于2019年10月5日周六 下午2:16写道：
>
> Hi,
> I am trying to install Kylin on Azure HDInsight Hadoop cluster.
>
> *check-env.sh* script is giving me permission error
>
> Retrieving hadoop conf dir...
> KYLIN_HOME is set to /usr/local/apache-kylin-2.6.3-bin-hadoop3
> mkdir: Incomplete HDFS URI, no host: hdfs:///kylin/spark-history
> Failed to create hdfs:///kylin/spark-history. Please make sure the user has
> right to access hdfs:///kylin/spark-history
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/

Re: Delete Data

[Billy(Yiming) Liu]

The cube data is stored by "Segment". You could delete some old segments.

2016-11-30 17:35 GMT+08:00 Amuro Copperfield :

> Hi，all I have a question. How can i delete some older data build by kylin
> such as before someday, then use a later day as a new start day?
>
> via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx=9.2.8=10.
> 12.1=email_footer_2]




-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: About Lookup table for streaming cube

[Billy(Yiming) Liu]

Do the join in your ETL process. For example, reading message from Kafka
Msg1, do the join in your app, and send results Kafka Msg2. Then build
streaming cube based on Msg2.

2016-11-30 16:38 GMT+08:00 Amuro Copperfield <xwhfcen...@gmail.com>:

> Do you have any idea about how to support lookup table for streaming cube?
> via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx=9.2.8=10.
> 12.1=email_footer_2]
> On Wed, Nov 30, 2016 at 15:13, Amuro Copperfield <xwhfcen...@gmail.com>
> wrote:
> sure, i got it
>
> via Newton Mail [https://cloudmagic.com/k/d/mailapp?ct=dx=9.2.8=10.
> 12.1=email_footer_2]
> On Wed, Nov 30, 2016 at 15:12, Billy(Yiming) Liu <liuyiming@gmail.com>
> wrote:
> Hi Amuro,
>
> Currently, not supported yet.
>
> 2016-11-30 15:04 GMT+08:00 Amuro Copperfield <xwhfcen...@gmail.com>:
>
> > Hi, all As subject, i want to know if kylin1.6.0 can support lookup table
> > join the fact table for steaming cube? And if the answer is yes, how many
> > lookup tables it can support to join?
> >
> > via Newton Mail [https://cloudmagic.com/k/d/ma
> > ilapp?ct=dx=9.2.8=10.12.1=email_footer_2]
>
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: About Lookup table for streaming cube

[Billy(Yiming) Liu]

Hi Amuro,

Currently, not supported yet.

2016-11-30 15:04 GMT+08:00 Amuro Copperfield :

> Hi, all As subject, i want to know if kylin1.6.0 can support lookup table
> join the fact table for steaming cube? And if the answer is yes, how many
> lookup tables it can support to join?
>
> via Newton Mail [https://cloudmagic.com/k/d/ma
> ilapp?ct=dx=9.2.8=10.12.1=email_footer_2]




-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: Welcome new Apache Kylin committer: Billy Liu

[Billy(Yiming) Liu]

Thanks Luke for the invitation, and thanks the trust from PMC and all
community.

The first time I met Kylin was 2015. At that time I tried to build up a DMP
system based on Kylin.

One year passed since then, I participate in the community, try to figure
out how Kylin works, learn from real experts, and meet many good friends.
Has so much fun here. I'm pleased, honored and humbled to accept the
invitation and to be a part of Kylin community.

Thank you, Luke and our community.


2016-11-30 9:54 GMT+08:00 Jian Zhong <zhongj...@apache.org>:

> Welcome Billy!
>
> On Wed, Nov 30, 2016 at 9:38 AM, Dong Li <lid...@apache.org> wrote:
>
> > Congrats! Welcome Billy!
> >
> >
> > Thanks,
> > Dong Li
> >
> >
> > Original Message
> > Sender:ShaoFeng shishaofeng...@apache.org
> > Recipient:dev...@kylin.apache.org
> > Date:Wednesday, Nov 30, 2016 09:03
> > Subject:Re: Welcome new Apache Kylin committer: Billy Liu
> >
> >
> > Welcome Billy! 2016-11-30 8:59 GMT+08:00 Luke Han luke...@apache.org:  I
> > am very pleased to announce that the Project Management Committee  (PMC)
> of
> > Apache Kylin has asked Billy (Yiming) Liu to becomeApache Kylin
> committer,
> > and he has already accepted.   Billy has already made many contributions
> to
> > Kylin community, to answer  others questions actively, submit patches for
> > bug fixes and contribute to  some features. We are so glad to have him to
> > be our new committer.   Please join me to welcome Billy.   Luke Han   On
> > behalf of the Apache Kylin PPMC  -- Best regards, Shaofeng Shi 史少锋
> >
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: default.kylin_intermediate not found NoSuchObjectException

[Billy(Yiming) Liu]

No attachment found. I think the attachment may be blocked by mail list
service.

2016-11-17 9:28 GMT+08:00 移动苏州研发中心-陈雷雷 <775620...@qq.com>:

> Hi all:
>
>  My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-
> bin.tar.gz.
>   I created the sample cube with bin/sample.sh. And when I built the
> sample cube, in step 3, an execption occured which is 
> java.lang.RuntimeException:
> java.io.IOException: NoSuchObjectException(message:
> default.kylin_intermediate_kylin_sale* table not found). And the detailed
> information is in the attachment.
>  I have searched the archive of the mailing list, and  found out
> property hive.metastore.uris should be set , but I already set it before.
> And the intermdeiate table is in hive, while I check it using hive command.
> Can anyone give me a pointer where I should configure to solve the problem.
>
>
>
>
>
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: some confuse about Mandatory Dimensions

[Billy(Yiming) Liu]

If you set A, B, and C as mandatory dimensions, that means Kylin will save
the cuboid result by grouping A, B, C internally. But that not means you
could only query by grouping A, B, C.  If you only query A, B. The final
result will do post-aggregation by grouping the above cuboid. Same as query
grouping A. The cost is performance, since more post-aggregation needed.
But if you query by grouping D. There would be no result, since you missed
the mandatory dimension.

2016-11-17 13:31 GMT+08:00 张晓明（zhangxiaoming）-技术产品中心 :

> Hi,all
>
>  I have create a cube in My System with Mandatory Dimensions such
> as  A B C, and the Measure use count distinct filed “u” will HLL ,
>
> When the segment of the cube complete,I query the result with kylin sql
> as “select count(distinct u) from table where A=xxx and b=yyy” or “select
> count(distinct u) from table where A=xxx ”. The result is correct
>
> In my opinion, all of the query condition must be set (A=xxx,B=,C=zzz)
> ,the kylin sql can be wrok,
>
> The question is How the Kylin query the result and the distinct value is
> right ?  that is unbelievable
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2196) Update Tomcat clas loader to parallel loader

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2196:


 Summary: Update Tomcat clas loader to parallel loader
 Key: KYLIN-2196
 URL: https://issues.apache.org/jira/browse/KYLIN-2196
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Reporter: Billy(Yiming) Liu
Assignee: Billy(Yiming) Liu
Priority: Minor


The related article:

https://bz.apache.org/bugzilla/show_bug.cgi?id=57681

https://yq.aliyun.com/articles/4227




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Apache Kylin compiler

[Billy(Yiming) Liu]

The master branch is for HBase 0.98.
The master-hbase1.x branch is for HBase 1.x.

The source code is a little different.

2016-11-15 16:04 GMT+08:00 peng.jianhua <35573...@qq.com>:

> Dear All:
>
> I have a question. The source code address of the apache kylin is
> git://git.apache.org/kylin.git. How to compile can get HBase 1.x version
> and
> HBase 0.9.8 version using the only source code?
>
>
>
>
>
> Best regards
>
> Peng Jianhua
>
>
>
>
>
> 2016.11.15
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: kylin supports complex data type?

[Billy(Yiming) Liu]

Not yet. It's very welcomed if someone could contribute on these data type
support.

2016-11-11 14:14 GMT+08:00 wang...@snqu.com :

> Does Kylin 1.5.4 support complex data type(Map, array, struct) in Hive?
>
>
>
> wang...@snqu.com
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: When query this statement will be reported to the wrong

[Billy(Yiming) Liu]

"DEFAULT" is a reserved word in Apache Calcite which is also the SQL parser
in Kylin. Please try "DEFAULT".TABLE_NAME.

2016-11-11 9:45 GMT+08:00 zhangtianyu...@chinasofti.com <
zhangtianyu...@chinasofti.com>:

> hi:
> When query this statement will be reported to the wrong? The default is
> hive databasename.
> SELECT * FROM DEFAULT.TABLE_NAME;
>
> right:
> SELECT * FROM TABLE_NAME;
>
> --
>
> 咨询顾问，数据服务业务线，*张天宇*
>
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: hadoop2.2 imcompatible proble

[Billy(Yiming) Liu]

Based on my limited experience, here are some source code changes needed
because some YARN APIs changed since Hadoop 2.2.

The code is in JobTaskCounterExtractor and HadoopStatusChecker

2016-11-10 11:23 GMT+08:00 胡志华(万里通科技及数据中心商务智能团队数据分析组) <
huzhihua...@pingan.com.cn>:

> Hi all
>
>As the request of department, I need to deploy another kylin
> cluster. The problem is hadoop cluster is too old , hadoop2.2.0, cube
> building will stop at step 3 “Extract Fact Table Distinct Columns”, the
> error code from mapreduce is as below:
>
>I don’t know whether kylin support hadoop 2.2.0, by the way, I have
> run “wordcount” on kylin’s hadoop client ,it worked.
>
>Hadoop cluster won’t be upgraded easily, So I can’t doploy kylin
> with my present environment ?
>
>
> “Application application_1468678294220_132943 failed 2 times due to AM
> Container for appattempt_1468678294220_132943_02 exited with
> exitCode: 1 due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
> at org.apache.hadoop.util.Shell.run(Shell.java:379)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(
> Shell.java:589)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.
> launchContainer(DefaultContainerExecutor.java:195)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:283)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.
> launcher.ContainerLaunch.call(ContainerLaunch.java:79)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> .Failing this attempt.. Failing the application.”
>
>
> 
> 
> The information in this email is confidential and may be legally
> privileged. If you have received this email in error or are not the
> intended recipient, please immediately notify the sender and delete this
> message from your computer. Any use, distribution, or copying of this email
> other than by the intended recipient is strictly prohibited. All messages
> sent to and from us may be monitored to ensure compliance with internal
> policies and to protect our business.
> Emails are not secure and cannot be guaranteed to be error free as they
> can be intercepted, amended, lost or destroyed, or contain viruses. Anyone
> who communicates with us by email is taken to accept these risks.
>
> 收发邮件者请注意：
> 本邮件含保密信息，若误收本邮件，请务必通知发送人并直接删去，不得使用、传播或复制本邮件。
> 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。
> 
> 
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: version compability

[Billy(Yiming) Liu]

Glad to hear that.

2016-10-28 6:43 GMT+08:00 mnagy :

> Problem fixed at version 1.6.
> I have just checked it ;)
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/version-compability-tp5636p6106.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2133) Check web server port availability when startup

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2133:


 Summary: Check web server port  availability when startup
 Key: KYLIN-2133
 URL: https://issues.apache.org/jira/browse/KYLIN-2133
 Project: Kylin
  Issue Type: Improvement
  Components: Tools, Build and Test
Reporter: Billy(Yiming) Liu
Assignee: Billy(Yiming) Liu
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2131) Load Kafka client configuration from properties files

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2131:


 Summary: Load Kafka client configuration from properties files
 Key: KYLIN-2131
 URL: https://issues.apache.org/jira/browse/KYLIN-2131
 Project: Kylin
  Issue Type: Improvement
  Components: streaming
Reporter: Billy(Yiming) Liu
Priority: Minor


The latest kafka source hardcode the connection properties(such as "timeout.ms" 
in source files, it could be better if could refactor these properties into 
files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-2123) Reload metadata could not load new Column Type

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2123:


 Summary: Reload metadata could not load new Column Type
 Key: KYLIN-2123
 URL: https://issues.apache.org/jira/browse/KYLIN-2123
 Project: Kylin
  Issue Type: Bug
  Components: Metadata
Reporter: Billy(Yiming) Liu
Assignee: Shaofeng SHI


If the data column type has changed manually in JSON, and click "Reload". The 
new column type does not work. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Scheduling Cube Daily

[Billy(Yiming) Liu]

please schedule a crontab job with Kylin REST call, for more information:
http://kylin.apache.org/docs15/howto/howto_use_restapi.html

2016-10-21 14:26 GMT+08:00 Mr_Data :

> Hi,
>
> I am new for Apache Kylin. I have created a cube and want to schedule it
> daily for added new values daily.
>
> How can I setup that?
>
> Can you help me please?
>
> Best Regards,
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Scheduling-Cube-Daily-tp6057.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: Unable to connect to Kylin Web UI

[Billy(Yiming) Liu]

The first thing to do is checking the kylin.log. Is there any exception
when Kylin starts up? Could the sample.sh run successfully?

2016-10-19 19:09 GMT+08:00 Big Data :

> Hi,
>
> I have recently installed kylin 1.5.4.1 Hbase1.x on hortonworks sandbox, I
> am able to connect to Ambari with the address http://127.0.0.1:8080 where
> as I am not able to connect to kylin after successful installation with the
> address http://127.0.0.1:7070/kylin.
>
> I used two n/w adapters both NAT & bridged || Bridged & Bridged and tried
> with port forwarding on NAT with 7070 port but still i am not reachable to
> the web UI.
>
> Kylin sever is restarted successfully.
>
> Appreciate your help.
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/mapreduce/HCatInputFormat

[Billy(Yiming) Liu]

Edit /usr/lib/hbase/conf/hbase-env.sh
Change the first line from
export HBASE_CLASSPATH=/etc/hadoop/conf

to
export HBASE_CLASSPATH=$HBASE_CLASSPATH:/etc/hadoop/conf

2016-10-19 14:24 GMT+08:00 张磊 <121762...@qq.com>:

> Hi   when i build the sample kylin_sales_cube, in the kylin.log,i find
> java.lang.NoClassDefFoundError. but in the log i find some messages, i do
> not konw why?
>
>
> /usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
> is loaded, why class is not foung?
>
>
> 016-10-18 23:17:59,902 INFO  [pool-8-thread-3]
> common.AbstractHadoopJob:203 : Hive Dependencies After Filtered:
> /usr/lib/hive/lib/hive-metastore-2.1.0-amzn-0.jar,/
> usr/lib/hive/lib/hive-exec-2.1.0-amzn-0.jar,/usr/lib/hive-
> hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
>
>
> 2016-10-18 23:17:59,907 INFO  [pool-8-thread-3]
> common.AbstractHadoopJob:371 : Job 'tmpjars' updated --
> file:/usr/lib/hive/lib/hive-metastore-2.1.0-amzn-0.jar,
> file:/usr/lib/hive/lib/hive-exec-2.1.0-amzn-0.jar,file:/
> usr/lib/hive-hcatalog/share/hcatalog/hive-hcatalog-core-2.1.0-amzn-0.jar
>
>
> 2016-10-18 23:17:59,934 ERROR [pool-8-thread-3]
> threadpool.DefaultScheduler:140 : ExecuteException
> job:845380a7-63b7-4315-8d71-6bb290018790
> org.apache.kylin.job.exception.ExecuteException: 
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/
> mapreduce/HCatInputFormat
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:123)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kylin.job.exception.ExecuteException: 
> java.lang.NoClassDefFoundError:
> org/apache/hive/hcatalog/mapreduce/HCatInputFormat
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:123)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> ... 4 more
> Caused by: java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/
> mapreduce/HCatInputFormat
> at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:89)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> setupMapper(FactDistinctColumnsJob.java:123)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:120)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> ... 6 more
> Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.
> mapreduce.HCatInputFormat
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1858)
> at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(
> WebappClassLoaderBase.java:1701)
> ... 12 more




-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: some question about kylin

[Billy(Yiming) Liu]

Have you built the cube successfully? The Insight Tab lists query-able
tables only.

2016-10-18 11:14 GMT+08:00 张磊 <121762...@qq.com>:

> hi
> in model menu, there are some tables; but in insight menu,there is no
> tables, the file of kylin.log do not contain errors, why?
>
> -- 原始邮件 --
> *发件人:* "ShaoFeng Shi";;
> *发送时间:* 2016年10月17日(星期一) 晚上10:00
> *收件人:* "dev";
> *主题:* Re: some question about kylin
>
> Hi,
>
> Usually this is caused that HBase's script didn't inheritate the
> "HBASE_CLASSPATH" environment varaible (Kylin depends on it to attache Hive
> jars to classpath).
>
> Go to the HBase installation path, and then grep "HBASE_CLASSPATH" in the
> `hbase` shell file, you should find something like:
>
> export
> HBASE_CLASSPATH=$HADOOP_CONF:$HADOOP_HOME/*:$HADOOP_HOME/
> lib/*:$ZOOKEEPER_HOME/*:$ZOOKEEPER_HOME/lib/*:$HBASE_CLASSPATH
>
> Above is a good sample, as it will keep the original value of
> $HBASE_CLASSPATH; But in some distribution like EMR 5.0, it just set the
> HBASE_CLASSPATH value instead of appending, then it will cause the hive jar
> not on Kylin's classpath. You need manually correct that.
>
> I will add this to FAQ page.
>
>
> 2016-10-17 17:03 GMT+08:00 张磊 <121762...@qq.com>:
>
> > I install kylin(apache-kylin-1.5.4.1-hbase1.x-bin) in EMR5.0.0， while i
> > operate on web, there is some error, i do not install hcatalog in emr.
> How
> > can i resolve this question? Thanks!
> >
> > java.lang.NoClassDefFoundError: org/apache/hive/hcatalog/
> mapreduce/HCatInputFormat
> > at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> > configureJob(HiveMRInput.java:89)  at org.apache.kylin.engine.mr.
> > steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:
> 123)
> >at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> > run(FactDistinctColumnsJob.java:103) at
> org.apache.kylin.engine.mr
> > .MRUtil.runMRJob(MRUtil.java:88)   at org.apache.kylin.engine.mr.
> > common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)   at
> > org.apache.kylin.job.execution.AbstractExecutable.
> > execute(AbstractExecutable.java:113)   at org.apache.kylin.job.
> > execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:
> 57)
> >at org.apache.kylin.job.execution.AbstractExecutable.
> > execute(AbstractExecutable.java:113)   at org.apache.kylin.job.impl.
> > threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
> >  at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> > at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> >
> >
> > 上一封 下一封
> > « 返回
> >
> >
> >
> >
> >
> >
> >
> >
> > 上一封 下一封
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2096) Support "select version()" SQL statement

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2096:


 Summary: Support "select version()" SQL statement
 Key: KYLIN-2096
 URL: https://issues.apache.org/jira/browse/KYLIN-2096
 Project: Kylin
  Issue Type: Improvement
  Components: Driver - JDBC
Reporter: Billy(Yiming) Liu
Assignee: Yifan Zhang
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Ability of Kylin to get data from HBase

[Billy(Yiming) Liu]

I think you are talking about source. Currently, Kylin supports Hive and
Kafka as source. There is very limit requirement for HBase as source. Maybe
you could try to export from HBase to Hive first, and then build the cube.


2016-10-14 12:48 GMT+08:00 PRABHU Reshma :

> Hi,
>
> I wanted to understand if it is able to retrieve data from Hbase in the
> big data environment on Hortonworks for building cube on Kylin.
>
> If yes, can you please let me know how it is done?
>
> Regards,
> Reshma
> =
>
> Ce message et toutes les pieces jointes (ci-apres le "message")
> sont confidentiels et susceptibles de contenir des informations
> couvertes par le secret professionnel. Ce message est etabli
> a l'intention exclusive de ses destinataires. Toute utilisation
> ou diffusion non autorisee interdite.
> Tout message electronique est susceptible d'alteration. La SOCIETE GENERALE
> et ses filiales declinent toute responsabilite au titre de ce message
> s'il a ete altere, deforme falsifie.
>
> =
>
> This message and any attachments (the "message") are confidential,
> intended solely for the addresses, and may contain legally privileged
> information. Any unauthorized use or dissemination is prohibited.
> E-mails are susceptible to alteration. Neither SOCIETE GENERALE nor any
> of its subsidiaries or affiliates shall be liable for the message
> if altered, changed or falsified.
>
> =
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: java.lang.OutOfMemoryError: Java heap space

[Billy(Yiming) Liu]

50,000,000 is ultra high cardinality. What kind of Dictionary did you
choose?

2016-10-11 9:16 GMT+08:00 沙漠火狐 <278211...@qq.com>:

> thanks xwhfcen...@gmail.com
>
>
> in /bin/setev.sh my setting is
>
>
> export KYLIN_JVM_SETTINGS="-Xms2048M -Xmx10240M -Xss1024K
> -XX:MaxPermSize=10240M -verbose:gc -XX:+PrintGCDetails
> -XX:+PrintGCDateStamps -Xloggc:$KYLIN_HOME/logs/kylin.gc.$$
> -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M"
>
>
> the problem is  still.  or  i any config setting  is wrong?
>
>
>
>
> -- 原始邮件 --
> 发件人: "Mario Copperfield";;
> 发送时间: 2016年10月10日(星期一) 下午5:26
> 收件人: "dev";
>
> 主题: Re: java.lang.OutOfMemoryError: Java heap space
>
>
>
> can try set KYLIN_JVM_SETTINGS in /bin/setenv.sh
>
> On Mon, Oct 10, 2016 at 4:55 PM, 沙漠火狐 <278211...@qq.com> wrote:
>
> > hi
> >I have a big lookuptable about 1.3G, when I cube it,  in
> > /logs/kylin.out  say :
> >
> >
> > Oct 10, 2016 4:20:22 PM org.apache.catalina.startup.Catalina start
> > INFO: Server startup in 24004 ms
> > Found segment ordrpath_goodsid[2016100800_2016100900]
> > #
> > # java.lang.OutOfMemoryError: Java heap space
> > # -XX:OnOutOfMemoryError="kill -9 %p"
> > #   Executing /bin/sh -c "kill -9 23272"...
> >
> >
> >
> > 
> > then the  kylin is stop.
> >
> >
> > so I  add JAVA_OPTS="-Xms256m -Xmx10240m -XX:PermSize=128m
> > -XX:MaxPermSize=4096m"   config in   catalin.sh
> >
> >
> > and change the config in kylin_job_conf_inmem.xml  to
> >  
> > mapreduce.map.memory.mb
> > 4096
> > 
> > 
> >
> >
> > 
> > mapreduce.map.java.opts
> > -Xmx10240m
> > 
> > 
> >
> >
> > I also change the propery in kylin.properies
> > kylin.dictionary.max.cardinality=5000
> > kylin.table.snapshot.max_mb=1500
> >
> >
> >
> >
> >
> >
> >
> > but the problem is still in.is there any config i should add to solve
> > this problem. thanks !
>
>
>
>
> --
> Best regards,
> Amuro Copperfield
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2068) Import hive comment when sync tables

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2068:


 Summary: Import hive comment when sync tables
 Key: KYLIN-2068
 URL: https://issues.apache.org/jira/browse/KYLIN-2068
 Project: Kylin
  Issue Type: Improvement
  Components: Metadata
Reporter: Billy(Yiming) Liu
Assignee: Shaofeng SHI
Priority: Minor


Current Sync Table imports the table names, column names and data type, without 
comment. The "comment" is useful for understanding the column and cube 
designing. May I propose to include the comment information into column 
metadata.

Both backend and GUI work needed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [Announce] Apache Kylin 1.5.4.1 released

[Billy(Yiming) Liu]

Thanks Shaofeng. Release is a hard work.

2016-09-28 17:34 GMT+08:00 ShaoFeng Shi :

> The Apache Kylin team is pleased to announce the immediate availability of
> the 1.5.4.1 release.
>
> This is a bug fix release based on 1.5.4; All of the changes in this
> release can be found in:
> https://kylin.apache.org/docs15/release_notes.html
>
> You can download the source release and binary packages from
> https://www.apache.org/dyn/closer.cgi?path=/kylin/apache-kylin-1.5.4.1/
>
> More information about the binary packages is on Kylin's download page
> https://kylin.apache.org/download/
>
> Apache Kylin is an open source Distributed Analytics Engine designed to
> provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop,
> supporting extremely large datasets.
>
> Apache Kylin lets you query massive data set at sub-second latency in 3
> steps:
> 1. Identify a Star Schema data on Hadoop.
> 2. Build Cube on Hadoop.
> 3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC
> or RESTful API.
>
> Thanks everyone who have contributed to the 1.5.4.1 release.
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kylin.apache.org/
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2041) Wrong parameter definition in Get Hive Tables REST API

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2041:


 Summary: Wrong parameter definition in Get Hive Tables REST API
 Key: KYLIN-2041
 URL: https://issues.apache.org/jira/browse/KYLIN-2041
 Project: Kylin
  Issue Type: Bug
  Components: REST Service
Reporter: Billy(Yiming) Liu
Assignee: Zhong,Jason
Priority: Minor


According to document: 
http://kylin.apache.org/docs15/howto/howto_use_restapi.html#get-hive-tables
the "project" is a required parameter. But the source code is "required = 
false" which will lead Internal Server Error when wrong parameter. The fix is 
simple.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [Award] Kylin won InfoWord Bossie Awards 2016, again!

[Billy(Yiming) Liu]

So cool. Congrats.

2016-09-23 11:09 GMT+08:00 Hao Chen :

> Congratulation!
>
> Hao
>
> On Sep 23, 2016, at 12:35 AM, Luke Han  wrote:
>
> Hi community,
>  You may already know, in the latest announced news from InfoWorld,
> Apache Kylin has been selected for this year's Bossie Awards again:
> *The Best Open Source Big Data Tools*. This is second time we won this.
>   There are 12 projects in this years list, they are TensorFlow, Beam,
> Spark, Kylin
> Kafka,Impala, Elasticsearch, SlamData, Zeppelin, Solr, Streamsets, Titan.
> Most of
> them are Apache projects (include incubating). Congrats to ASF!
>
>Would like to take this monument to say thanks to everybody, we
> never could
> won such industry recognition without everyone's contribution, thanks:-)
>
> Here's news link, enjoy it:
> http://www.infoworld.com/article/3120856/open-source-
> tools/bossie-awards-2016-the-best-open-source-big-data-tools.html#slide9
>
> Thanks.
> Luke Han
>
>


-- 
With Warm regards

Yiming Liu (刘一鸣)

Sonar enabled for Apache Kylin

[Billy(Yiming) Liu]

Hi community,

Apache Software Foundation has setup the Sonar code analytics service for
Kylin:
https://analysis.apache.org/dashboard/index/272747

Through the dashboard and issues, we found there are still some bad smells
inside the code. Not all issues are real problems(I think most of them are
not), but the fix and suggestions are welcomed always.

If you find something interesting, please share with the community. Let's
keep the higher code quality and make it fun.

-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: [Announce] Apache Kylin 1.5.4 released

[Billy(Yiming) Liu]

Thanks Shaofeng and our community.

2016-09-16 21:25 GMT+08:00 ShaoFeng Shi :

> The Apache Kylin team is pleased to announce the immediate availability of
> the 1.5.4 release.
>
> This is a bug fix release based on 1.5.3; All of the changes in this
> release can be found in:
> https://kylin.apache.org/docs15/release_notes.html
>
> You can download the source release and binary packages from
> https://www.apache.org/dyn/closer.cgi?path=/kylin/apache-kylin-1.5.4/
>
> More information about the binary packages is on Kylin's download page
> https://kylin.apache.org/download/
>
> Apache Kylin is an open source Distributed Analytics Engine designed to
> provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop,
> supporting extremely large datasets.
>
> Apache Kylin lets you query massive data set at sub-second latency in 3
> steps:
> 1. Identify a Star Schema data on Hadoop.
> 2. Build Cube on Hadoop.
> 3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC
> or RESTful API.
>
> Thanks everyone who have contributed to the 1.5.4 release.
>
> We welcome your help and feedback. For more information on how to
> report problems, and to get involved, visit the project website at
> https://kylin.apache.org/
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

Re: Fwd: About Kafka in Kylin

[Billy(Yiming) Liu]

The current design is still an experimental approach. Kafka could not
guarantee the global order, so we have to find other solution. The new
design Streaming OLAP solution will relay on the Kafka partition order,
instead of app timestamp. The code is under KYLIN-1726 branch still.

2016-09-13 15:46 GMT+08:00 Mario Copperfield :

> OK, Thank you
>
> On Tue, Sep 13, 2016 at 3:27 PM, Sarnath K  wrote:
>
> > Yes,  that's true.  If you are looking at an app timestamp(event origin
> > time),  then We can't binary search on it. Though Binary search may be a
> > good approximation for the common case.
> > Not sure what Kylin is designed for. Let's wait to hear from the experts!
> >
> > On Sep 13, 2016 12:49, "Mario Copperfield"  wrote:
> >
> > > It's true that data appears in order in Kafka, but it can't assert that
> > the
> > > timestamp of data is ordered, in fact, in real time it always appear
> > > without order
> > >
> > > On Tue, Sep 13, 2016 at 3:14 PM, Sarnath K  wrote:
> > >
> > > > I am not sure about what Kylin does.  But I know that data appears in
> > > order
> > > > in Kafka broker. But the consumer can consume in any order that it
> > likes.
> > > > So,  offsets are more driven by Consumers and Kafka does not have a
> say
> > > on
> > > > it.
> > > > Sharing this based on my preliminary understanding of how Kafka
> works.
> > > > Best,
> > > > Sarnath
> > > >
> > > > On Sep 13, 2016 12:41, "Mario Copperfield" 
> > wrote:
> > > >
> > > > > Dear all,
> > > > >I am using kylin streaming build, and when i read the code
> > about
> > > > > this module, i found that kylin use binary search to find the
> offset
> > > > which
> > > > > is the closest adjust to the starttamp. I doubt that is that work
> if
> > > the
> > > > > data in kafka is not order?
> > > > >Thanks and waits.
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > > Amuro Copperfield
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > > Amuro Copperfield
> > >
> >
>
>
>
> --
> Best regards,
> Amuro Copperfield
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

[jira] [Created] (KYLIN-2010) Date dictionary return wrong SQL result

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-2010:


 Summary: Date dictionary return wrong SQL result
 Key: KYLIN-2010
 URL: https://issues.apache.org/jira/browse/KYLIN-2010
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Affects Versions: v1.5.3
Reporter: Billy(Yiming) Liu
Assignee: Billy(Yiming) Liu


One dimension calls DAY_ID, varchar type, data likes "20160401". The cube is 
built successfully with "Date" dictionary for the DAY_ID column. But query 
'select count(*), DAY_ID from table group by DAY_ID', the result DAY_ID column 
is '145946880', not '20160401'. If build with "Dict" dictionary, the result 
will be '20160401'. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1995) Upgrade MapReduce properties which are deprecated

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-1995:


 Summary: Upgrade MapReduce properties which are deprecated
 Key: KYLIN-1995
 URL: https://issues.apache.org/jira/browse/KYLIN-1995
 Project: Kylin
  Issue Type: Task
  Components: Job Engine
Affects Versions: v1.5.2
Reporter: Billy(Yiming) Liu
Assignee: Dong Li
Priority: Minor


Currently, Kylin use Hadoop 2.6 API. There are many properties are deprecated 
in Hadoop 2.6, but still used in kylin's kylin_hive_conf.xml and 
kylin_job_conf.xml, such as mapred.compress.map.output, 
mapred.map.output.compression.codec and more. The full list is 
https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/DeprecatedProperties.html
 

In this JIRA task, the deprecated properties will be upgraded to hadoop 2.6 
effective name and value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1938) Document for Hive/HBase/Hadoop permission required

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-1938:


 Summary: Document for Hive/HBase/Hadoop permission required
 Key: KYLIN-1938
 URL: https://issues.apache.org/jira/browse/KYLIN-1938
 Project: Kylin
  Issue Type: Improvement
  Components: Documentation
Affects Versions: v1.5.3
Reporter: Billy(Yiming) Liu
Priority: Minor


Kylin would execute quite a few hadoop command when building cube, such as dfs, 
set "mapreduce.job.reduces", set "hive.merge.mapredfiles" and more. Some 
commands are mandatory, and some are optional for better performance. 

Usually in a hadoop cluster, Apache Kylin should be treated as a
privileged user (instead of a normal user like analyst), which can execute
necessary hadoop/hdfs/hbase/hive actions (like mkdir, create htable, etc);
To achieve this, the administrator need do some configurations and
authorizations.

What we need do is to compose a document to list these privileges.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1919) Support Embedded Structure when Parsing Streaming Message

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-1919:


 Summary: Support Embedded Structure when Parsing Streaming Message
 Key: KYLIN-1919
 URL: https://issues.apache.org/jira/browse/KYLIN-1919
 Project: Kylin
  Issue Type: New Feature
  Components: streaming
Affects Versions: v1.5.2
Reporter: Billy(Yiming) Liu


According to the doc: 
http://kylin.apache.org/docs15/tutorial/cube_streaming.html, the Kafka incoming 
message should be in flatten structure. But it's too limit for JSON message. 
The request feature would support embedded structure raw messages, and convert 
them into flatten table structure for further cube building and SQL query.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1912) Create Intermediate Flat Hive Table failed when using beeline

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-1912:


 Summary: Create Intermediate Flat Hive Table failed when using 
beeline
 Key: KYLIN-1912
 URL: https://issues.apache.org/jira/browse/KYLIN-1912
 Project: Kylin
  Issue Type: Bug
  Components: Job Engine
Affects Versions: v1.5.2
Reporter: Billy(Yiming) Liu
Assignee: Dong Li
Priority: Critical


When beeline is enabled with parameters:
kylin.hive.client = beeline
kylin.hive.beeline.params=-n root --hiveconf 
hive.security.authorization.sqlstd.confwhitelist.append='mapreduce.job.*|dfs.*' 
-u 'jdbc:hive2://localhost:1' 

The build cube will fail with following exceptions:
{code}
java.lang.IllegalArgumentException: Map input splits are 0 bytes, something is 
wrong!
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.getTotalMapInputMB(AbstractHadoopJob.java:528)
at 
org.apache.kylin.engine.mr.steps.CuboidJob.setReduceTaskNum(CuboidJob.java:183)
at org.apache.kylin.engine.mr.steps.CuboidJob.run(CuboidJob.java:139)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:91)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:121)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-07-21 15:05:38,615 INFO  [pool-5-thread-6] common.AbstractHadoopJob:479 : 
tempMetaFileString is : 
file:///opt/client/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/kylin_job_meta5547890224035214519/meta
2016-07-21 15:05:38,619 ERROR [pool-5-thread-6] 
execution.AbstractExecutable:128 : error execute 
MapReduceExecutable{id=782765e2-5357-4cc3-8430-b4ee9ffc69de-05, name=Build Base 
Cuboid Data, state=RUNNING}
java.lang.IllegalArgumentException: Map input splits are 0 bytes, something is 
wrong!
at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.getTotalMapInputMB(AbstractHadoopJob.java:528)
at 
org.apache.kylin.engine.mr.steps.CuboidJob.setReduceTaskNum(CuboidJob.java:183)
at org.apache.kylin.engine.mr.steps.CuboidJob.run(CuboidJob.java:139)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:91)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:121)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}

After checking the detail logs, I found the intermediate table may not create 
succeed. 
{code}
2016-07-21 15:15:50,361 INFO  [pool-5-thread-1] 
execution.AbstractExecutable:100 : Executing >>>>>>>>>>>>>   Create 
Intermediate Flat Hive Table   <<<<<<<<<<<<<
2016-07-21 15:15:50,376 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : 
Update row /execute_output/8bd42c24-9fef-4d9f-887f-7de1dac57f7e-00 from oldTs: 
1469085306322, to newTs: 1469085350362, operation result: true
2016-07-21 15:15:50,376 INFO  [pool-5-thread-1] manager.ExecutableManager:274 : 
job id:8bd42c24-9fef-4d9f-887f-7de1dac57f7e-00 from READY to RUNNING
2016-07-21 15:15:50,376 INFO  [pool-5-thread-1] execution.AbstractExecutable:49 
: executing:beeline  -f 
/opt/client/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/beeline_346879081651464139.hql;rm
 -f 
/opt/client/kylin/apache-kylin-1.5.2.1-bin/bin/./../tomcat/temp/beeline_346879081651464139.hql
2016-07-21 15:15:53,999 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : 
Update row /execute_output/8bd42c24-9fef-4d9f-887f-7de1dac57f7e-00 from oldTs: 
1469085350362, to newTs: 1469085353989, operation result: true
2016-07-21 15:15:54,028 DEBUG [pool-5-thread-1] hbase.HBaseResourceStore:262 : 
Update row /execute_output/8bd42c24-9fef-4d9f-887f-7de1dac57f7e-00 from oldTs: 
1469085353989,

[jira] [Created] (KYLIN-1901) Diagnosis package run command failed when using beeline

[Billy(Yiming) Liu (JIRA)]

Billy(Yiming) Liu created KYLIN-1901:


 Summary: Diagnosis package run command failed when using beeline
 Key: KYLIN-1901
 URL: https://issues.apache.org/jira/browse/KYLIN-1901
 Project: Kylin
  Issue Type: Bug
  Components: Tools, Build and Test
Affects Versions: v1.5.2
Reporter: Billy(Yiming) Liu
Assignee: hongbin ma
Priority: Minor


It seems passed the wrong parameters for Beeline case. 

{quote}
2016-07-18 15:15:13,863 INFO  [http-bio-7070-exec-2] 
tool.JobDiagnosisInfoCLI:187 : Queue:default
2016-07-18 15:15:13,871 INFO  [http-bio-7070-exec-2] 
tool.JobDiagnosisInfoCLI:130 : ClientEnvExtractor args: [-destDir, 
/opt/client/kylin/apache-kylin-1.5.2.1-bin/bin/../tomcat/temp/1468826111567-0/job_2016_07_18_00_15_11/client,
 -compress, false, -submodule, true]
2016-07-18 15:15:21,324 WARN  [http-bio-7070-exec-2] tool.ClientEnvExtractor:98 
: Failed to run command: beeline --version.
java.io.IOException: OS command error exit with 255 -- beeline --version
WARNING: Use "yarn jar" to launch YARN applications.
Not a valid JAR: /opt/client/Hive/Beeline/lib/-u

at 
org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:92)
at 
org.apache.kylin.common.util.CliCommandExecutor.execute(CliCommandExecutor.java:80)
at 
org.apache.kylin.tool.ClientEnvExtractor.addShellOutput(ClientEnvExtractor.java:94)
at 
org.apache.kylin.tool.ClientEnvExtractor.executeExtract(ClientEnvExtractor.java:65)
at 
org.apache.kylin.tool.AbstractInfoExtractor.execute(AbstractInfoExtractor.java:99)
at 
org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:39)
at 
org.apache.kylin.tool.JobDiagnosisInfoCLI.executeExtract(JobDiagnosisInfoCLI.java:131)
at 
org.apache.kylin.tool.AbstractInfoExtractor.execute(AbstractInfoExtractor.java:99)
at 
org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:39)
at 
org.apache.kylin.rest.service.DiagnosisService.dumpJobDiagnosisInfo(DiagnosisService.java:64)
at 
org.apache.kylin.rest.service.DiagnosisService$$FastClassByCGLIB$$d802fbf6.invoke()
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at 
org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at 
org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64)
at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at 
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
at 
org.apache.kylin.rest.service.DiagnosisService$$EnhancerByCGLIB$$8319c027.dumpJobDiagnosisInfo()
at 
org.apache.kylin.rest.controller.DiagnosisController.dumpJobDiagnosisInfo(DiagnosisController.java:99)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:213)
at 
org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:126)
at 
org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:96)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:617)
at 
org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:578)
at 
org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80)
at 
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923)
at 
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852)
at 
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882)
at 
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:778)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:620)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilter