Re: [VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-28 Thread yu feng
+1(no binding) mvn test passed build(mvn clean install -DskipTests) success md5&sha1 verified 2017-04-29 0:30 GMT+08:00 Dong Li : > +1 binding > > mvn test passed > > Thanks, > Dong Li > > 2017-04-28 22:12 GMT+08:00 ShaoFeng Shi : > > > +1 binding; > > > > Verified mvn test, md5, sha1 and gpg sig

[jira] [Created] (KYLIN-2578) Refactor DistributedLock

2017-04-28 Thread liyang (JIRA)
liyang created KYLIN-2578: - Summary: Refactor DistributedLock Key: KYLIN-2578 URL: https://issues.apache.org/jira/browse/KYLIN-2578 Project: Kylin Issue Type: Improvement Reporter: liyang

Re: cube building taking 8 hours just for 6 thousands records

2017-04-28 Thread Li Yang
Then it boils down to MR job tuning. You shall identify the slow MR job and take action from there. There are many ways to diagnose and tune MR job. Try google 'tune mapreduce job'. On Fri, Apr 28, 2017 at 6:07 PM, suresh m wrote: > Hi Thanks for your timely reply. > > I set kylin.cube.algorithm

Re: Creating Snowflake schema / Link 2 Cubes

2017-04-28 Thread Li Yang
Hi Bart, With the diagnosis pack, the problem is much clearer. - Seems you are using a CDH quickstart sandbox which is very limited in resource. In that case, it is expected that running 2 or 3 table stats at the same time could hang due to resource competition (thus deadlock) in YAR

Re: Why 'is null' is not evaluable?

2017-04-28 Thread Li Yang
Looks like a bug to me. On Thu, Apr 27, 2017 at 3:52 PM, magang wrote: > Hi, > > When sql contains filter: 'is null'/'is not null', the filter will not be > push down to coprocessor, because the CompareTupleFilter.isEvaluable() > method return false, is it by design or just a bug? > > related co

Re: [VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-28 Thread Dong Li
+1 binding mvn test passed Thanks, Dong Li 2017-04-28 22:12 GMT+08:00 ShaoFeng Shi : > +1 binding; > > Verified mvn test, md5, sha1 and gpg signature, all good. > > 2017-04-28 15:11 GMT+08:00 hongbin ma : > > > +1 > > > > mvn test passed > > mvn integration test passed > > > > On Thu, Apr 27, 2

Re: [VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-28 Thread ShaoFeng Shi
+1 binding; Verified mvn test, md5, sha1 and gpg signature, all good. 2017-04-28 15:11 GMT+08:00 hongbin ma : > +1 > > mvn test passed > mvn integration test passed > > On Thu, Apr 27, 2017 at 8:38 AM, 《秦殇》!健 wrote: > > > +1 > > It's great!!! > > -- 原始邮件 -- > > 发

Re: java.lang.NullPointerException

2017-04-28 Thread ShaoFeng Shi
Hi, The cube definition looks okay, although "AGENTID" and "COURSEID" appeared both in dimension and TopN measure. They were defined to use "dict" encoding so Kylin will build dictionary for them. Could you please share the cube instance json, in which there has the segment metadata; all dictionar

Re: cube building with huge memory, for 5000 records 2.3GB

2017-04-28 Thread ShaoFeng Shi
You need check your Hadoop configuration; Kylin uses your default configuration to request resource from Yarn; If you observed it uses huge mount of mem, it may indicate the configuration is incorrect or the cube design got problem. Without detail information we couldn't judge what's wrong in your

Re: How to change kylin execution engine from Mapreduce to Tez

2017-04-28 Thread ShaoFeng Shi
Hi Suresh, Tez isn't supported in Kylin; From 2.0 there is the Spark engine, please check Kylin's document. Kylin uses MR as the default framework, it is quite stable and the performance is also acceptable. If you observed unexpected slow, suggest you check your environment and the cube design.

How to change kylin execution engine from Mapreduce to Tez

2017-04-28 Thread suresh m
Hi, I can see here my kylin job executing threw Mapreduce, i think this is one of the reason for taking more time to build cube. Is there any chance to change execution engine as Tez. Attaching screen shot for reference.

cube building with huge memory, for 5000 records 2.3GB

2017-04-28 Thread suresh m
Hi, My kylin cube taking huge memory just for few records. Even i changed compression property as Snappy but still occupying huge memory. Attaching screenshot for your reference. Suggestions are welcome to reduce cube size. Regards, Suresh

Re: cube building taking 8 hours just for 6 thousands records

2017-04-28 Thread suresh m
Hi Thanks for your timely reply. I set kylin.cube.algorithm=layer , but still facing same issue. Please let me know any other tuning to improve performance. Regards, Suresh On Tue, Apr 18, 2017 at 7:23 PM, Li Yang wrote: > > #24 Step Name: Build Cube > > It is in-mem cubing taking effect and

??????????: ??????????: Error while executing SQL "select count(*) as nums,courseid from optionaction group by courseid LIMIT 50000": null

2017-04-28 Thread 35925138
?? 2017-04-28 15:22:09,556 DEBUG [Query 505b4b6f-467d-45fd-9c92-c301678875af-76] plan.RelOptPlanner:856 : Cheapest plan: OLAPToEnumerableConverter: rowcount = 10.0, cumulative cost = {1.0E100 rows, 12.55 cpu, 0.0 io}, id = 77 OLAPLimitRel(fetch=[5]): ro

[jira] [Created] (KYLIN-2577) Improve hive&mr job configuration

2017-04-28 Thread Wang Cheng (JIRA)
Wang Cheng created KYLIN-2577: - Summary: Improve hive&mr job configuration Key: KYLIN-2577 URL: https://issues.apache.org/jira/browse/KYLIN-2577 Project: Kylin Issue Type: Bug Reporte

Re: [VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-28 Thread hongbin ma
+1 mvn test passed mvn integration test passed On Thu, Apr 27, 2017 at 8:38 AM, 《秦殇》!健 wrote: > +1 > It's great!!! > -- 原始邮件 -- > 发件人: "Li Yang";; > 发送时间: 2017年4月27日(星期四) 上午7:22 > 收件人: "dev"; > > 主题: [VOTE] Release apache-kylin-2.0.0 (RC3) > > > > Hi all, > > I h

[jira] [Created] (KYLIN-2576) kylin-classpath/logs:permission denied

2017-04-28 Thread james (JIRA)
james created KYLIN-2576: Summary: kylin-classpath/logs:permission denied Key: KYLIN-2576 URL: https://issues.apache.org/jira/browse/KYLIN-2576 Project: Kylin Issue Type: Improvement Repo

[jira] [Created] (KYLIN-2575) Experimental feature: Computed Column

2017-04-28 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2575: - Summary: Experimental feature: Computed Column Key: KYLIN-2575 URL: https://issues.apache.org/jira/browse/KYLIN-2575 Project: Kylin Issue Type: New Feature