[jira] [Commented] (KYLIN-2234) KYLIN throws null exception when execute specific query

2016-12-17 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15758372#comment-15758372
 ] 

liyang commented on KYLIN-2234:
---

Note master branch is ahead of 1.6.0.

> KYLIN throws null exception when execute specific query
> ---
>
> Key: KYLIN-2234
> URL: https://issues.apache.org/jira/browse/KYLIN-2234
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v1.5.3
>Reporter: Hao Lin
>Assignee: liyang
>
> KYLIN throws null pointer exception when executing a specify query. The query 
> tries to calculate VV ratio of condition A and condition B. For simplicity, a 
> minimum query is rewriten on ‘learn_kylin’ project and the condition is 
> removed, so it can be reproduced easily.
>  
> *Query*
> {code:xml}
> SELECT t1.PART_DT, SUM(t2.vv) / SUM(t1.vv) AS vv_rate
> FROM
> (
> SELECT  PART_DT, COUNT(1) as vv
> FROM KYLIN_SALES
> GROUP BY PART_DT
> ) AS t1
> JOIN
> (
> SELECT  PART_DT, COUNT(1) as vv
> FROM KYLIN_SALES
> GROUP BY PART_DT
> ) AS t2
> ON (t1.PART_DT = t2.PART_DT)
> GROUP BY t1.PART_DT
> {code}
>  
> *KYLIN Server LOG*
> {code}
> null
> at org.apache.calcite.avatica.Helper.createException(Helper.java:56)
> at org.apache.calcite.avatica.Helper.createException(Helper.java:41)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:143)
> at 
> org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:186)
> at 
> org.apache.kylin.rest.service.QueryService.execute(QueryService.java:366)
> at 
> org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:278)
> at 
> org.apache.kylin.rest.service.QueryService.query(QueryService.java:121)
> at 
> org.apache.kylin.rest.service.QueryService$$FastClassByCGLIB$$4957273f.invoke()
> …..
> Caused by: java.lang.NullPointerException
> at 
> org.apache.kylin.query.relnode.OLAPAggregateRel.translateAggregation(OLAPAggregateRel.java:268)
> at 
> org.apache.kylin.query.relnode.OLAPAggregateRel.implementRewrite(OLAPAggregateRel.java:240)
> at 
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:121)
> at 
> org.apache.kylin.query.relnode.OLAPProjectRel.implementRewrite(OLAPProjectRel.java:233)
> at 
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:121)
> at 
> org.apache.kylin.query.relnode.OLAPLimitRel.implementRewrite(OLAPLimitRel.java:101)
> at 
> org.apache.kylin.query.relnode.OLAPRel$RewriteImplementor.visitChild(OLAPRel.java:121)
> at 
> org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:95)
> at 
> org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:102)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (KYLIN-2280) A easier way to change all the conflict ports when start multi kylin instance in the same server

2016-12-17 Thread liyang (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

liyang updated KYLIN-2280:
--
Labels: newbie  (was: )

> A easier way to change all the conflict ports when start multi kylin instance 
> in the same server 
> -
>
> Key: KYLIN-2280
> URL: https://issues.apache.org/jira/browse/KYLIN-2280
> Project: Kylin
>  Issue Type: Improvement
>Reporter: XIE FAN
>Assignee: XIE FAN
>Priority: Minor
>  Labels: newbie
> Fix For: v1.6.1
>
>
> Sometimes we may want to start mutiple kylin instance in the same server. And 
> we need to modify serveral files to change all the conflict ports, which is 
> very inconvinent. So we need to find a easier to change all those ports in 
> one click.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (KYLIN-1043) Error when Start with Sample Cube:"NoSuchMethodError: org.apache.hadoop.mapreduce.Job.setJar"

2016-12-17 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15758344#comment-15758344
 ] 

liyang commented on KYLIN-1043:
---

> org.apache.hadoop.mapreduce.Job.setJar(Ljava/lang/String;)V

This is a very old interface, has been there for a long time. There must be 
some classpath issues in your env.

> Error when Start with Sample Cube:"NoSuchMethodError: 
> org.apache.hadoop.mapreduce.Job.setJar"
> -
>
> Key: KYLIN-1043
> URL: https://issues.apache.org/jira/browse/KYLIN-1043
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Affects Versions: v1.0
> Environment: TERM = xterm
> HBASE_CLASSPATH_PREFIX = 
> ./bin/../tomcat/bin/bootstrap.jar:./bin/../tomcat/bin/tomcat-juli.jar:./bin/../tomcat/lib/*:
> JAVA_HOME = /usr/lib/java-1.7.0
> HBASE_HOME = /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/lib/hbase/bin/..
> HBASE_ENV_INIT = true
> SSH_CLIENT = 10.17.129.130 19439 22
> MAIL = /var/spool/mail/root
> PWD = /usr/lib/hdh/kylin-1.0-incubating
> HOSTNAME = hdh172010037221
> CVS_RSH = ssh
> G_BROKEN_FILENAMES = 1
> NLSPATH = /usr/dt/lib/nls/msg/%L/%N.cat
> HBASE_REST_OPTS = 
> ZOOKEEPER_HOME = 
> /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/zookeeper
> HBASE_PID_DIR = /var/run/hbase
> HISTSIZE = 1000
> hive_dependency = 
> /opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/conf:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-service-0.13.1-cdh5.2.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/commons-httpclient-3.0.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-ant-0.13.1-cdh5.2.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hbase-protocol.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/mail-1.4.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-shims.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/jetty-all-7.6.0.v20120127.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/commons-lang3-3.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-shims-common.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/tempus-fugit-1.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-hwi-0.13.1-cdh5.2.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-metastore.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/stringtemplate-3.2.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/ST4-4.0.4.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/groovy-all-2.1.6.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-hbase-handler.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-beeline-0.13.1-cdh5.2.0.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-ant.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hbase-hadoop-compat.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/antlr-runtime-3.4.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-cli.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hbase-server.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-shims-0.23.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-beeline.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/bonecp-0.8.0.RELEASE.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hive-exec.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/datanucleus-rdbms-3.2.9.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/hbase-hadoop2-compat.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p0.36/bin/../lib/hive/lib/jta-1.1.jar:/opt/cloudera/parcels/CDH-5.2.0-1.cdh5.2.0.p

[jira] [Commented] (KYLIN-2279) suddenly query table does not exist in the Insight

2016-12-17 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15758322#comment-15758322
 ] 

liyang commented on KYLIN-2279:
---

Could you provide steps for others to reproduce this problem? Just from the 
description, other can do little.

>  suddenly query table does not exist in the Insight
> ---
>
> Key: KYLIN-2279
> URL: https://issues.apache.org/jira/browse/KYLIN-2279
> Project: Kylin
>  Issue Type: Bug
>Reporter: WangHaiyong
>
> One of my CUBE for a period of time, suddenly query table does not exist in 
> the Insight.
> To create a Cube also can not. Only to create the model to create a Cube, can 
> work normally.
> Excuse me, is what reason, how to avoid happening again?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (KYLIN-2273) Raise No new message comes issue for the Kylin1.6 Streaming cube build

2016-12-17 Thread liyang (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

liyang resolved KYLIN-2273.
---
Resolution: Not A Problem

> Raise No new message comes issue for the Kylin1.6 Streaming cube build 
> ---
>
> Key: KYLIN-2273
> URL: https://issues.apache.org/jira/browse/KYLIN-2273
> Project: Kylin
>  Issue Type: Bug
>  Components: Client - CLI
>Affects Versions: v1.6.0
> Environment: CDH5.8.0
> Kylin1.6
> Kafka_2.11-0.10.1.0 
>Reporter: QiLiFei
>Priority: Blocker
> Attachments: kylin.log, 捕获.PNG
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> When I commit the curl command to build my streaming cube , it will always 
> raise the below error . However , I'm sure that I set the correct value on 
> the properties sourceSoffsetStart and sourceOffsetEnd .And during this 
> process , I always keep the  KafkaSampleProducer running in the tutorial !!!  
> I tried to replace the 9223372036854775807 by 10 or another . However it 
> still failed to work correctly . I'm wondering why this happen even though I 
> follow the steps from the official 
> doc(http://kylin.apache.org/docs16/tutorial/cube_streaming.html).  Anything 
> wrong or missing for me ???
> Curl command :
> curl -X PUT --user ADMIN:KYLIN -H "Content-Type: 
> application/json;charset=utf-8" -d '{ "sourceOffsetStart": 0, 
> "sourceOffsetEnd": 9223372036854775807, "buildType": "BUILD"}' 
> http://172.31.10.171:7070/kylin/api/cubes/StreamingCubeDemo/build2
> Error:
>  java.lang.IllegalArgumentException: No new message comes, startOffset = 
> endOffset:0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (KYLIN-2273) Raise No new message comes issue for the Kylin1.6 Streaming cube build

2016-12-17 Thread liyang (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15758312#comment-15758312
 ] 

liyang commented on KYLIN-2273:
---

Please avoid due post, it is a waste of readers' time and is not polite.

Like I replied in the mail, the issue looks like inside HDFS configuration. 
Nothing to do with Kylin by looking at the stacktrace.

> Raise No new message comes issue for the Kylin1.6 Streaming cube build 
> ---
>
> Key: KYLIN-2273
> URL: https://issues.apache.org/jira/browse/KYLIN-2273
> Project: Kylin
>  Issue Type: Bug
>  Components: Client - CLI
>Affects Versions: v1.6.0
> Environment: CDH5.8.0
> Kylin1.6
> Kafka_2.11-0.10.1.0 
>Reporter: QiLiFei
>Priority: Blocker
> Attachments: kylin.log, 捕获.PNG
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> When I commit the curl command to build my streaming cube , it will always 
> raise the below error . However , I'm sure that I set the correct value on 
> the properties sourceSoffsetStart and sourceOffsetEnd .And during this 
> process , I always keep the  KafkaSampleProducer running in the tutorial !!!  
> I tried to replace the 9223372036854775807 by 10 or another . However it 
> still failed to work correctly . I'm wondering why this happen even though I 
> follow the steps from the official 
> doc(http://kylin.apache.org/docs16/tutorial/cube_streaming.html).  Anything 
> wrong or missing for me ???
> Curl command :
> curl -X PUT --user ADMIN:KYLIN -H "Content-Type: 
> application/json;charset=utf-8" -d '{ "sourceOffsetStart": 0, 
> "sourceOffsetEnd": 9223372036854775807, "buildType": "BUILD"}' 
> http://172.31.10.171:7070/kylin/api/cubes/StreamingCubeDemo/build2
> Error:
>  java.lang.IllegalArgumentException: No new message comes, startOffset = 
> endOffset:0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (KYLIN-2293) Refactor KylinConfig to separate test case into KylinTestConfig

2016-12-17 Thread Billy Liu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Billy Liu updated KYLIN-2293:
-
Attachment: KYLIN-2293.patch

Has moved all test hack code into KylinTestConfig

> Refactor KylinConfig to separate test case into KylinTestConfig 
> 
>
> Key: KYLIN-2293
> URL: https://issues.apache.org/jira/browse/KYLIN-2293
> Project: Kylin
>  Issue Type: Task
>  Components: Metadata
>Affects Versions: v1.6.0
>Reporter: Billy Liu
>Assignee: Billy Liu
>Priority: Minor
> Attachments: KYLIN-2293.patch
>
>
> Currently, here are some "For test" method exposed in KylinConfig, the 
> refactor would move all these "For test" methods into another Test related 
> class, to reduce the unnecessary APIs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (KYLIN-2293) Refactor KylinConfig to separate test case into KylinTestConfig

2016-12-17 Thread Billy Liu (JIRA)
Billy Liu created KYLIN-2293:


 Summary: Refactor KylinConfig to separate test case into 
KylinTestConfig 
 Key: KYLIN-2293
 URL: https://issues.apache.org/jira/browse/KYLIN-2293
 Project: Kylin
  Issue Type: Task
  Components: Metadata
Affects Versions: v1.6.0
Reporter: Billy Liu
Assignee: Billy Liu
Priority: Minor


Currently, here are some "For test" method exposed in KylinConfig, the refactor 
would move all these "For test" methods into another Test related class, to 
reduce the unnecessary APIs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)