[jira] [Assigned] (KYLIN-3025) kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI reassigned KYLIN-3025:
---

Assignee: Chao Long

> kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4
> ---
>
> Key: KYLIN-3025
> URL: https://issues.apache.org/jira/browse/KYLIN-3025
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - ODBC
>Affects Versions: v2.1.0
> Environment: Windows 10;kylin v2.2.0;tableau desktop 10.4;kylin odbc 
> v2.1.0
>Reporter: Hokyung Song
>Assignee: Chao Long
>Priority: Major
> Fix For: v2.5.0
>
>
> In Tableau Desktop version 9.3, also it works very well.
> but..when I use measure field (bigint type of data) in Tableau Desktop 
> version 10.4, it occured query error. (decimal type field works well.)
> I guess.. "{fn CONVERT}" function couldn't parsed. please support tableau 
> 10.4 :)
> Detailed query example from tableau:
> {code}
> SELECT "MOMENT"."P_DT" AS "P_DT",
>   SUM({fn CONVERT("MOMENT"."ACTIONCOUNT", SQL_BIGINT)}) AS 
> "sum_ACTIONCOUNT_ok"
> FROM "TEST"."MOMENT" "MOMENT"
> GROUP BY "MOMENT"."P_DT"
> {code}
> 
> environment
> 
> * kylin server : v2.2.0
> * kylin odbc (for windows client) : v2.1.0
> * tableau desktop : 10.4
> * client os : windows 10 (64bit)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-2899) Enable segment level query cache

2018-06-25 Thread Shaofeng SHI (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523239#comment-16523239
 ] 

Shaofeng SHI commented on KYLIN-2899:
-

Gang, thanks for the info. I will take a look.

> Enable segment level query cache
> 
>
> Key: KYLIN-2899
> URL: https://issues.apache.org/jira/browse/KYLIN-2899
> Project: Kylin
>  Issue Type: Sub-task
>  Components: Query Engine
>Affects Versions: v2.1.0
>Reporter: Zhong Yanghong
>Assignee: Ma Gang
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3421) Improve job scheduler fetch performance

2018-06-25 Thread Zhong Yanghong (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523069#comment-16523069
 ] 

Zhong Yanghong commented on KYLIN-3421:
---

Thanks [~Shaofengshi], since it's not included in 2.4.0, it has been applied to 
the master branch and will be included in 2.5.0.

> Improve job scheduler fetch performance
> ---
>
> Key: KYLIN-3421
> URL: https://issues.apache.org/jira/browse/KYLIN-3421
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v2.5.0
>
> Attachments: APACHE-KYLIN-3421.patch
>
>
> Currently, there are several improvements we can do for job scheduler:
> * For {{DistributedScheduler}}, it does not check {{isReady()}} for 
> checkpoint jobs
> * Since the state lots of executables fetched from HBase are not READY, it's 
> better to fetch their output first, which can reduce lots of get requests to 
> hbase
> * {{FetcherRunnerWithPriority}} is not enabled in {{DistributedScheduler}}, 
> which needs to change the lockPath from *{color:#f79232}segmentId{color}* to 
> *{color:#f79232}jobId{color}*



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3420) common sql query fail on kylin web ui

2018-06-25 Thread Shuangyin Ge (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523068#comment-16523068
 ] 

Shuangyin Ge commented on KYLIN-3420:
-

Could there by some unseen characters or unexpected trailing spaces in your SQL?

Such questions should go [to 
u...@kylin.apache.org|mailto:to%c2%a0u...@kylin.apache.org] instead of JIRA.

> common sql query fail on kylin web ui
> -
>
> Key: KYLIN-3420
> URL: https://issues.apache.org/jira/browse/KYLIN-3420
> Project: Kylin
>  Issue Type: Bug
>  Components: Query Engine
>Affects Versions: v2.3.1
> Environment: debian
>Reporter: ZoneYang
>Priority: Critical
>  Labels: bug
> Attachments: Clip(06-19-14-57-34).png, Clip(06-19-14-58-36).png
>
>
> kylin version:2.3.1
> sql:
> SELECT "COUNTRY",
> "LATITUDE",
> "LONGITUDE",
> "NAME" 
> FROM DEFAULT.KYLIN_COUNTRY
> LIMIT 10
>  
> when i execute this sql, kylin web ui will tell me fail



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3421) Improve job scheduler fetch performance

2018-06-25 Thread Zhong Yanghong (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhong Yanghong updated KYLIN-3421:
--
Fix Version/s: v2.5.0

> Improve job scheduler fetch performance
> ---
>
> Key: KYLIN-3421
> URL: https://issues.apache.org/jira/browse/KYLIN-3421
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Fix For: v2.5.0
>
> Attachments: APACHE-KYLIN-3421.patch
>
>
> Currently, there are several improvements we can do for job scheduler:
> * For {{DistributedScheduler}}, it does not check {{isReady()}} for 
> checkpoint jobs
> * Since the state lots of executables fetched from HBase are not READY, it's 
> better to fetch their output first, which can reduce lots of get requests to 
> hbase
> * {{FetcherRunnerWithPriority}} is not enabled in {{DistributedScheduler}}, 
> which needs to change the lockPath from *{color:#f79232}segmentId{color}* to 
> *{color:#f79232}jobId{color}*



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3426) visualization charts were not showing up in the insight page

2018-06-25 Thread Jayaraj (JIRA)
Jayaraj created KYLIN-3426:
--

 Summary: visualization charts were not showing up in the insight 
page
 Key: KYLIN-3426
 URL: https://issues.apache.org/jira/browse/KYLIN-3426
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Affects Versions: v2.3.1
Reporter: Jayaraj
 Attachments: visualization_missing.png

created model and cube in kylin using sample dataset. In insight tab, able to 
query the cubes, but all the visualization charts were not showing up for the 
query result. Please find the attached screen shot and suggest on this.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3421) Improve job scheduler fetch performance

2018-06-25 Thread Shaofeng SHI (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522301#comment-16522301
 ] 

Shaofeng SHI commented on KYLIN-3421:
-

[~yaho] please set "fixed version" properly, otherwise we won't know which 
release includes it.

> Improve job scheduler fetch performance
> ---
>
> Key: KYLIN-3421
> URL: https://issues.apache.org/jira/browse/KYLIN-3421
> Project: Kylin
>  Issue Type: Improvement
>  Components: Job Engine
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
> Attachments: APACHE-KYLIN-3421.patch
>
>
> Currently, there are several improvements we can do for job scheduler:
> * For {{DistributedScheduler}}, it does not check {{isReady()}} for 
> checkpoint jobs
> * Since the state lots of executables fetched from HBase are not READY, it's 
> better to fetch their output first, which can reduce lots of get requests to 
> hbase
> * {{FetcherRunnerWithPriority}} is not enabled in {{DistributedScheduler}}, 
> which needs to change the lockPath from *{color:#f79232}segmentId{color}* to 
> *{color:#f79232}jobId{color}*



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (KYLIN-3282) hbase timeout cause the endless status.

2018-06-25 Thread Xingxing Di (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521957#comment-16521957
 ] 

Xingxing Di edited comment on KYLIN-3282 at 6/25/18 7:58 AM:
-

Hi Shaofeng, now I can't find the error log which cause job disappeared,  but i 
saw a few "Overwriting conflict "  error  logs like the origin post by 
readme_kylin.  

 
{code:java}
2018-06-10 19:34:51,044 ERROR [Scheduler 372961027 Job 
39a3698c-c961-456d-a655-3a9c5f8dc188-2194] common.MapReduceExecutable:195 : 
error execute Map
ReduceExecutable{id=39a3698c-c961-456d-a655-3a9c5f8dc188-15, name=Convert 
Cuboid Data to HFile, state=RUNNING}
java.lang.IllegalStateException: Overwriting conflict 
/execute_output/39a3698c-c961-456d-a655-3a9c5f8dc188-15, expect old TS 
1528630470288, but it i
s 1528630481128
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:316)
at 
org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:294)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:280)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:260)
at 
org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:104)
at 
org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:218)
at 
org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:470)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:160)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
{code}


was (Author: dixingx...@yeah.net):
Hi Shaofeng, now I can't find the error log cause job disappeared,  but i saw 
few "Overwriting conflict "  error  logs like the origin post by readme_kylin.  

 
{code:java}

2018-06-10 19:34:51,044 ERROR [Scheduler 372961027 Job 
39a3698c-c961-456d-a655-3a9c5f8dc188-2194] common.MapReduceExecutable:195 : 
error execute Map
ReduceExecutable{id=39a3698c-c961-456d-a655-3a9c5f8dc188-15, name=Convert 
Cuboid Data to HFile, state=RUNNING}
java.lang.IllegalStateException: Overwriting conflict 
/execute_output/39a3698c-c961-456d-a655-3a9c5f8dc188-15, expect old TS 
1528630470288, but it i
s 1528630481128
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:316)
at 
org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:294)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:280)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:260)
at 
org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:104)
at 
org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:218)
at 
org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:470)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:160)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
{code}

> hbase timeout cause the endless status.
> ---
>
> Key: KYLIN-3282
> URL: https://issues.apache.org/jira/browse/KYLIN-3282
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Affects Versions: v2.3.0
>Reporter: readme_kylin
>Priority: Major
>
> ri Mar 09 12:52:07 GMT+08:00 2018, 
> RpcRetryingCaller\{globalStartTime=1520571112216, pause=100, retries=1}, 
> java.io.IOException: Call to QZ140/10.0.0.140:16020 failed on local 
> exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=8030361, 
> waitTime=15002, operationTimeout=15000 expired.
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:157)
>  at 

[jira] [Commented] (KYLIN-3282) hbase timeout cause the endless status.

2018-06-25 Thread Xingxing Di (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521957#comment-16521957
 ] 

Xingxing Di commented on KYLIN-3282:


Hi Shaofeng, now I can't find the error log cause job disappeared,  but i saw 
few "Overwriting conflict "  error  logs like the origin post by readme_kylin.  

 
{code:java}

2018-06-10 19:34:51,044 ERROR [Scheduler 372961027 Job 
39a3698c-c961-456d-a655-3a9c5f8dc188-2194] common.MapReduceExecutable:195 : 
error execute Map
ReduceExecutable{id=39a3698c-c961-456d-a655-3a9c5f8dc188-15, name=Convert 
Cuboid Data to HFile, state=RUNNING}
java.lang.IllegalStateException: Overwriting conflict 
/execute_output/39a3698c-c961-456d-a655-3a9c5f8dc188-15, expect old TS 
1528630470288, but it i
s 1528630481128
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:316)
at 
org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:294)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:280)
at 
org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:260)
at 
org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:104)
at 
org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:218)
at 
org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:470)
at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:160)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)
at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125)
at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:144)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
{code}

> hbase timeout cause the endless status.
> ---
>
> Key: KYLIN-3282
> URL: https://issues.apache.org/jira/browse/KYLIN-3282
> Project: Kylin
>  Issue Type: Bug
>  Components: Job Engine
>Affects Versions: v2.3.0
>Reporter: readme_kylin
>Priority: Major
>
> ri Mar 09 12:52:07 GMT+08:00 2018, 
> RpcRetryingCaller\{globalStartTime=1520571112216, pause=100, retries=1}, 
> java.io.IOException: Call to QZ140/10.0.0.140:16020 failed on local 
> exception: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=8030361, 
> waitTime=15002, operationTimeout=15000 expired.
> at 
> org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:157)
>  at org.apache.hadoop.hbase.client.HTable.checkAndPut(HTable.java:1233)
>  at 
> org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:311)
>  at 
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:305)
>  at 
> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:291)
>  at 
> org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:271)
>  at 
> org.apache.kylin.job.dao.ExecutableDao.writeJobOutputResource(ExecutableDao.java:88)
>  at 
> org.apache.kylin.job.dao.ExecutableDao.updateJobOutput(ExecutableDao.java:216)
>  at 
> org.apache.kylin.job.execution.ExecutableManager.addJobInfo(ExecutableManager.java:480)
>  at 
> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:161)
>  at 
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162)
>  at 
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:67)
>  at 
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:162)
>  at 
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:300)
>  at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>  at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>  at java.lang.Thread.run(Thread.java:745)
>  
>  
> 2018-03-09 12:52:10,191 ERROR [Scheduler 9772827 Job 
> 499477a7-4c1a-4c5a-8d4a-0b3218a58dca-516] execution.AbstractExecutable:100 : 
> 1th retries for onExecuteFinished fails due to {}
> java.lang.IllegalStateException: Overwriting conflict 
> /execute_output/499477a7-4c1a-4c5a-8d4a-0b3218a58dca-13, expect old TS 
> 1520571099067, but it is 1520571112216
>  at 
> org.apache.kylin.storage.hbase.HBaseResourceStore.checkAndPutResourceImpl(HBaseResourceStore.java:316)
>  at 
> 

[jira] [Assigned] (KYLIN-2554) Update Chinese docs to latest kylin

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI reassigned KYLIN-2554:
---

Assignee: 翟娜  (was: nichunen)

Zhai na is working on this.

> Update Chinese docs to latest kylin
> ---
>
> Key: KYLIN-2554
> URL: https://issues.apache.org/jira/browse/KYLIN-2554
> Project: Kylin
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: nichunen
>Assignee: 翟娜
>Priority: Major
> Fix For: v2.4.0
>
>
> Currently, Chinese docs of kylin are out of date, this may confuse users, 
> need to be updated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-2554) Update Chinese docs to latest kylin

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-2554:

Affects Version/s: (was: v1.6.0)
Fix Version/s: (was: Future)
   v2.4.0

> Update Chinese docs to latest kylin
> ---
>
> Key: KYLIN-2554
> URL: https://issues.apache.org/jira/browse/KYLIN-2554
> Project: Kylin
>  Issue Type: Improvement
>  Components: Documentation
>Reporter: nichunen
>Assignee: nichunen
>Priority: Major
> Fix For: v2.4.0
>
>
> Currently, Chinese docs of kylin are out of date, this may confuse users, 
> need to be updated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (KYLIN-3229) Update tutorial for 2.3 release

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI closed KYLIN-3229.
---
Resolution: Fixed

> Update tutorial for 2.3 release
> ---
>
> Key: KYLIN-3229
> URL: https://issues.apache.org/jira/browse/KYLIN-3229
> Project: Kylin
>  Issue Type: Sub-task
>  Components: Documentation
>Reporter: Shaofeng SHI
>Assignee: Shaofeng SHI
>Priority: Major
>
> The step by step tutorial on kylin website is out of date. Need be updated 
> together with the release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (KYLIN-3027) Upgrade Jackson version

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI closed KYLIN-3027.
---
Resolution: Fixed

Updated to 2.9.5 in KYLIN-3372

> Upgrade Jackson version
> ---
>
> Key: KYLIN-3027
> URL: https://issues.apache.org/jira/browse/KYLIN-3027
> Project: Kylin
>  Issue Type: Bug
>Reporter: peng.jianhua
>Assignee: peng.jianhua
>Priority: Major
>
> *【Security Vulnerability Alert】 Jackson-databind deserialization 
> vulnerability*
> CVE ID:
> {code}
> CVE-2017-7525
> CVE-2017-15095
> {code}
> Description
> {code}
> CVE-2017-7525 is prone to a remote-code execution vulnerability. 
> Successfully exploiting this issue allows attackers to execute arbitrary code 
> in the context of the affected application. Failed exploits will result in 
> denial-of-service conditions.
> CVE-2017-15095 describes more deserialization exploits for jackson-databind 
> as a follow-up to CVE-2017-7525
> {code}
> Scope
> {code}
> Jackson version <= 2.9.2
> {code}
> Solution
> {code}
> Jackson official is about to release a new version to solve the problem
> {code}
> Reference
> {code}
> https://github.com/FasterXML/jackson-databind/releases
> http://www.openwall.com/lists/oss-security/2017/11/02/3
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (KYLIN-1511) model SelectedColumnMeta cannot be parsed by Jackson

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI closed KYLIN-1511.
---
Resolution: Invalid

> model SelectedColumnMeta cannot be parsed by Jackson
> 
>
> Key: KYLIN-1511
> URL: https://issues.apache.org/jira/browse/KYLIN-1511
> Project: Kylin
>  Issue Type: Bug
>  Components: REST Service
>Affects Versions: v1.4.0
>Reporter: Lola Liu
>Assignee: liyang
>Priority: Major
>
> class SelectedColumnMeta is immutable and doesn’t have a default constructor.
> When trying to deserialize a JSON String to SelectedColumnMeta an Exception 
> “JsonMappingException: No suitable constructor found” is thrown.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-2998) Kill spark app when cube job was discarded

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-2998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-2998:

Fix Version/s: v2.5.0

> Kill spark app when cube job was discarded
> --
>
> Key: KYLIN-2998
> URL: https://issues.apache.org/jira/browse/KYLIN-2998
> Project: Kylin
>  Issue Type: Improvement
>  Components: Spark Engine
>Affects Versions: v2.1.0
>Reporter: kangkaisen
>Assignee: kangkaisen
>Priority: Major
> Fix For: v2.5.0
>
>
> Currently, when we discard spark job, the spark job will still running, and 
> when we restart JobServer, the SparkExecutable will submit a new spark job. 
> we should handle spark job as mr job.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3025) kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4

2018-06-25 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521933#comment-16521933
 ] 

ASF GitHub Bot commented on KYLIN-3025:
---

asfgit commented on issue #158: KYLIN-3025 fix error: {fn CONVERT} for bigint 
type in tableau 10.4
URL: https://github.com/apache/kylin/pull/158#issuecomment-399852166
 
 
   Can one of the admins verify this patch?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4
> ---
>
> Key: KYLIN-3025
> URL: https://issues.apache.org/jira/browse/KYLIN-3025
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - ODBC
>Affects Versions: v2.1.0
> Environment: Windows 10;kylin v2.2.0;tableau desktop 10.4;kylin odbc 
> v2.1.0
>Reporter: Hokyung Song
>Priority: Major
> Fix For: v2.5.0
>
>
> In Tableau Desktop version 9.3, also it works very well.
> but..when I use measure field (bigint type of data) in Tableau Desktop 
> version 10.4, it occured query error. (decimal type field works well.)
> I guess.. "{fn CONVERT}" function couldn't parsed. please support tableau 
> 10.4 :)
> Detailed query example from tableau:
> {code}
> SELECT "MOMENT"."P_DT" AS "P_DT",
>   SUM({fn CONVERT("MOMENT"."ACTIONCOUNT", SQL_BIGINT)}) AS 
> "sum_ACTIONCOUNT_ok"
> FROM "TEST"."MOMENT" "MOMENT"
> GROUP BY "MOMENT"."P_DT"
> {code}
> 
> environment
> 
> * kylin server : v2.2.0
> * kylin odbc (for windows client) : v2.1.0
> * tableau desktop : 10.4
> * client os : windows 10 (64bit)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3025) kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4

2018-06-25 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521920#comment-16521920
 ] 

ASF GitHub Bot commented on KYLIN-3025:
---

codecov-io commented on issue #158: KYLIN-3025 fix error: {fn CONVERT} for 
bigint type in tableau 10.4
URL: https://github.com/apache/kylin/pull/158#issuecomment-399850733
 
 
   # [Codecov](https://codecov.io/gh/apache/kylin/pull/158?src=pr=h1) Report
   > Merging [#158](https://codecov.io/gh/apache/kylin/pull/158?src=pr=desc) 
into 
[master](https://codecov.io/gh/apache/kylin/commit/5a089adcae55a5fb5333f4e8f527ae05cca3e0d7?src=pr=desc)
 will **increase** coverage by `0.01%`.
   > The diff coverage is `n/a`.
   
   [![Impacted file tree 
graph](https://codecov.io/gh/apache/kylin/pull/158/graphs/tree.svg?height=150=650=JawVgbgsVo=pr)](https://codecov.io/gh/apache/kylin/pull/158?src=pr=tree)
   
   ```diff
   @@ Coverage Diff  @@
   ## master #158  +/-   ##
   
   + Coverage 22.44%   22.45%   +0.01% 
   - Complexity 4153 4155   +2 
   
 Files  1034 1034  
 Lines 6217962179  
 Branches   8907 8907  
   
   + Hits  1395313961   +8 
   + Misses4690346899   -4 
   + Partials   1323 1319   -4
   ```
   
   
   | [Impacted 
Files](https://codecov.io/gh/apache/kylin/pull/158?src=pr=tree) | Coverage Δ 
| Complexity Δ | |
   |---|---|---|---|
   | 
[...ache/kylin/query/util/DefaultQueryTransformer.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-cXVlcnkvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2t5bGluL3F1ZXJ5L3V0aWwvRGVmYXVsdFF1ZXJ5VHJhbnNmb3JtZXIuamF2YQ==)
 | `80.76% <ø> (ø)` | `7 <0> (ø)` | :arrow_down: |
   | 
[...rg/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2lubWVtY3ViaW5nL01lbURpc2tTdG9yZS5qYXZh)
 | `69.6% <0%> (-0.61%)` | `7% <0%> (ø)` | |
   | 
[...a/org/apache/kylin/dict/Number2BytesConverter.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L051bWJlcjJCeXRlc0NvbnZlcnRlci5qYXZh)
 | `82.53% <0%> (+0.79%)` | `18% <0%> (+1%)` | :arrow_up: |
   | 
[...g/apache/kylin/metadata/cachesync/Broadcaster.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vbWV0YWRhdGEvY2FjaGVzeW5jL0Jyb2FkY2FzdGVyLmphdmE=)
 | `52.73% <0%> (+0.99%)` | `22% <0%> (ø)` | :arrow_down: |
   | 
[...g/apache/kylin/source/datagen/ColumnGenerator.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1tZXRhZGF0YS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUva3lsaW4vc291cmNlL2RhdGFnZW4vQ29sdW1uR2VuZXJhdG9yLmphdmE=)
 | `72.29% <0%> (+1.35%)` | `8% <0%> (ø)` | :arrow_down: |
   | 
[.../apache/kylin/cube/cuboid/TreeCuboidScheduler.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1jdWJlL3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9jdWJlL2N1Ym9pZC9UcmVlQ3Vib2lkU2NoZWR1bGVyLmphdmE=)
 | `66.15% <0%> (+2.3%)` | `0% <0%> (ø)` | :arrow_down: |
   | 
[...he/kylin/dict/lookup/cache/RocksDBLookupTable.java](https://codecov.io/gh/apache/kylin/pull/158/diff?src=pr=tree#diff-Y29yZS1kaWN0aW9uYXJ5L3NyYy9tYWluL2phdmEvb3JnL2FwYWNoZS9reWxpbi9kaWN0L2xvb2t1cC9jYWNoZS9Sb2Nrc0RCTG9va3VwVGFibGUuamF2YQ==)
 | `78.37% <0%> (+5.4%)` | `6% <0%> (+1%)` | :arrow_up: |
   
   --
   
   [Continue to review full report at 
Codecov](https://codecov.io/gh/apache/kylin/pull/158?src=pr=continue).
   > **Legend** - [Click here to learn 
more](https://docs.codecov.io/docs/codecov-delta)
   > `Δ = absolute  (impact)`, `ø = not affected`, `? = missing data`
   > Powered by 
[Codecov](https://codecov.io/gh/apache/kylin/pull/158?src=pr=footer). Last 
update 
[5a089ad...050d242](https://codecov.io/gh/apache/kylin/pull/158?src=pr=lastupdated).
 Read the [comment docs](https://docs.codecov.io/docs/pull-request-comments).
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4
> ---
>
> Key: KYLIN-3025
> URL: https://issues.apache.org/jira/browse/KYLIN-3025
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - ODBC
>Affects 

[jira] [Commented] (KYLIN-3025) kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4

2018-06-25 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521917#comment-16521917
 ] 

ASF GitHub Bot commented on KYLIN-3025:
---

coveralls commented on issue #158: KYLIN-3025 fix error: {fn CONVERT} for 
bigint type in tableau 10.4
URL: https://github.com/apache/kylin/pull/158#issuecomment-399850460
 
 
   ## Pull Request Test Coverage Report for [Build 
3271](https://coveralls.io/builds/17668835)
   
   * **0** of **0**   changed or added relevant lines in **0** files are 
covered.
   * **1** unchanged line in **1** file lost coverage.
   * Overall coverage increased (+**0.006%**) to **24.577%**
   
   ---
   
   
   |  Files with Coverage Reduction | New Missed Lines | % |
   | :-|--|--: |
   | 
[core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/17668835/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L553)
 | 1 | 78.12% |
   
   
   |  Totals | [![Coverage 
Status](https://coveralls.io/builds/17668835/badge)](https://coveralls.io/builds/17668835)
 |
   | :-- | --: |
   | Change from base [Build 3270](https://coveralls.io/builds/17665950): |  
0.006% |
   | Covered Lines: | 15282 |
   | Relevant Lines: | 62179 |
   
   ---
   #   - [Coveralls](https://coveralls.io)
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4
> ---
>
> Key: KYLIN-3025
> URL: https://issues.apache.org/jira/browse/KYLIN-3025
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - ODBC
>Affects Versions: v2.1.0
> Environment: Windows 10;kylin v2.2.0;tableau desktop 10.4;kylin odbc 
> v2.1.0
>Reporter: Hokyung Song
>Priority: Major
> Fix For: v2.5.0
>
>
> In Tableau Desktop version 9.3, also it works very well.
> but..when I use measure field (bigint type of data) in Tableau Desktop 
> version 10.4, it occured query error. (decimal type field works well.)
> I guess.. "{fn CONVERT}" function couldn't parsed. please support tableau 
> 10.4 :)
> Detailed query example from tableau:
> {code}
> SELECT "MOMENT"."P_DT" AS "P_DT",
>   SUM({fn CONVERT("MOMENT"."ACTIONCOUNT", SQL_BIGINT)}) AS 
> "sum_ACTIONCOUNT_ok"
> FROM "TEST"."MOMENT" "MOMENT"
> GROUP BY "MOMENT"."P_DT"
> {code}
> 
> environment
> 
> * kylin server : v2.2.0
> * kylin odbc (for windows client) : v2.1.0
> * tableau desktop : 10.4
> * client os : windows 10 (64bit)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (KYLIN-3425) Kylin v2.3.2 Release

2018-06-25 Thread kangkaisen (JIRA)
kangkaisen created KYLIN-3425:
-

 Summary: Kylin v2.3.2 Release
 Key: KYLIN-3425
 URL: https://issues.apache.org/jira/browse/KYLIN-3425
 Project: Kylin
  Issue Type: Task
Reporter: kangkaisen
Assignee: kangkaisen
 Fix For: v2.3.2






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Closed] (KYLIN-3180) kylin Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.session

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI closed KYLIN-3180.
---
Resolution: Incomplete

> kylin Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.hive.ql.session
> 
>
> Key: KYLIN-3180
> URL: https://issues.apache.org/jira/browse/KYLIN-3180
> Project: Kylin
>  Issue Type: Bug
>  Components: Tools, Build and Test
>Affects Versions: v2.2.0
> Environment: aws emr 5.8
>Reporter: cuicui
>Assignee:  Kaige Liu
>Priority: Major
> Fix For: Future
>
>
> hello
> when I install kylin2.2 version on emr 5.8 successfully ,but when I build 
> example cube in step2 occurred such problems 
> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.session
> I have checked my local environments hive dependence jar is avaliable and 
> hbase is also right
> whether exist same place I configured not right ,please help me found out 
> ,thanks for your helping
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (KYLIN-3094) Upgrade zookeeper to 3.4.12

2018-06-25 Thread Shaofeng SHI (JIRA)


 [ 
https://issues.apache.org/jira/browse/KYLIN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shaofeng SHI updated KYLIN-3094:

Fix Version/s: v2.5.0

> Upgrade zookeeper to 3.4.12
> ---
>
> Key: KYLIN-3094
> URL: https://issues.apache.org/jira/browse/KYLIN-3094
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Ted Yu
>Assignee: nichunen
>Priority: Minor
> Fix For: v2.5.0
>
>
> Current zookeeper release is 3.4.12
> We should upgrade dependency from 3.4.8 to 3.4.12 where there is important 
> security fix.
> One such critical fix is ZOOKEEPER-2146, which can be explored maliciously



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (KYLIN-3025) kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4

2018-06-25 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/KYLIN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16521899#comment-16521899
 ] 

ASF GitHub Bot commented on KYLIN-3025:
---

Wayne1c opened a new pull request #158: KYLIN-3025 fix error: {fn CONVERT} for 
bigint type in tableau 10.4
URL: https://github.com/apache/kylin/pull/158
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> kylin odbc error : {fn CONVERT} for bigint type in tableau 10.4
> ---
>
> Key: KYLIN-3025
> URL: https://issues.apache.org/jira/browse/KYLIN-3025
> Project: Kylin
>  Issue Type: Bug
>  Components: Driver - ODBC
>Affects Versions: v2.1.0
> Environment: Windows 10;kylin v2.2.0;tableau desktop 10.4;kylin odbc 
> v2.1.0
>Reporter: Hokyung Song
>Priority: Major
> Fix For: v2.5.0
>
>
> In Tableau Desktop version 9.3, also it works very well.
> but..when I use measure field (bigint type of data) in Tableau Desktop 
> version 10.4, it occured query error. (decimal type field works well.)
> I guess.. "{fn CONVERT}" function couldn't parsed. please support tableau 
> 10.4 :)
> Detailed query example from tableau:
> {code}
> SELECT "MOMENT"."P_DT" AS "P_DT",
>   SUM({fn CONVERT("MOMENT"."ACTIONCOUNT", SQL_BIGINT)}) AS 
> "sum_ACTIONCOUNT_ok"
> FROM "TEST"."MOMENT" "MOMENT"
> GROUP BY "MOMENT"."P_DT"
> {code}
> 
> environment
> 
> * kylin server : v2.2.0
> * kylin odbc (for windows client) : v2.1.0
> * tableau desktop : 10.4
> * client os : windows 10 (64bit)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)