Re:Re: [DISCUSS] New Kylin Streaming Solution From eBay

2018-10-31 Thread Ma Gang
Thanks Xiaoxiang, Very good questions! Please see my comments started with [Gang]: 1. Is it possible to use Yarn as cluster manager for index task. Coordinator process will set up them at specificed period. [Gang] I think it is possible, but in current design, the indexing task is design

[jira] [Created] (KYLIN-3661) query return inconsistent result

2018-10-31 Thread wangxianbin (JIRA)
wangxianbin created KYLIN-3661: -- Summary: query return inconsistent result Key: KYLIN-3661 URL: https://issues.apache.org/jira/browse/KYLIN-3661 Project: Kylin Issue Type: Bug Affects Versio

Re: [DISCUSS] New Kylin Streaming Solution From eBay

2018-10-31 Thread Xiaoxiang Yu
Hi gang, I am so glad to know that eBay has a solution for realtime olap on kylin. I have some small question: 1. Is it possible to use Yarn as cluster manager for index task. Coordinator process will set up them at specificed period. Yarn will manage : a) retry these task if some f

[jira] [Created] (KYLIN-3660) subquery, join wiht two cube return No Result

2018-10-31 Thread jiahua.hu (JIRA)
jiahua.hu created KYLIN-3660: Summary: subquery, join wiht two cube return No Result Key: KYLIN-3660 URL: https://issues.apache.org/jira/browse/KYLIN-3660 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-3659) The password to connect to RDBMS data source should be more confidential.

2018-10-31 Thread yujie.sun (JIRA)
yujie.sun created KYLIN-3659: Summary: The password to connect to RDBMS data source should be more confidential. Key: KYLIN-3659 URL: https://issues.apache.org/jira/browse/KYLIN-3659 Project: Kylin

Re: Kylin2.5不支持Hive2.x的SQL中的关键字识别

2018-10-31 Thread liuzhixin
Hi ShaoFeng Shi: I create a jira for the case. # Refer: https://issues.apache.org/jira/browse/KYLIN-3658 # Thank you for your help. Best Wishes. > 在 2018年10月31日,下午9:31,ShaoFeng Shi 写道: > > Hi zhixin, > > Thanks for letting us know this; Would you like to report a JIRA to Kylin? > Thank you! >

[jira] [Created] (KYLIN-3657) sql length over 64 KB cause query fail

2018-10-31 Thread wangxianbin (JIRA)
wangxianbin created KYLIN-3657: -- Summary: sql length over 64 KB cause query fail Key: KYLIN-3657 URL: https://issues.apache.org/jira/browse/KYLIN-3657 Project: Kylin Issue Type: Bug Co

[jira] [Created] (KYLIN-3658) The keywords of Hive are not supported By Kylin

2018-10-31 Thread liuzhixin (JIRA)
liuzhixin created KYLIN-3658: Summary: The keywords of Hive are not supported By Kylin Key: KYLIN-3658 URL: https://issues.apache.org/jira/browse/KYLIN-3658 Project: Kylin Issue Type: Bug Aff

Re: 有关kylin在Hbase中生成的表的处理疑问

2018-10-31 Thread JiaTao Tao
This in FAQ may also help: http://kylin.apache.org/docs/gettingstarted/faq.html What kind of data be left in ‘kylin.env.hdfs-working-dir’ ? We often > execute kylin cleanup storage command, but now our working dir folder is > about 300 GB size, can we delete old data manually? > >- The dat

Re: Partition Column for Kylin

2018-10-31 Thread liuzhixin
Hi George Ni, Thank you for your answer! Best Wishes! > 在 2018年10月31日,下午9:45,George Ni 写道: > > As I know, partition column on separate columns is not supported yet. > > There is an issue: https://issues.apache.org/jira/browse/KYLIN-3650 > > I think dipesh is working on it. > > Best regard

Re: 有关kylin在Hbase中生成的表的处理疑问

2018-10-31 Thread Lijun Cao
Hi,杨冠军: This article may help you.http://kylin.apache.org/cn/docs/howto/howto_cleanup_storage.html Best Regards Lijun Cao > 在 2018年11月1日,09:02,杨冠军 写道: > > > 您好: > kylin构建完成后,会在hbase中产生很多文件,附件中为生成的文件截图,请问这些文件哪些可以删除? >谢谢! > > > 杨冠军 开发工程师 > champion.y...@kutesmart.com > 公司名称

有关kylin在Hbase中生成的表的处理疑问

2018-10-31 Thread 杨冠军
您好: kylin构建完成后,会在hbase中产生很多文件,附件中为生成的文件截图,请问这些文件哪些可以删除? 谢谢! | 杨冠军开发工程师 champion.y...@kutesmart.com 公司名称:青岛酷特智能股份有限公司 地址:即墨市红领大街17号 电话: 手机:15563907071 |

答复: APACHE KYLIN - Detect bad query

2018-10-31 Thread Na Zhai
Hi, Do you think that Kylin has too many output logs? In Kylin, BadQueryDetector will check bad query every 60 seconds(default). It cannot be closed. You can change the interval time of detecting by changing kylin.query.timeout-seconds-coefficient and kylin.query.timeout-seconds. Best wish

Re: Partition Column for Kylin

2018-10-31 Thread George Ni
As I know, partition column on separate columns is not supported yet. There is an issue: https://issues.apache.org/jira/browse/KYLIN-3650 I think dipesh is working on it. Best regards, Chun’en Ni(George) - 原始邮件 - 发件人: liuzhixin 收件人: dev@kylin.apache.org 抄送: 335960...@qq.com 已发送邮件: W

Re: Kylin2.5不支持Hive的SQL中的关键字识别

2018-10-31 Thread ShaoFeng Shi
Hi zhixin, Thanks for letting us know this; Would you like to report a JIRA to Kylin? Thank you! liuzhixin 于2018年10月31日周三 下午6:48写道: > Hi kylin team: > > Hive2.3 版本严格限制了SQL中的关键字使用,必须添加上反引号, 例如`date`。 > > 但是Kylin在访问Hive的时候,生成的SQL语句没有添加反引号``来约束SQL关键字,这会带来很多问题。 > > > Best wishes! -- Best regard

[jira] [Created] (KYLIN-3656) Improve HLLCounter performance

2018-10-31 Thread Chang chen (JIRA)
Chang chen created KYLIN-3656: - Summary: Improve HLLCounter performance Key: KYLIN-3656 URL: https://issues.apache.org/jira/browse/KYLIN-3656 Project: Kylin Issue Type: Improvement Affects Ve

Partition Column for Kylin

2018-10-31 Thread liuzhixin
Hi kylin team: If my hive table partitions are below: # PARTITIONED BY ( `` string, `mm` string, `dd` string, `re` string, `hh` string) # How can I set the partition Partition Date Column and Partition Time Column? Best wishes.

Kylin2.5不支持Hive的SQL中的关键字识别

2018-10-31 Thread liuzhixin
Hi kylin team: Hive2.3 版本严格限制了SQL中的关键字使用,必须添加上反引号, 例如`date`。 但是Kylin在访问Hive的时候,生成的SQL语句没有添加反引号``来约束SQL关键字,这会带来很多问题。 Best wishes!

Re:Re: Re: [DISCUSS] New Kylin Streaming Solution From eBay

2018-10-31 Thread Ma Gang
Hi ShaoFeng, Sorry I reply the wrong email, copy my reply here for further discussion :)Very good questions, please see my comments start with [Gang]:1) How to bridge the real-time cube with a cube built from Hive? You know, in Kylin the source type is marked at the table level, which means a tab

Re: Apache Kylin Meetup @Hangzhou 26 Oct

2018-10-31 Thread ShaoFeng Shi
Hi users, This meetup has been finished in last Friday; Now the slides are shared on the slidestalk.com for your reference: Apache Kylin 2.5 updates https://www.slidestalk.com/s/ApacheKylin25Updates66588 New Kylin Streaming in eBay https://www.slidestalk.com/s/NewKylinStreamingineBay69694 Table

[jira] [Created] (KYLIN-3655) Reinitialize CubeInstance when clear segments

2018-10-31 Thread Zhong Yanghong (JIRA)
Zhong Yanghong created KYLIN-3655: - Summary: Reinitialize CubeInstance when clear segments Key: KYLIN-3655 URL: https://issues.apache.org/jira/browse/KYLIN-3655 Project: Kylin Issue Type: Imp

Apache Kylin online tutorials

2018-10-31 Thread ShaoFeng Shi
Hello, Often the people ask whether Kylin has online tutorials for self-study. Actually, there are some; Here I list some for your reference: 1) Free Kylin tutorial (registration needed), from the core developers, in Chinese: https://www.chinahadoop.cn/search?q=kylin 2) A paid Kylin tutorial on

Re:Re: Re: [DISCUSS] Columnar storage engine for Apache Kylin

2018-10-31 Thread Ma Gang
Hi ShaoFeng, Very good questions, please see my comments start with [Gang]: 1) How to bridge the real-time cube with a cube built from Hive? You know, in Kylin the source type is marked at the table level, which means a table is either a Hive table, a JDBC table or a streaming table. To implement

Re: Re: [DISCUSS] New Kylin Streaming Solution From eBay

2018-10-31 Thread ShaoFeng Shi
Hi Gang, The real-time OLAP capability is pretty cool; I have a couple of questions here: 1) How to bridge the real-time cube with a cube built from Hive? You know, in Kylin the source type is marked at the table level, which means a table is either a Hive table, a JDBC table or a streaming table