Re: about kylin

2017-09-28 Thread Li Feng
HI Enjun, Kylin can’t ‘create’ Hive table,it syncstables from Hive. Pls refer to this link: http://kylin.apache.org/docs21/tutorial/web.html for how to sync tables. BR, Lee. 发件人: "enjun.zhu" <727865...@qq.com> 答复: "dev@kylin.apache.org" 日期: 2017年9月29日 星期五 14:24 至: dev 主题: about kylin 我有问

about kylin

2017-09-28 Thread enjun.zhu
hivekylinhive??... ...

[jira] [Created] (KYLIN-2916) NPE happens in testBPUSCalculator randomly

2017-09-28 Thread Wang Cheng (JIRA)
Wang Cheng created KYLIN-2916: - Summary: NPE happens in testBPUSCalculator randomly Key: KYLIN-2916 URL: https://issues.apache.org/jira/browse/KYLIN-2916 Project: Kylin Issue Type: Bug

Re:Re: Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread 崔苗
how about int column? Can I use a integer column in on cube both as dimension and distinct count? 在 2017-09-29 11:41:02,ShaoFeng Shi 写道: >Split that into two cubes: in one it acts as a dimension, in the other, it >acts as count distinct measure. > >2017-09-29 11:12 GMT+08:00 崔苗 : > >> if a column

[jira] [Created] (KYLIN-2915) Exception during query on lookup table

2017-09-28 Thread liyang (JIRA)
liyang created KYLIN-2915: - Summary: Exception during query on lookup table Key: KYLIN-2915 URL: https://issues.apache.org/jira/browse/KYLIN-2915 Project: Kylin Issue Type: Bug Reporter:

Re: Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
The issue is discussed in https://issues.apache.org/jira/browse/KYLIN-2679 2017-09-29 11:41 GMT+08:00 ShaoFeng Shi : > Split that into two cubes: in one it acts as a dimension, in the other, it > acts as count distinct measure. > > 2017-09-29 11:12 GMT+08:00 崔苗 : > >> if a column was used both a

Re: Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
Split that into two cubes: in one it acts as a dimension, in the other, it acts as count distinct measure. 2017-09-29 11:12 GMT+08:00 崔苗 : > if a column was used both as dimension and distinct count,what should be > use to encode ? > 在 2017-09-29 11:05:28,ShaoFeng Shi 写道: > >Use GD for dimensio

Re:Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread 崔苗
if a column was used both as dimension and distinct count,what should be use to encode ? 在 2017-09-29 11:05:28,ShaoFeng Shi 写道: >Use GD for dimension encoding will cause query inaccurate, that should be >avoided. > >Please use dict or fixed_length encoding for that column. > >2017-09-29 10:37 GM

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
Use GD for dimension encoding will cause query inaccurate, that should be avoided. Please use dict or fixed_length encoding for that column. 2017-09-29 10:37 GMT+08:00 柯南 : > Yes,I am careful to use GD. Could I have another way to instead of GD? > > > > > -- 原始邮件 ---

?????? A problem about Global Dictionary and cube merge

2017-09-28 Thread ????
Yes??I am careful to use GD. Could I have another way to instead of GD?? -- -- ??: "ShaoFeng Shi";; : 2017??9??29??(??) 9:41 ??: "dev"; : Re: A problem about Global Dictionary and cube merge I see; Did you use G

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
I see; Did you use GlobalDictionaryBuilder for a dimension column? The GD should only be used for count distinct measure, not suitable for dimension encoding. 2017-09-28 23:57 GMT+08:00 柯南 : > Thank you for your reply! > I know this command.But Because its segment could not be merged, even if >

Re: Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread ShaoFeng Shi
Yes it is possible, but the latest Kylin 2.1 version should be used. The previous version has a bug which will write big metadata file for cluster A's HDFS. 2017-09-28 22:03 GMT+08:00 cludezhu : > "hadoop cluster (A) env will be released " means deleting the cluster. > > after I delete the hadoo

?????? A problem about Global Dictionary and cube merge

2017-09-28 Thread ????
Thank you for your reply! I know this command.But Because its segment could not be merged, even if run this command ,the hbase tables could not be cleaned. -- -- ??: "ShaoFeng Shi";; : 2017??9??28??(??) 9:29 ??: "dev";

Re: Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread cludezhu
"hadoop cluster (A) env will be released "  means deleting the cluster.  after I delete the hadoop cluster, is that possible to keep a kylin query instance running just with the hbase cluster? thanks cludezhu On September 28, 2017 at 9:27:43 PM, ShaoFeng Shi (shaofeng...@apache.org) wrote: W

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
You need run this: https://kylin.apache.org/docs21/howto/howto_cleanup_storage.html 2017-09-28 20:40 GMT+08:00 柯南 : > hi,all: > Because of our yarn and hbase`s version limited,we deploy apache > kylin 1.6.0. For the correct result of 'count(distinct A_col)' across > segments, we must use Gl

Re: Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread ShaoFeng Shi
What do you mean by "hadoop cluster (A) env will be released "? Delete the cluster, or just keep a minimal running? If your Hadoop uses on-disk HDFS, there will be data loss when you delete the cluster. Remember to do a backup for the /kylin folder if you do want to do that. 2017-09-28 20:12 GMT

A problem about Global Dictionary and cube merge

2017-09-28 Thread ????
hi,all?? Because of our yarn and hbase`s version limited,we deploy apache kylin 1.6.0. For the correct result of 'count(distinct A_col)' across segments, we must use Global Dictionary to A_col. When the cube contain configuration of 'org.apache.kylin.dict.GlobalDictionaryBuilder', its segm

Re: Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread Billy Liu
sure. That's typical read/write deployment. 2017-09-28 18:47 GMT+08:00 cludezhu : > Hi, > > currently we have two cluster for kylin deployment: > hadoop cluster (A) for calculating and building cube > hbase cluster (B) for storing data. > > We just create the calculating cluster (A) on demand sin

Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread cludezhu
Hi,  currently we have two cluster for kylin deployment:  hadoop cluster (A) for calculating and building cube  hbase cluster (B) for storing data.  We just create the calculating cluster (A) on demand since all our env is deployed on Cloud.  so the hadoop cluster (A) env will be released after

Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread cludezhu
Hi, currently we have two cluster for kylin deployment: hadoop cluster (A) for calculating and building cube hbase cluster (B) for storing data. We just create the calculating cluster (A) on demand since all our env is deployed on Cloud.  so the hadoop cluster (A) env will be released after we

[jira] [Created] (KYLIN-2914) Visualization tools for data lineage

2017-09-28 Thread Pan, Julian (JIRA)
Pan, Julian created KYLIN-2914: -- Summary: Visualization tools for data lineage Key: KYLIN-2914 URL: https://issues.apache.org/jira/browse/KYLIN-2914 Project: Kylin Issue Type: New Feature

Re: Re: query problem

2017-09-28 Thread 446463...@qq.com
Hi,that means kylin.query.cache-enabled is ture or false is not matter? 446463...@qq.com From: ShaoFeng Shi Date: 2017-09-28 15:46 To: dev Subject: Re: query problem Hi, Kylin only caches some queries which: 1) take longer time 2) scan many rows in HBase 2) scan many bytes; So if your query

Re: query problem

2017-09-28 Thread ShaoFeng Shi
Hi, Kylin only caches some queries which: 1) take longer time 2) scan many rows in HBase 2) scan many bytes; So if your query wasn't cached, it indicates that it doesn't match these rules. The threshold of these conditions can be tunned in kylin.properties, as we see in this part of codes. 2017-0

query problem

2017-09-28 Thread 446463...@qq.com
Hi all : there is a problem in querying result though kylin I view the code in QueryService.java at kytlin ``` public SQLResponse doQueryWithCache(SQLRequest sqlRequest) { // some code SQLResponse sqlResponse = null; boolean queryCacheEnabled = checkCondition(kylinConfig.isQ

query problem

2017-09-28 Thread 446463...@qq.com
Hi all : there is a problem in querying result though kylin I view the code in QueryService.java at kytlin ``` public SQLResponse doQueryWithCache(SQLRequest sqlRequest) { // some code SQLResponse sqlResponse = null; boolean queryCacheEnabled = checkCondition(kylinConfig.isQ