Re: [Discuss] Apache Kylin Component Owner Plan

2018-02-02 Thread Roger Shi
+1 I can take the owner of component "Query Engine". On 02/02/2018, 7:09 PM, "Li Yang" wrote: +1 I can take the owner of component "Metadata" to offload Shaofeng. And Roger is a better person to own "Query Engine" than me. :-) Cheers Yang On Fri, Feb 2

[jira] [Created] (KYLIN-3067) Provide web interface for dimension capping feature

2017-11-28 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-3067: Summary: Provide web interface for dimension capping feature Key: KYLIN-3067 URL: https://issues.apache.org/jira/browse/KYLIN-3067 Project: Kylin Issue Type

[jira] [Created] (KYLIN-3036) Allow complex column type when loading source table

2017-11-13 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-3036: Summary: Allow complex column type when loading source table Key: KYLIN-3036 URL: https://issues.apache.org/jira/browse/KYLIN-3036 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2930) Selecting one column in union causes compile error

2017-10-11 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2930: Summary: Selecting one column in union causes compile error Key: KYLIN-2930 URL: https://issues.apache.org/jira/browse/KYLIN-2930 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2889) Subquery columns not exported in OLAPContext allColumns

2017-09-21 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2889: Summary: Subquery columns not exported in OLAPContext allColumns Key: KYLIN-2889 URL: https://issues.apache.org/jira/browse/KYLIN-2889 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2888) Subquery columns not exported in OLAPContext allColumns

2017-09-21 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2888: Summary: Subquery columns not exported in OLAPContext allColumns Key: KYLIN-2888 URL: https://issues.apache.org/jira/browse/KYLIN-2888 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2887) Subquery columns not exported in OLAPContext allColumns

2017-09-21 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2887: Summary: Subquery columns not exported in OLAPContext allColumns Key: KYLIN-2887 URL: https://issues.apache.org/jira/browse/KYLIN-2887 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2850) Throw clear error message when there're more than 63 columns in rowkey

2017-09-05 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2850: Summary: Throw clear error message when there're more than 63 columns in rowkey Key: KYLIN-2850 URL: https://issues.apache.org/jira/browse/KYLIN-2850 Project:

[jira] [Created] (KYLIN-2829) Union two subquery under join make SQL return null values

2017-08-31 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2829: Summary: Union two subquery under join make SQL return null values Key: KYLIN-2829 URL: https://issues.apache.org/jira/browse/KYLIN-2829 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2830) Union two subquery under join make SQL return null values

2017-08-31 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2830: Summary: Union two subquery under join make SQL return null values Key: KYLIN-2830 URL: https://issues.apache.org/jira/browse/KYLIN-2830 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2809) Support operator "+" as string concat operator

2017-08-24 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2809: Summary: Support operator "+" as string concat operator Key: KYLIN-2809 URL: https://issues.apache.org/jira/browse/KYLIN-2809 Project: Kylin Issue Type: I

Re: [VOTE] Release apache-kylin-2.1.0 (RC2)

2017-08-15 Thread roger shi
+1 (non-binding) mvn test passed md5 & sha1 verified Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-04T03:39:06+08:00) Maven home: /usr/local/Cellar/maven/3.5.0/libexec Java version: 1.8.0_91, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0

[jira] [Created] (KYLIN-2785) Handle Maprfs schema working directory

2017-08-11 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2785: Summary: Handle Maprfs schema working directory Key: KYLIN-2785 URL: https://issues.apache.org/jira/browse/KYLIN-2785 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2777) Should throw error when sql contains non-equi left join

2017-08-03 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2777: Summary: Should throw error when sql contains non-equi left join Key: KYLIN-2777 URL: https://issues.apache.org/jira/browse/KYLIN-2777 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2771) Turn on all TIMEDATE FUNCTIONS in ODBC

2017-07-31 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2771: Summary: Turn on all TIMEDATE FUNCTIONS in ODBC Key: KYLIN-2771 URL: https://issues.apache.org/jira/browse/KYLIN-2771 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2772) Turn on all TIMEDATE FUNCTIONS in ODBC

2017-07-31 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2772: Summary: Turn on all TIMEDATE FUNCTIONS in ODBC Key: KYLIN-2772 URL: https://issues.apache.org/jira/browse/KYLIN-2772 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2765) Eliminate restriction on Global Dictionary of Dim columns

2017-07-28 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2765: Summary: Eliminate restriction on Global Dictionary of Dim columns Key: KYLIN-2765 URL: https://issues.apache.org/jira/browse/KYLIN-2765 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2657) Cube merge TopN dictionary not found, cause NPE

2017-06-06 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2657: Summary: Cube merge TopN dictionary not found, cause NPE Key: KYLIN-2657 URL: https://issues.apache.org/jira/browse/KYLIN-2657 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2623) Move output(Hbase) related code from MR engine to outputside

2017-05-15 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2623: Summary: Move output(Hbase) related code from MR engine to outputside Key: KYLIN-2623 URL: https://issues.apache.org/jira/browse/KYLIN-2623 Project: Kylin Issue

答复: [Announce] New Apache Kylin committer Roger Shi

2017-05-01 Thread Roger Shi
Thank you all. Glad to join such good community and let's make Apache Kylin better together. [😊] 发件人: Billy Liu 发送时间: 2017年4月29日 23:23:44 收件人: user 抄送: dev; Apache Kylin PMC; sjc 主题: Re: [Announce] New Apache Kylin committer Roger Shi Welcome Roger. 20

????: ??????????: Error while executing SQL "select count(*) as nums,courseid from optionaction group by courseid LIMIT 50000": null

2017-04-27 Thread roger shi
ncoding": "dict", "isShardBy": false }, { "column": "RESID", "encoding": "dict", "isShardBy": false }, { "column": "USERID", "encoding&q

????: Error while executing SQL "select count(*) as nums,courseid from optionaction group by courseid LIMIT 50000": null

2017-04-26 Thread roger shi
More information is required to answer your question. Would you mind to attach kylin log and related metadata json? ??: 35925138 <35925...@qq.com> : 2017??4??27?? 11:32:44 ??: dev : Error while executing SQL "select count(*) as nums,courseid fr

答复: [VOTE] Release apache-kylin-2.0.0 (RC1)

2017-04-22 Thread roger shi
+1 (no binding) mvn test passed md5/sha verified Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-11T00:41:47+08:00) Maven home: /usr/local/Cellar/maven/3.3.9/libexec Java version: 1.8.0_91, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_

????: build cube?????????????????????????????????????????? unable to create new native thread

2017-04-20 Thread roger shi
Hi, The first step is running some Hive command. It seems the default hive memory configuration is not enough. Please check the hive configuration in your environment. You can also adjust the configuration in Kylin's hive configuration file (conf/kylin_hive_conf.xml). __

答复: [jira] [Created] (KYLIN-2557) The kylin will start failed because of creating HBase table confict when multiple instances of the kylin are started at the same time.

2017-04-19 Thread roger shi
Hi jianhua, The short term workaround is to start an instance first and others later. 发件人: peng.jianhua (JIRA) 发送时间: 2017年4月20日 13:43:04 收件人: dev@kylin.apache.org 主题: [jira] [Created] (KYLIN-2557) The kylin will start failed because of creating HBase table confic

答复: Dual timestamp columns support in 2.0, Fact table Partitioned on ingestion date, aggregate on event date

2017-04-16 Thread roger shi
As Hive can have multiple partition columns, making actual event date column a partition column in Hive may help in this case. 发件人: ShaoFeng Shi 发送时间: 2017年4月17日 11:54:48 收件人: dev 主题: Re: Dual timestamp columns support in 2.0, Fact table Partitioned on ingestion

答复: 答复: 答复: Kylin Build Cube failing with the following error

2017-04-14 Thread roger shi
th the following error any suggestions on the changes of the properties and corresponding values. also, the sample cube with Kylin builds without any problems. then why this small cube build fails again and again, beats me. On Fri, Apr 14, 2017 at 2:21 AM, Roger Shi [via Apache Kylin] < ml-node+s7

????: ??????????: ??????????: Error: java.io.IOException: Unable to initialize any output collector

2017-04-14 Thread roger shi
hadoop??2047??2048 -- -- ??????: "roger shi";; : 2017??4??13??(??) 4:30 ??: "dev"; : : ??: Error: java.io.IOException: Unable to initialize any output collector It se

答复: 答复: Kylin Build Cube failing with the following error

2017-04-14 Thread roger shi
u, Apr 13, 2017 at 11:57 PM, Roger Shi [via Apache Kylin] < ml-node+s74782n7647...@n6.nabble.com> wrote: > Which step throws this error? From the log, it seems hadoop is opening > local file. Please check the default FileSystem of HDFS and also check the > hadoop job's memory

答复: Kylin Build Cube failing with the following error

2017-04-13 Thread roger shi
Which step throws this error? From the log, it seems hadoop is opening local file. Please check the default FileSystem of HDFS and also check the hadoop job's memory configuration. There might be some hint. 发件人: ashishjainm 发送时间: 2017年4月14日 13:53:58 收件人: dev@kyli

答复: [jira] [Created] (KYLIN-2511) org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/serde2/typein

2017-04-13 Thread roger shi
What's your Kylin environment? More information is required to locate the issue cause. 发件人: liaocs 发送时间: 2017年4月12日 16:33:01 收件人: dev@kylin.apache.org 主题: Re: [jira] [Created] (KYLIN-2511) org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.ex

SSB benchmark result of Apache Kylin 2.0.x

2017-04-13 Thread roger shi
Dear all, We are testing Kylin performance again as the next release 2.0 is coming soon. The latest result is quite satisfactory -- https://github.com/Kyligence/ssb-kylin [https://avatars0.githubusercontent.com/u/17005771?v=3&s=400] GitHub - Kyligence/ssb-

????: ??????????: Error: java.io.IOException: Unable to initialize any output collector

2017-04-13 Thread roger shi
ge: "Unable to initialize ... ??: 35925138 <35925...@qq.com> : 2017??4??13?? 15:13:45 ??: dev : ??: Error: java.io.IOException: Unable to initialize any output collector -- ???? -- ??

????: Error: java.io.IOException: Unable to initialize any output collector

2017-04-12 Thread roger shi
Could you please attach the complete stack trace of the error? ??: 35925138 <35925...@qq.com> : 2017??4??13?? 13:45:09 ??: dev : Error: java.io.IOException: Unable to initialize any output collector kylin??1.6.0 hadoop??2.6.0??build

答复: Cube query failing on changing rowkeys column order

2017-04-12 Thread roger shi
Metadata inconsistent means metadata is in invalid state. Though Cube building passes, query still expose the error. Please modify Cube description from Web UI and try again as rowkey reordering is easy there. 发件人: Shailesh Prajapati 发送时间: 2017年4月4日 18:03:31 收件人

[jira] [Created] (KYLIN-2532) Make Hive flat step more extensible

2017-04-04 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2532: Summary: Make Hive flat step more extensible Key: KYLIN-2532 URL: https://issues.apache.org/jira/browse/KYLIN-2532 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2520) Unify Restful API response and provide versioning

2017-03-27 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2520: Summary: Unify Restful API response and provide versioning Key: KYLIN-2520 URL: https://issues.apache.org/jira/browse/KYLIN-2520 Project: Kylin Issue Type: Task

[jira] [Created] (KYLIN-2514) Joins in data model fail to save when they disorder

2017-03-17 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2514: Summary: Joins in data model fail to save when they disorder Key: KYLIN-2514 URL: https://issues.apache.org/jira/browse/KYLIN-2514 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2420) Record zookeeper lock holder information

2017-02-03 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2420: Summary: Record zookeeper lock holder information Key: KYLIN-2420 URL: https://issues.apache.org/jira/browse/KYLIN-2420 Project: Kylin Issue Type: Improvement

答复: Proposal for updating master branch to use HBase 1.x

2017-01-22 Thread roger shi
+1, thanks Kaige. 发件人: Kaige Liu 发送时间: 2017年1月22日 12:06 收件人: dev@kylin.apache.org 主题: Proposal for updating master branch to use HBase 1.x Hi Folks, Currently our master branch is based on HBase 0.98. As per discussion here

Re: [DISCUSS] Call the next release v2.0?

2016-12-18 Thread roger shi
+1 On 19/12/2016, 2:23 PM, "Li Yang" wrote: Guys, I'm thinking maybe it's time to call the next release v2.0. Like to hear your thoughts. Actually the current v1.6, for the streaming cubing capability, is already a good candidate of v2.0. However there were some oth

Re: error build cube :Not a valid value

2016-12-13 Thread roger shi
If you’re using kyling 1.5.X, would you please upgrade to 1.6.0 and have a try? It seems a known issue for old kylin version. On 14/12/2016, 11:02 AM, "roger shi" wrote: What’s your Kylin version? On 13/12/2016, 4:34 PM, "gaolv123...@163.com" wrote:

Re: error build cube :Not a valid value

2016-12-13 Thread roger shi
What’s your Kylin version? On 13/12/2016, 4:34 PM, "gaolv123...@163.com" wrote: what is the fail reason when building cube? logs : 2016-12-13 16:19:56,032 ERROR [Thread-13] org.apache.kylin.dict.TrieDictionary: Not a valid value: 葫 / 2016-12-13 16:19:57,033 ERROR [pool-

Re: Update default config for sandbox environment

2016-12-08 Thread roger shi
Agree. Better task parallelization for sandbox environment. On 08/12/2016, 6:30 PM, "Billy Liu" wrote: Hi dev community, Most users deploy Kylin on their own sandbox for the first trial. Most sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH sandbox

Re: 回复: 使用全局字典报错AppendTrieDictionary can't retrive value from id

2016-12-05 Thread roger shi
Hi wangdan, Would you please attach the cube desc json? The cube definition in previous email is cube instance json. Thanks, Roger On 06/12/2016, 10:20 AM, "wang...@snqu.com" wrote: 查看了kylin.properties文件中kylin.dictionary.max.cardinality=500修改为kylin.dictionary.max.cardinality=2000

Re: select * clause still case all regionserver crash

2016-12-04 Thread roger shi
It’s not recommend to select * without limit. Query server cannot handle too many records got from storage. On 05/12/2016, 10:25 AM, "alaleiwang" wrote: thanks a lot,i will check KYLIN-1936 and try v1.5.4 to find if it will solve our problem by use "select * from table limit N"

Re: select * clause still case all regionserver crash

2016-12-04 Thread roger shi
hat is the new limit ?) Thanks 2016-12-04 9:39 GMT+01:00 roger shi : > The limit push down issue is completely resolved in JIRA KYLIN-1936, which > is applied in 1.5.4. So please try kylin 1.5.4. > > On 02/12/2016, 5:51 PM, "ShaoFeng Shi

Re: select * clause still case all regionserver crash

2016-12-04 Thread roger shi
The limit push down issue is completely resolved in JIRA KYLIN-1936, which is applied in 1.5.4. So please try kylin 1.5.4. On 02/12/2016, 5:51 PM, "ShaoFeng Shi" wrote: I remember hongbin has further optimization on the limit push down after 1.5.3; @hongbin, can you confirm this?

答复: [DISCUSS] Naming convention for config files and properties

2016-11-18 Thread roger shi
Nice proposal, +1. 发件人: Li Yang 发送时间: 2016年11月18日 18:00:31 收件人: dev@kylin.apache.org 主题: Re: [DISCUSS] Naming convention for config files and properties Thank you Yerui & Dayue! > Just one question, how to decide the package name of property name? Java package n

[jira] [Created] (KYLIN-2201) Cube desc and aggregation group rule combination max check fail

2016-11-16 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2201: Summary: Cube desc and aggregation group rule combination max check fail Key: KYLIN-2201 URL: https://issues.apache.org/jira/browse/KYLIN-2201 Project: Kylin Issue

[jira] [Created] (KYLIN-2191) Integer encoding error for width from 3 to 7

2016-11-14 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2191: Summary: Integer encoding error for width from 3 to 7 Key: KYLIN-2191 URL: https://issues.apache.org/jira/browse/KYLIN-2191 Project: Kylin Issue Type: Bug

答复: [VOTE] Release apache-kylin-1.6.0 (RC1)

2016-11-12 Thread roger shi
When running mvn test, I got following error: Results : Failed tests: CubeDescTest.testBadInit12 Expected: (an instance of java.lang.IllegalStateException and exception with message a string containing "Aggregation group 0 a dimension exist in more than one hierarchy: [CATEG_LVL2_NAME, META_C

答复: Duplicate Column! Error coming while executing the query- Using Kyline 1.6 Snapshot version

2016-11-09 Thread roger shi
Hi Ankur, Kylin doesn't support this kind of query " ... where fo.pick_due_ts >= fo.last_update_ts ... ". You work around by creating view of the origin table with a new column, for example larger_pick. The column's value is 1 for pick_due_ts >= last_update_ts, otherwise the value is 0. Your q

????: java.lang.IllegalArgumentException: Too high cardinality is not suitable for dictionary -- cardinality: 6007319

2016-11-09 Thread roger shi
No, I think you can not merge. The workaround is to rebuild the cube with other encoding on this column. ??: <121762...@qq.com> : 2016??11??9?? 12:03:16 ??: dev : java.lang.IllegalArgumentException: Too high cardinality is not suitable for

[jira] [Created] (KYLIN-2164) Cube metadata broken error message missing

2016-11-05 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2164: Summary: Cube metadata broken error message missing Key: KYLIN-2164 URL: https://issues.apache.org/jira/browse/KYLIN-2164 Project: Kylin Issue Type: Improvement

答复: http://127.0.0.1/kylin is giving 404, using HDP 2.5

2016-11-03 Thread roger shi
Would you please send out the kylin log? It helps locate your issue. 发件人: Alberto Ramón 发送时间: 2016年11月3日 20:46 收件人: dev@kylin.apache.org 主题: Re: http://127.0.0.1/kylin is giving 404, using HDP 2.5 This: "A new Kylin instance is started by root, stop it using "

[jira] [Created] (KYLIN-2139) record Hive intermediate table size

2016-10-28 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2139: Summary: record Hive intermediate table size Key: KYLIN-2139 URL: https://issues.apache.org/jira/browse/KYLIN-2139 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2028) find-*-dependency script fail on Mac OS

2016-09-18 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-2028: Summary: find-*-dependency script fail on Mac OS Key: KYLIN-2028 URL: https://issues.apache.org/jira/browse/KYLIN-2028 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-1900) Cube new build override old one

2016-07-17 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-1900: Summary: Cube new build override old one Key: KYLIN-1900 URL: https://issues.apache.org/jira/browse/KYLIN-1900 Project: Kylin Issue Type: Bug Components

[jira] [Created] (KYLIN-1804) Better view for hierarchy dimensions adding when creating cube

2016-06-16 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-1804: Summary: Better view for hierarchy dimensions adding when creating cube Key: KYLIN-1804 URL: https://issues.apache.org/jira/browse/KYLIN-1804 Project: Kylin Issue

[jira] [Created] (KYLIN-1794) Enable job list even some job metadata parsing failed

2016-06-16 Thread Roger Shi (JIRA)
Roger Shi created KYLIN-1794: Summary: Enable job list even some job metadata parsing failed Key: KYLIN-1794 URL: https://issues.apache.org/jira/browse/KYLIN-1794 Project: Kylin Issue Type: Bug

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 3)

2016-05-24 Thread Roger Shi
+1 (non-binding) mvn test passed md5&sha1&signature verified On 5/25/16, 11:38 AM, "Jian Zhong" wrote: >+1 (binding) >mvn test passed >md5&sha1&signature verified > >On Tue, May 24, 2016 at 8:43 PM, Xiaoyu Wang wrote: > >> +1 (binding) >> mvn test passed >> signature&md5&sha1 verified >> >> >>

Re: Re:Re: No detail message when Error.

2016-04-25 Thread Roger Shi
Hi Roy, Would you please provide all related logs fetched from $KYLIN_HOME/logs/kylin.log? It will help in reproducing the issue and finding the root cause. -- View this message in context: http://apache-kylin.74782.x6.nabble.com/No-detail-message-when-Error-tp4152p4260.html Sent from the Apache