Re: Re: Re: Re: Date error when query streaming cube

2016-12-08 Thread 汪胜
Of coure, I created an JIRA for my problems.Here is the url: https://issues.apache.org/jira/browse/KYLIN-2264 On 12/9/2016 14:48, Billy Liuwrote: Could you file an JIRA for this issue? The segment time may not process properly. 2016-12-09 14:26 GMT+08:00 汪胜 : > Yes, server date is same with

[jira] [Created] (KYLIN-2264) Date error when use new streaming cube in Kylin1.6.0

2016-12-08 Thread WangSheng (JIRA)
WangSheng created KYLIN-2264: Summary: Date error when use new streaming cube in Kylin1.6.0 Key: KYLIN-2264 URL: https://issues.apache.org/jira/browse/KYLIN-2264 Project: Kylin Issue Type: Bug

Re: Re: Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
Could you file an JIRA for this issue? The segment time may not process properly. 2016-12-09 14:26 GMT+08:00 汪胜 : > Yes, server date is same with PC date. And I didn't found this situation > in Kylin 1.5.*. I'm confused that cube's Last Build Time and Create Time > displayed on Kylin Web are sam

Re: Re: Re: Date error when query streaming cube

2016-12-08 Thread 汪胜
Yes, server date is same with PC date. And I didn't found this situation in Kylin 1.5.*. I'm confused that cube's Last Build Time and Create Time displayed on Kylin Web are same with PC date, but segments' start time and end time ​are eralier 8 hours than PC date. Aren't they used the same time

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Billy Liu
Glad to hear it. 2016-12-09 14:14 GMT+08:00 Tarun Vashisth : > Thanks Billy for your help. > > Indeed, It was a configuration issue with hadoop. We were able to resolve > it and now Apache Kylin is working fine. > > > Regards, > > Tarun > > > From: Billy Liu > Se

[jira] [Created] (KYLIN-2263) Display reasonable exception message if could not find kafka dependency for streaming build

2016-12-08 Thread Billy Liu (JIRA)
Billy Liu created KYLIN-2263: Summary: Display reasonable exception message if could not find kafka dependency for streaming build Key: KYLIN-2263 URL: https://issues.apache.org/jira/browse/KYLIN-2263 Pr

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Tarun Vashisth
Thanks Billy for your help. Indeed, It was a configuration issue with hadoop. We were able to resolve it and now Apache Kylin is working fine. Regards, Tarun From: Billy Liu Sent: Thursday, December 8, 2016 7:48:40 PM To: Samirul Haque Cc: Tarun Vashisth; d..

Re: Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
How about your server timezone? Is your server at the right time? Try run 'date' on your server. 2016-12-09 13:58 GMT+08:00 汪胜 : > I only changed "kylin.rest.timezone=GMT" to "kylin.rest.timezone=GM+8" in > file "kylin.properties", and I don't know kylin.web.timezone, this > propertiey should be

Re: Re: Date error when query streaming cube

2016-12-08 Thread 汪胜
I only changed "kylin.rest.timezone=GMT" to "kylin.rest.timezone=GM+8" in file "kylin.properties", and I don't know kylin.web.timezone, this propertiey should be default. On 12/9/2016 12:05, Billy Liuwrote: Thanks for the reporting. Could you provide more information? including Kylin server

[jira] [Created] (KYLIN-2262) Kafka Streaming Cube build error

2016-12-08 Thread QiLiFei (JIRA)
QiLiFei created KYLIN-2262: -- Summary: Kafka Streaming Cube build error Key: KYLIN-2262 URL: https://issues.apache.org/jira/browse/KYLIN-2262 Project: Kylin Issue Type: Test Components: C

Re: Date error when query streaming cube

2016-12-08 Thread Billy Liu
Thanks for the reporting. Could you provide more information? including Kylin server timezone, kylin.web.timezone. 2016-12-09 9:46 GMT+08:00 汪胜 : > Sorry for that. I used JDBC and Kylin Web to test the sql query for > streaming cube, but the records came from JDBC and Kylin Web are incorrect. > A

[jira] [Created] (KYLIN-2261) Cleanup Hbase Storage issue

2016-12-08 Thread QiLiFei (JIRA)
QiLiFei created KYLIN-2261: -- Summary: Cleanup Hbase Storage issue Key: KYLIN-2261 URL: https://issues.apache.org/jira/browse/KYLIN-2261 Project: Kylin Issue Type: Test Components: Client -

Date error when query streaming cube

2016-12-08 Thread 汪胜
Sorry for that. I used JDBC and Kylin Web to test the sql query for streaming cube, but the records came from JDBC and Kylin Web are incorrect. All of theses records' date are earlier than my PC date(8 hours). I found that records came from Kylin server are incorrected when I did query by remo

Re: Re: 答复: 答复: 回复:答复: Kylin1.6.0流式Cube查询时间错误

2016-12-08 Thread Luke Han
Hi all, Would you mind to discuss in English? There are people coming from all of the world and they would like to know what you are talking about, especially about some issue or problem. Please help to try using English which will help a lot for record and search. Thank you very much

Re: Update default config for sandbox environment

2016-12-08 Thread Billy Liu
Besides the default value change, I could draft a document introducing the current default configuration, and give some advice for larger cluster deployment. 2016-12-08 20:40 GMT+08:00 roger shi : > Agree. Better task parallelization for sandbox environment. > > On 08/12/2016, 6:30 PM, "Billy Liu

Re: kylin 1.6.0 cardinality can't greater than 5000000 ?

2016-12-08 Thread Alberto Ramón
Humm, you can try this: With Kylin 1705 you can use Global dictionary Builder, which support 2 Billons of values (versus previous dic 5 Millons) In Teorical you can migrate from old dics (Kylin 1775

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Billy Liu
It seems not Kylin's issue. The stacktrace is Hadoop code. Based on my limited experience, most of Hadoop issues come from the misconfiguration or incompatible components. Could you try some Hadoop distribution? Or your hadoop administrator could give much help. 2016-12-08 20:44 GMT+08:00 Samirul

[jira] [Created] (KYLIN-2260) have a try

2016-12-08 Thread lpstart (JIRA)
lpstart created KYLIN-2260: -- Summary: have a try Key: KYLIN-2260 URL: https://issues.apache.org/jira/browse/KYLIN-2260 Project: Kylin Issue Type: Bug Components: Job Engine Rep

[jira] [Created] (KYLIN-2259) have a try

2016-12-08 Thread lpstart (JIRA)
lpstart created KYLIN-2259: -- Summary: have a try Key: KYLIN-2259 URL: https://issues.apache.org/jira/browse/KYLIN-2259 Project: Kylin Issue Type: Bug Components: Web Reporter:

Re: Update default config for sandbox environment

2016-12-08 Thread roger shi
Agree. Better task parallelization for sandbox environment. On 08/12/2016, 6:30 PM, "Billy Liu" wrote: Hi dev community, Most users deploy Kylin on their own sandbox for the first trial. Most sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH sandbox

Re: Update default config for sandbox environment

2016-12-08 Thread hongbin ma
hi billy that's really good idea, how do you plan to approach this? On Thu, Dec 8, 2016 at 6:30 PM, Billy Liu wrote: > Hi dev community, > > Most users deploy Kylin on their own sandbox for the first trial. Most > sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH > sa

Re: Issues in building cubes of Apache Kylin

2016-12-08 Thread Tarun Vashisth
Hi Billy, echo $HIVE_CONF gives output: /usr/local/hive/conf We are still getting the same error java.io.FileNotFoundException: File does not exist: hdfs://localhost:54310/app/hadoop/tmp/mapred/staging/hduser1254415952/.staging/job_local1254415952_0001/libjars/hive-metastore-1.2.1.jar

Update default config for sandbox environment

2016-12-08 Thread Billy Liu
Hi dev community, Most users deploy Kylin on their own sandbox for the first trial. Most sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH sandbox. We'd better make the default kylin configuration convenient for these sandbox environment. The suggestion includes reducing

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
https://github.com/apache/kylin/blob/master/storage-hbase/src/main/java/org/apache/kylin/storage/hbase/util/StorageCleanupJob.java For 1.5.4, it should still be org.apache.kylin.storage.hbase.util.StorageCleanupJob For 1.6+ it would be org.apache.kylin.tool.StorageCleanupJob 2016-12-08 18:13 GMT+

Re: Can not Clean Up

2016-12-08 Thread Luke_Selina
Absolutely yes ! If not how I can run kylin? -- View this message in context: http://apache-kylin.74782.x6.nabble.com/Can-not-Clean-Up-tp6554p6559.html Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
Have you exported KYLIN_HOME? 2016-12-08 16:50 GMT+08:00 Luke_Selina : > Just as the pic shows it still shows Error @Billy Liu > > -- > View this message in context: http://apache-kylin.74782.x6. > nabble.com/Can-not-Clean-Up-tp6554p6556.html > Sent from the Apache Kylin mailing list archive at N

[jira] [Created] (KYLIN-2258) sql query(avg/min/max over) result turns to be replicated

2016-12-08 Thread Luyuan Zhai (JIRA)
Luyuan Zhai created KYLIN-2258: -- Summary: sql query(avg/min/max over) result turns to be replicated Key: KYLIN-2258 URL: https://issues.apache.org/jira/browse/KYLIN-2258 Project: Kylin Issue Typ

Re: Can not Clean Up

2016-12-08 Thread Luke_Selina
Just as the pic shows it still shows Error @Billy Liu -- View this message in context: http://apache-kylin.74782.x6.nabble.com/Can-not-Clean-Up-tp6554p6556.html Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: Can not Clean Up

2016-12-08 Thread Billy Liu
try org.apache.kylin.tool.StorageCleanupJob 2016-12-08 16:39 GMT+08:00 Luke_Selina : > I use the command '/opt/kylin/bin/kylin.sh > org.apache.kylin.storage.hbase.util.StorageCleanupJon --delete true' to > clean up my cluster, but it claims Could not find or load main class > org.apache.kylin.sto

Can not Clean Up

2016-12-08 Thread Luke_Selina
I use the command '/opt/kylin/bin/kylin.sh org.apache.kylin.storage.hbase.util.StorageCleanupJon --delete true' to clean up my cluster, but it claims Could not find or load main class org.apache.kylin.storage.hbase.util.StorageCleanuoJon, please give me some suggestions, thank you! my env: CDH-5.7

Re: About Lookup table for streaming cube

2016-12-08 Thread Li Yang
Or any suggestion about using lookup table in streaming, please share with us too. On Wed, Nov 30, 2016 at 5:36 PM, Billy(Yiming) Liu wrote: > Do the join in your ETL process. For example, reading message from Kafka > Msg1, do the join in your app, and send results Kafka Msg2. Then build > strea