on the dict repeatly loading issue, it is fixed in http://mail-archives.apache.org/mod_mbox/kylin-commits/201601.mbox/%[email protected]%3E on 2.0 and 2.x-staging.
i'll backport it to 1.x today On Mon, Jan 18, 2016 at 10:15 AM, ShaoFeng Shi <[email protected]> wrote: > Yes the "acceptPartial" may cause confusion and we decided to disable it, > will roll out in v1.3. > > Kylin will introduce the "approximate" TopN measure in the future release > (maybe v2.1), with which the Top records will be pre-calculated during cube > build; then Kylin can quickly answer instead of getting all records to > sort. You can get more information in the JIRA > https://issues.apache.org/jira/browse/KYLIN-943 > > 2016-01-17 22:27 GMT+08:00 sdangi <[email protected]>: > > > I was looking at the commits. 10 days back, 2 files (QueryReqeust and > > SQLRequest.java) were touched that have fixed the issue for clients using > > REST API, changing the default acceptPartial to false. > > > > I tried with Zeppelin and it works and results from Hive and Zeppelin > (via > > REST API) work. However, the response time has now gone really up and > > queries are taking far longer. Where I should be looking to improve the > > performance. It seems that as part of HBase scans, the dictionary info > is > > repeatedly loaded - can we not read it from the cache? > > > > > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:33,501][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > > - Going to load DictionaryInfo from > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > 2016-01-17 09:27:33,726 WARN [http-bio-80-exec-6] hdfs.DFSClient: > > DFSInputStream has been closed already > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:33,726][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > > - Loaded dictionary at > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:35,443][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > > - Going to load DictionaryInfo from > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > 2016-01-17 09:27:35,669 WARN [http-bio-80-exec-6] hdfs.DFSClient: > > DFSInputStream has been closed already > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:35,669][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > > - Loaded dictionary at > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:37,469][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > > - Going to load DictionaryInfo from > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > 2016-01-17 09:27:37,697 WARN [http-bio-80-exec-6] hdfs.DFSClient: > > DFSInputStream has been closed already > > [http-bio-80-exec-6]:[2016-01-17 > > > > > 09:27:37,697][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > > - Loaded dictionary at > > > > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > > > Thanks, > > > > > > > > -- > > View this message in context: > > > http://apache-kylin.74782.x6.nabble.com/TopN-Results-Differ-in-Hive-and-Kylin-tp3288p3296.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > -- > Best regards, > > Shaofeng Shi > -- Regards, *Bin Mahone | 马洪宾* Apache Kylin: http://kylin.io Github: https://github.com/binmahone
