Yes the "acceptPartial" may cause confusion and we decided to disable it, will roll out in v1.3.
Kylin will introduce the "approximate" TopN measure in the future release (maybe v2.1), with which the Top records will be pre-calculated during cube build; then Kylin can quickly answer instead of getting all records to sort. You can get more information in the JIRA https://issues.apache.org/jira/browse/KYLIN-943 2016-01-17 22:27 GMT+08:00 sdangi <[email protected]>: > I was looking at the commits. 10 days back, 2 files (QueryReqeust and > SQLRequest.java) were touched that have fixed the issue for clients using > REST API, changing the default acceptPartial to false. > > I tried with Zeppelin and it works and results from Hive and Zeppelin (via > REST API) work. However, the response time has now gone really up and > queries are taking far longer. Where I should be looking to improve the > performance. It seems that as part of HBase scans, the dictionary info is > repeatedly loaded - can we not read it from the cache? > > > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:33,501][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > - Going to load DictionaryInfo from > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > 2016-01-17 09:27:33,726 WARN [http-bio-80-exec-6] hdfs.DFSClient: > DFSInputStream has been closed already > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:33,726][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > - Loaded dictionary at > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:35,443][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > - Going to load DictionaryInfo from > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > 2016-01-17 09:27:35,669 WARN [http-bio-80-exec-6] hdfs.DFSClient: > DFSInputStream has been closed already > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:35,669][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > - Loaded dictionary at > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:37,469][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)] > - Going to load DictionaryInfo from > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > 2016-01-17 09:27:37,697 WARN [http-bio-80-exec-6] hdfs.DFSClient: > DFSInputStream has been closed already > [http-bio-80-exec-6]:[2016-01-17 > > 09:27:37,697][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)] > - Loaded dictionary at > > /dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict > > Thanks, > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/TopN-Results-Differ-in-Hive-and-Kylin-tp3288p3296.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi
