I was looking at the commits. 10 days back, 2 files (QueryReqeust and
SQLRequest.java) were touched that have fixed the issue for clients using
REST API, changing the default acceptPartial to false. 

I tried with Zeppelin and it works and results from Hive and Zeppelin (via
REST API) work. However, the response time has now gone really up and
queries are taking far longer.  Where I should be looking to improve the
performance.  It seems that as part of HBase scans, the dictionary info is
repeatedly loaded - can we not read it from the cache?


[http-bio-80-exec-6]:[2016-01-17
09:27:33,501][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)]
- Going to load DictionaryInfo from
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict
2016-01-17 09:27:33,726 WARN  [http-bio-80-exec-6] hdfs.DFSClient:
DFSInputStream has been closed already
[http-bio-80-exec-6]:[2016-01-17
09:27:33,726][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)]
- Loaded dictionary at
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict
[http-bio-80-exec-6]:[2016-01-17
09:27:35,443][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)]
- Going to load DictionaryInfo from
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict
2016-01-17 09:27:35,669 WARN  [http-bio-80-exec-6] hdfs.DFSClient:
DFSInputStream has been closed already
[http-bio-80-exec-6]:[2016-01-17
09:27:35,669][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)]
- Loaded dictionary at
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict
[http-bio-80-exec-6]:[2016-01-17
09:27:37,469][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:378)]
- Going to load DictionaryInfo from
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict
2016-01-17 09:27:37,697 WARN  [http-bio-80-exec-6] hdfs.DFSClient:
DFSInputStream has been closed already
[http-bio-80-exec-6]:[2016-01-17
09:27:37,697][DEBUG][org.apache.kylin.dict.DictionaryManager.load(DictionaryManager.java:382)]
- Loaded dictionary at
/dict/KYLIN_DEMO.CUSTOMER_DIM_T/L1_CST_NM/3c9c05aa-c8e9-4bfa-861b-2f3794cb3209.dict

Thanks,



--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/TopN-Results-Differ-in-Hive-and-Kylin-tp3288p3296.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

Reply via email to