ShengJun Zheng created KYLIN-4905:
-------------------------------------
Summary: Support limit .. offset ... in spark query engine
Key: KYLIN-4905
URL: https://issues.apache.org/jira/browse/KYLIN-4905
Project: Kylin
Issue Type: New Feature
Components: Query Engine
Affects Versions: v4.0.0-alpha
Reporter: ShengJun Zheng
when use top-level result offset clause in query expression (ANSI SQL) : limit
xxx offset xxx in spark query engine,limit will not push down into spark
engine, and offset will not take effect. This is incompatible wIth Kylin
2.x~3.x.
After looking through the code, i found it's because spark dose not support
limit ... offset ... now. There is a spark issue in progress:
https://issues.apache.org/jira/browse/SPARK-28330, which was created in 2019
but still in progress.
So, should we support this feature temporarily in KYLIN? :
1. push down limit to spark
2. take result from starting offset in KYLIN query server
--
This message was sent by Atlassian Jira
(v8.3.4#803005)