[
https://issues.apache.org/jira/browse/LENS-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059397#comment-15059397
]
Puneet Gupta commented on LENS-901:
-----------------------------------
*Initial Thoughts :*
Users will need to call execute api with timeout for queries that need both
persistence and streaming results.
For Stream to work , following properties are required
* Persist In Server = true (supported via existing property
lens.query.enable.persistent.resultset) //server will persist the result in
file
* Persist In Memory = true //Server will store the result in memory also for
streaming .
* Persist In Memory Max Result Size = 1000 // The Persist in Memory happens
only when result rows <=1000. Server will not stream very big result sets.
* Persist In Memory time window (in secs) = 60 (60 seconds from submission
time) //Result is guaranteed to be persisted in memory only till the end of
60th second starting from submission time. Beyond this time, the InMemory
result may be dropped(The persistent result is still available though) . So
queries that fail to finish within 60 secs will not be streamed at all.
Note : More approprite property names to be decided
> Enable streaming results for queries
> ------------------------------------
>
> Key: LENS-901
> URL: https://issues.apache.org/jira/browse/LENS-901
> Project: Apache Lens
> Issue Type: Improvement
> Reporter: Puneet Gupta
> Assignee: Puneet Gupta
>
> Users and Applications would want to not only persist but also stream the
> results of queries that finish fast and produce a small result set. This
> JIRA is to track support for this feature
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
