[ https://issues.apache.org/jira/browse/LENS-901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059397#comment-15059397 ]
Puneet Gupta commented on LENS-901: ----------------------------------- *Initial Thoughts :* Users will need to call execute api with timeout for queries that need both persistence and streaming results. For Stream to work , following properties are required * Persist In Server = true (supported via existing property lens.query.enable.persistent.resultset) //server will persist the result in file * Persist In Memory = true //Server will store the result in memory also for streaming . * Persist In Memory Max Result Size = 1000 // The Persist in Memory happens only when result rows <=1000. Server will not stream very big result sets. * Persist In Memory time window (in secs) = 60 (60 seconds from submission time) //Result is guaranteed to be persisted in memory only till the end of 60th second starting from submission time. Beyond this time, the InMemory result may be dropped(The persistent result is still available though) . So queries that fail to finish within 60 secs will not be streamed at all. Note : More approprite property names to be decided > Enable streaming results for queries > ------------------------------------ > > Key: LENS-901 > URL: https://issues.apache.org/jira/browse/LENS-901 > Project: Apache Lens > Issue Type: Improvement > Reporter: Puneet Gupta > Assignee: Puneet Gupta > > Users and Applications would want to not only persist but also stream the > results of queries that finish fast and produce a small result set. This > JIRA is to track support for this feature -- This message was sent by Atlassian JIRA (v6.3.4#6332)