[ 
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630697#comment-16630697
 ] 

Arun Mahadevan commented on SPARK-10816:
----------------------------------------

Reiterating earlier point. "map/flapMapGroupsWithState" is GBK + mapping the 
grouped values to state on the reduce side.

The proposed native session window implements sessions as GBK operation 
(similar to tumbling and sliding windows) plus makes it easy for users to 
express gap based sessions. IMO, we could consider refactoring windowing 
operations to generic "assignWindows" and "mergeWindows" constructs. 
(https://issues.apache.org/jira/browse/SPARK-25555)

> EventTime based sessionization
> ------------------------------
>
>                 Key: SPARK-10816
>                 URL: https://issues.apache.org/jira/browse/SPARK-10816
>             Project: Spark
>          Issue Type: New Feature
>          Components: Structured Streaming
>            Reporter: Reynold Xin
>            Priority: Major
>         Attachments: SPARK-10816 Support session window natively.pdf
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to