[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630697#comment-16630697 ]
Arun Mahadevan commented on SPARK-10816: ---------------------------------------- Reiterating earlier point. "map/flapMapGroupsWithState" is GBK + mapping the grouped values to state on the reduce side. The proposed native session window implements sessions as GBK operation (similar to tumbling and sliding windows) plus makes it easy for users to express gap based sessions. IMO, we could consider refactoring windowing operations to generic "assignWindows" and "mergeWindows" constructs. (https://issues.apache.org/jira/browse/SPARK-25555) > EventTime based sessionization > ------------------------------ > > Key: SPARK-10816 > URL: https://issues.apache.org/jira/browse/SPARK-10816 > Project: Spark > Issue Type: New Feature > Components: Structured Streaming > Reporter: Reynold Xin > Priority: Major > Attachments: SPARK-10816 Support session window natively.pdf > > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org