[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656435#comment-16656435
]
Jungtaek Lim edited comment on SPARK-10816 at 10/21/18 12:19 AM:
-----------------------------------------------------------------
[~msukmanowsky]
In case if you are still struggling and would like to have session window with
event time & watermark via flatMapGroupsWithState, you can refer my
implementation of state function below
(NOTE: didn't clean the code. it is just for comparing)
https://gist.github.com/HeartSaVioR/9a3aeeef0f1d8ee97516743308b14cd6#file-eventtimesessionwindowimplementationviaflatmapgroupswithstate-scala-L32-L189
EDIT: modified the code since flatMapGroupsWithState doesn't guarantee events
to be sorted.
was (Author: kabhwan):
[~msukmanowsky]
In case if you are still struggling and would like to have session window with
event time & watermark via flatMapGroupsWithState, you can refer my
implementation of state function below
(NOTE: didn't clean the code. it is just for comparing)
https://gist.github.com/HeartSaVioR/9a3aeeef0f1d8ee97516743308b14cd6#file-eventtimesessionwindowimplementationviaflatmapgroupswithstate-scala-L30-L203
> EventTime based sessionization
> ------------------------------
>
> Key: SPARK-10816
> URL: https://issues.apache.org/jira/browse/SPARK-10816
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Reporter: Reynold Xin
> Priority: Major
> Attachments: SPARK-10816 Support session window natively.pdf, Session
> Window Support For Structure Streaming.pdf
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
