[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh updated SPARK-10816:
--------------------------------
Description:
Currently structured streaming supports two kinds of windows: tumbling window
and sliding window. Another useful window function is session window. Which is
not supported by SS.
Unlike time window (tumbling window and sliding window), session window doesn't
have static window begin and end time. Session window creation depends on
defined session gap which can be static or dynamic.
For static session gap, the events which are falling in a certain period of
time (gap) are considered as a session window. A session window closes when it
does not receive events for the gap. For dynamic gap, the gap could be changed
from event to event.
A good explanation of session window in Flink:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/windows.html#session-windows.
was:
Currently structured streaming supports two kinds of windows: tumbling window
and sliding window. Another useful window function is session window. Which is
not supported by SS.
Unlike time window (tumbling window and sliding window), session window doesn't
have static window begin and end time. Session window creation depends on
defined session gap which can be static or dynamic.
For static session gap, the events which are falling in a certain period of
time (gap) are considered as a session window. A session window closes when it
does not receive events for the gap. For dynamic gap, the gap could be changed
About session window, there is some info:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/windows.html#session-windows.
> EventTime based sessionization (session window)
> -----------------------------------------------
>
> Key: SPARK-10816
> URL: https://issues.apache.org/jira/browse/SPARK-10816
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Reporter: Reynold Xin
> Priority: Major
> Attachments: SPARK-10816 Support session window natively.pdf, Session
> Window Support For Structure Streaming.pdf
>
>
> Currently structured streaming supports two kinds of windows: tumbling window
> and sliding window. Another useful window function is session window. Which
> is not supported by SS.
> Unlike time window (tumbling window and sliding window), session window
> doesn't have static window begin and end time. Session window creation
> depends on defined session gap which can be static or dynamic.
> For static session gap, the events which are falling in a certain period of
> time (gap) are considered as a session window. A session window closes when
> it does not receive events for the gap. For dynamic gap, the gap could be
> changed from event to event.
> A good explanation of session window in Flink:
> https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/operators/windows.html#session-windows.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
