[jira] [Assigned] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-34889: --- Assignee: Jungtaek Lim > Introduce MergingSessionsIterator merging elements directly which belong to > the same session > > > Key: SPARK-34889 > URL: https://issues.apache.org/jira/browse/SPARK-34889 > Project: Spark > Issue Type: Sub-task > Components: Structured Streaming >Affects Versions: 3.2.0 >Reporter: Jungtaek Lim >Assignee: Jungtaek Lim >Priority: Major > > This issue tracks effort on introducing MergingSessionsIterator, which > enables to merge elements belong to the same session directly. This would be > quite performant compared to UpdatingSessionIterator. Note that > MergingSessionsIterator can only apply to the cases aggregation can be > applied altogether, so there're still rooms for UpdatingSessionIterator to be > used. > This issue also introduces MergingSessionsExec which is the physical node on > leveraging MergingSessionsIterator to sort the input rows and aggregate rows > according to the session windows. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34889: Assignee: (was: Apache Spark) > Introduce MergingSessionsIterator merging elements directly which belong to > the same session > > > Key: SPARK-34889 > URL: https://issues.apache.org/jira/browse/SPARK-34889 > Project: Spark > Issue Type: Sub-task > Components: Structured Streaming >Affects Versions: 3.2.0 >Reporter: Jungtaek Lim >Priority: Major > > This issue tracks effort on introducing MergingSessionsIterator, which > enables to merge elements belong to the same session directly. This would be > quite performant compared to UpdatingSessionIterator. Note that > MergingSessionsIterator can only apply to the cases aggregation can be > applied altogether, so there're still rooms for UpdatingSessionIterator to be > used. > This issue also introduces MergingSessionsExec which is the physical node on > leveraging MergingSessionsIterator to sort the input rows and aggregate rows > according to the session windows. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-34889) Introduce MergingSessionsIterator merging elements directly which belong to the same session
[ https://issues.apache.org/jira/browse/SPARK-34889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34889: Assignee: Apache Spark > Introduce MergingSessionsIterator merging elements directly which belong to > the same session > > > Key: SPARK-34889 > URL: https://issues.apache.org/jira/browse/SPARK-34889 > Project: Spark > Issue Type: Sub-task > Components: Structured Streaming >Affects Versions: 3.2.0 >Reporter: Jungtaek Lim >Assignee: Apache Spark >Priority: Major > > This issue tracks effort on introducing MergingSessionsIterator, which > enables to merge elements belong to the same session directly. This would be > quite performant compared to UpdatingSessionIterator. Note that > MergingSessionsIterator can only apply to the cases aggregation can be > applied altogether, so there're still rooms for UpdatingSessionIterator to be > used. > This issue also introduces MergingSessionsExec which is the physical node on > leveraging MergingSessionsIterator to sort the input rows and aggregate rows > according to the session windows. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
