[
https://issues.apache.org/jira/browse/SPARK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Fu updated SPARK-24932:
Description:
In issue SPARK-19140 we supported update output mode for non-aggregation
streaming queries. This should also be applied to streaming join to keep
semantic consistent.
PS. Streaming join feature is added after SPARK-19140.
When using update _output_ mode the join will works exactly as _append_ mode.
However, for example, this will allow user to run an aggregation-after-join
query in update mode in order to get a more real-time result output.
was:
In issue SPARK-19140 we supported update output mode for non-aggregation
streaming queries. This should also be applied to streaming join to keep
semantic consistent.
PS. Streaming join feature is added after SPARK-19140.
> Allow update mode for streaming queries with join
> -
>
> Key: SPARK-24932
> URL: https://issues.apache.org/jira/browse/SPARK-24932
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
>Affects Versions: 2.3.0, 2.3.1
>Reporter: Eric Fu
>Priority: Major
>
> In issue SPARK-19140 we supported update output mode for non-aggregation
> streaming queries. This should also be applied to streaming join to keep
> semantic consistent.
> PS. Streaming join feature is added after SPARK-19140.
> When using update _output_ mode the join will works exactly as _append_ mode.
> However, for example, this will allow user to run an aggregation-after-join
> query in update mode in order to get a more real-time result output.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
