[
https://issues.apache.org/jira/browse/SPARK-18758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-18758:
--
Description:
Listeners added with `sparkSession.streams.addListener(l)` are added to a
SparkSession. So events only from queries in the same session as a listener
should be posted to the listener.
Currently, all the events gets routed through the Spark's main listener bus,
and therefore all StreamingQueryListener events gets posted to
StreamingQueryListeners in all sessions. This is wrong.
was:Listeners added with `sparkSession.streams.addListener(l)` are added to a
SparkSession. So events only from queries in the same session as a listener
should be posted to the listener.
> StreamingQueryListener events from a StreamingQuery should be sent only to
> the listeners in the same session as the query
> -
>
> Key: SPARK-18758
> URL: https://issues.apache.org/jira/browse/SPARK-18758
> Project: Spark
> Issue Type: Bug
> Components: Structured Streaming
>Affects Versions: 2.0.2
>Reporter: Tathagata Das
>Priority: Critical
>
> Listeners added with `sparkSession.streams.addListener(l)` are added to a
> SparkSession. So events only from queries in the same session as a listener
> should be posted to the listener.
> Currently, all the events gets routed through the Spark's main listener bus,
> and therefore all StreamingQueryListener events gets posted to
> StreamingQueryListeners in all sessions. This is wrong.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
