Shixiong Zhu created SPARK-12847:
------------------------------------
Summary: Remove StreamingListenerBus and post all Streaming events
to the same thread as Spark events
Key: SPARK-12847
URL: https://issues.apache.org/jira/browse/SPARK-12847
Project: Spark
Issue Type: Improvement
Components: Spark Core, Streaming
Reporter: Shixiong Zhu
Assignee: Shixiong Zhu
SparkListener.onOtherEvent was added in
https://github.com/apache/spark/pull/10061. SQLListener uses it to dispatch SQL
special events instead of creating a new separate listener bus.
Streaming can also use the similar approach to eliminate the
StreamingListenerBus. Right now, nondeterministic message order in two listener
buses are really tricky when someone implements both SparkListener and
StreamingListener. And if we can use only one listener bus in Spark, the
nondeterministic message order will be eliminated and we can also remove a lot
of codes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
