[
https://issues.apache.org/jira/browse/SPARK-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kan Zhang updated SPARK-1475:
-----------------------------
Description: When stopping SparkListenerBus, its event queue needs to be
drained. And this needs to happen before event logger is stopped. Otherwise,
any events still waiting to be processed in the queue will be lost and
consequently event log file may be incomplete. (was: When SparkListenerBus
thread is stopped, its event queue needs to be drained. And this needs to
happen before event logger is stopped. Otherwise, any events still waiting to
be processed in queue will be lost and consequently event log file may be
incomplete. )
> Draining event logging queue before stopping event logger
> ---------------------------------------------------------
>
> Key: SPARK-1475
> URL: https://issues.apache.org/jira/browse/SPARK-1475
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Kan Zhang
> Assignee: Kan Zhang
> Priority: Blocker
> Fix For: 1.0.0
>
>
> When stopping SparkListenerBus, its event queue needs to be drained. And this
> needs to happen before event logger is stopped. Otherwise, any events still
> waiting to be processed in the queue will be lost and consequently event log
> file may be incomplete.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
