Kan Zhang created SPARK-1475: -------------------------------- Summary: Draining event logging queue before stopping event logger Key: SPARK-1475 URL: https://issues.apache.org/jira/browse/SPARK-1475 Project: Spark Issue Type: Bug Components: Spark Core Reporter: Kan Zhang Assignee: Kan Zhang Priority: Blocker Fix For: 1.0.0
When SparkListenerBus thread is stopped, its event queue needs to be drained. And this needs to happen before event logger is stopped. Otherwise, any events still waiting to be processed in queue will be lost and consequently event log file may be incomplete. -- This message was sent by Atlassian JIRA (v6.2#6252)