Reynold Xin created SPARK-3469: ---------------------------------- Summary: Make sure TaskCompletionListeners are called in presence of failures Key: SPARK-3469 URL: https://issues.apache.org/jira/browse/SPARK-3469 Project: Spark Issue Type: Improvement Affects Versions: 1.1.0 Reporter: Reynold Xin Assignee: Reynold Xin
If there are multiple TaskCompletionListeners, and any one of them misbehaves (e.g. throws an exception), then we will skip executing the rest of them. As we are increasingly relying on TaskCompletionListener for cleaning up of resources, we should make sure they are always called, even if the previous ones fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org