Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/21490 (sorry, I've been busy with Spark Summit) The problem I see is that fault tolerance might not be cleanly separable from query stop tolerance. If a user stops the query at the wrong time, will they see strange results which make them think Spark is doing something wrong? If we can come up with a clean story for what users will see on restart, and it makes sense no matter when the query was stopped, I agree that this change or #20958 would be reasonable to add.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org