Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/12089#issuecomment-207553189 Thanks for updating it! LGTM Merging with master Since this was a bug from before, let's add a unit test. It should be easy to write a unit test now that we keep the last checkpoint by default. However, that test will be hard to backport to earlier Spark versions. Let's do this: * I'll merge this now with master. * Can you please send a follow-up PR with a unit test? * After merging the unit test, I'll backport this PR to previous Spark versions.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org