Github user felixcheung commented on the issue:
https://github.com/apache/spark/pull/19373
to clarify, what I mean is the issue is caused by checkpointing being lazy
- so therefore if you remove the previous checkpoint before the new checkpoint
is started or completed, this fails.
so the fix might be to change to call `checkpoint()` to `checkpoint(eager:
true)` - this ensures by the time checkpoint call is returned the checkpointing
is completed.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
