JoshRosen commented on PR #36775:
URL: https://github.com/apache/spark/pull/36775#issuecomment-1171817134
> Thanks for you guys reviews, I think @JoshRosen's way is more appropriate,
we better change the implementation to "false negatives", though it may need
more efforts to implement it an
JoshRosen commented on PR #36775:
URL: https://github.com/apache/spark/pull/36775#issuecomment-1148136217
Does checking for filesystem closed exceptions completely fix this issue or
are we vulnerable to race conditions? Skimming through the [Hadoop DFSClient
code](https://github.com/apache/