[GitHub] [spark] cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-549292671 thanks, merging to master! This

[GitHub] [spark] cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-547252507 This makes sense to me. Temp files are not only used by shuffle, but also external sorter, exter

[GitHub] [spark] cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

cloud-fan commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-547240532 @yaooqinn I think @squito was asking about the final file, which has a fixed name. How do you av