[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-548899353 @jiangxb1987 Can we have this be merged. It looks be approved by all the reviewers here. Thank yo

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-548235124 @jiangxb1987 thanks a lot. This

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-547715872 > So the only time Hadoop should show you this bad disk is if yarn doesn't detect it or it if goe

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-547242547 @cloud-fan @squito sorry for the irrelevant answer. Yes, the final files are not handled here be

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-547224500 > I see what you're trying to do here, but does this really buy you much? If you have one bad dis

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-546768319 cc @squito This is an automated

[GitHub] [spark] yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures

yaooqinn commented on issue #25962: [SPARK-29285][Shuffle] Temporary shuffle files should be able to handle disk failures URL: https://github.com/apache/spark/pull/25962#issuecomment-536406064 cc @cloud-fan This is an automa