[ https://issues.apache.org/jira/browse/SPARK-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14124833#comment-14124833 ]
Andrew Ash commented on SPARK-1667: ----------------------------------- Hi [~sarutak] it looks like you sent in a better fix for this problem in SPARK-2670. Are we good to close this ticket now? > Jobs never finish successfully once bucket file missing occurred > ---------------------------------------------------------------- > > Key: SPARK-1667 > URL: https://issues.apache.org/jira/browse/SPARK-1667 > Project: Spark > Issue Type: Bug > Components: Shuffle > Affects Versions: 1.0.0 > Reporter: Kousuke Saruta > > If jobs execute shuffle, bucket files are created in a temporary directory > (named like spark-local-*). > When the bucket files are missing cased by disk failure or any reasons, jobs > cannot execute shuffle which has same shuffle id for the bucket files. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org