[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Attachment: commit failed.png > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > Attachments: commit failed.png > > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Attachment: (was: `N0)80~9A(AMT~2}%Q`M[RY.png) > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Attachment: `N0)80~9A(AMT~2}%Q`M[RY.png > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Description: In our cluster, we set spark.speculation=true, but when a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite. https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 was: In our cluster, we set spark.speculation=true, but when a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite. https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 Index ▴ID Attempt Status Locality Level Executor ID / Host Launch Time DurationGC Time Output Size / Records Shuffle Read Size / Records Errors 0 30910 SUCCESS PROCESS_LOCAL 1554 / 10.215.134.227 2016/07/25 02:33:39 19 min 1.2 min 0.0 B / 149525281121.5 MB / 15286949 0 37940 FAILED PROCESS_LOCAL 2027 / 10.215.146.29 2016/07/25 02:47:04 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 3794 0 40941 FAILED PROCESS_LOCAL 2546 / 10.196.150.233 2016/07/25 03:08:58 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4094 0 43842 FAILED PROCESS_LOCAL 2823 / 10.215.155.155 2016/07/25 03:29:50 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4384 0 45733 FAILED PROCESS_LOCAL 3011 / 10.215.139.24 2016/07/25 03:46:50 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4573 0 48054 SUCCESS PROCESS_LOCAL 3246 / 10.196.138.215 2016/07/25 04:06:12 0 ms1.3 min 0.0 B / 149524481121.5 MB / 15286949 1 30920 SUCCESS PROCESS_LOCAL 1505 / 10.196.130.102 2016/07/25 02:33:39 22 min 4.9 min 0.0 B / 149536921121.9 MB / 15288628 1 37950 FAILED PROCESS_LOCAL 2253 / 10.196.145.33 2016/07/25 02:48:28 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 3795 1 40741 FAILED PROCESS_LOCAL 2493 / 10.196.148.109 2016/07/25 03:08:49 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 4074 1 42632 FAILED PROCESS_LOCAL 2705 / 10.196.149.21 2016/07/25 03:25:05 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 4263 > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Description: In our cluster, we set spark.speculation=true, but when a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite. https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 Index ▴ID Attempt Status Locality Level Executor ID / Host Launch Time DurationGC Time Output Size / Records Shuffle Read Size / Records Errors 0 30910 SUCCESS PROCESS_LOCAL 1554 / 10.215.134.227 2016/07/25 02:33:39 19 min 1.2 min 0.0 B / 149525281121.5 MB / 15286949 0 37940 FAILED PROCESS_LOCAL 2027 / 10.215.146.29 2016/07/25 02:47:04 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 3794 0 40941 FAILED PROCESS_LOCAL 2546 / 10.196.150.233 2016/07/25 03:08:58 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4094 0 43842 FAILED PROCESS_LOCAL 2823 / 10.215.155.155 2016/07/25 03:29:50 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4384 0 45733 FAILED PROCESS_LOCAL 3011 / 10.215.139.24 2016/07/25 03:46:50 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4573 0 48054 SUCCESS PROCESS_LOCAL 3246 / 10.196.138.215 2016/07/25 04:06:12 0 ms1.3 min 0.0 B / 149524481121.5 MB / 15286949 1 30920 SUCCESS PROCESS_LOCAL 1505 / 10.196.130.102 2016/07/25 02:33:39 22 min 4.9 min 0.0 B / 149536921121.9 MB / 15288628 1 37950 FAILED PROCESS_LOCAL 2253 / 10.196.145.33 2016/07/25 02:48:28 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 3795 1 40741 FAILED PROCESS_LOCAL 2493 / 10.196.148.109 2016/07/25 03:08:49 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 4074 1 42632 FAILED PROCESS_LOCAL 2705 / 10.196.149.21 2016/07/25 03:25:05 / / TaskCommitDenied (Driver denied task commit) for job: 2, partition: 1, attemptNumber: 4263 was: In our cluster, we set spark.speculation=true, but when a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite. https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 > Index ▴ ID Attempt Status Locality Level Executor ID / Host > Launch Time DurationGC Time Output Size / Records Shuffle Read > Size / Records Errors > 0 30910 SUCCESS PROCESS_LOCAL 1554 / 10.215.134.227 > 2016/07/25 02:33:39 19 min 1.2 min 0.0 B / 149525281121.5 MB / > 15286949 > 0 37940 FAILED PROCESS_LOCAL 2027 / 10.215.146.29 > 2016/07/25 02:47:04 / / TaskCommitDenied > (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 3794 > 0 40941 FAILED PROCESS_LOCAL 2546 / 10.196.150.233 > 2016/07/25 03:08:58 / / TaskCommitDenied > (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4094 > 0 43842 FAILED PROCESS_LOCAL 2823 / 10.215.155.155 > 2016/07/25 03:29:50 / / TaskCommitDenied > (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4384 > 0 45733 FAILED PROCESS_LOCAL 3011 / 10.215.139.24 > 2016/07/25 03:46:50 / / TaskCommitDenied > (Driver denied task commit) for job: 2, partition: 0, attemptNumber: 4573 > 0 48054 SUCCESS PROCESS_LOCAL 3246 / 10.196.138.215 > 2016/07/25 04:06:1
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Description: In our cluster, we set spark. When a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark. When a task throw exception at > SparkHadoopMapRedUtil.performCommit(), this task can retry infinite > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Description: In our cluster, we set spark.speculation=true, but when a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite. https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 was: In our cluster, we set spark. When a task throw exception at SparkHadoopMapRedUtil.performCommit(), this task can retry infinite https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > > In our cluster, we set spark.speculation=true, but when a task throw > exception at SparkHadoopMapRedUtil.performCommit(), this task can retry > infinite. > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala#L83 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-16709) Task with commit failed will retry infinite when speculation set to true
[ https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-16709: -- Affects Version/s: 1.6.0 > Task with commit failed will retry infinite when speculation set to true > > > Key: SPARK-16709 > URL: https://issues.apache.org/jira/browse/SPARK-16709 > Project: Spark > Issue Type: Bug >Affects Versions: 1.6.0 >Reporter: Hong Shen > -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
