Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21607#discussion_r197300379
--- Diff:
core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala ---
@@ -80,7 +81,7 @@ object SparkHadoopMapRedUtil extends Logging {
logInfo(message)
// We need to abort the task so that the driver can reschedule
new attempts, if necessary
committer.abortTask(mrTaskContext)
- throw new CommitDeniedException(message, jobId, splitId,
taskAttemptNumber)
+ throw new CommitDeniedException(message, ctx.stageId(), splitId,
ctx.attemptNumber())
--- End diff --
2.2 and later use the stage ID; I think it's more correct since that's what
the coordinator uses, but don't really mind either way.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
