Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/21606#discussion_r197543585 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkHadoopWriter.scala --- @@ -104,12 +104,12 @@ object SparkHadoopWriter extends Logging { jobTrackerId: String, commitJobId: Int, sparkPartitionId: Int, - sparkAttemptNumber: Int, + sparkTaskId: Long, committer: FileCommitProtocol, iterator: Iterator[(K, V)]): TaskCommitMessage = { // Set up a task. val taskContext = config.createTaskAttemptContext( - jobTrackerId, commitJobId, sparkPartitionId, sparkAttemptNumber) + jobTrackerId, commitJobId, sparkPartitionId, sparkTaskId.toInt) --- End diff -- To backport this, can we use the `.toInt` version? I think that should be safe.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org