Github user awarrior commented on a diff in the pull request:
https://github.com/apache/spark/pull/19118#discussion_r138263099
--- Diff:
core/src/main/scala/org/apache/spark/internal/io/SparkHadoopWriter.scala ---
@@ -112,11 +112,12 @@ object SparkHadoopWriter extends Logging {
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/19118#discussion_r138238318
--- Diff:
core/src/main/scala/org/apache/spark/internal/io/SparkHadoopWriter.scala ---
@@ -112,11 +112,12 @@ object SparkHadoopWriter extends Logging {
GitHub user awarrior opened a pull request:
https://github.com/apache/spark/pull/19118
[SPARK-21882][CORE] OutputMetrics doesn't count written bytes correctly in
the saveAsHadoopDataset function
spark-21882
## What changes were proposed in this pull request?