Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/23207#discussion_r239311018
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/limit.scala ---
@@ -38,12 +38,18 @@ case class CollectLimitExec(limit: Int, child:
SparkPlan) extends UnaryExecNode
override def outputPartitioning: Partitioning = SinglePartition
override def executeCollect(): Array[InternalRow] =
child.executeTake(limit)
private val serializer: Serializer = new
UnsafeRowSerializer(child.output.size)
- override lazy val metrics =
SQLShuffleMetricsReporter.createShuffleReadMetrics(sparkContext)
+ private val writeMetrics =
SQLShuffleWriteMetricsReporter.createShuffleWriteMetrics(sparkContext)
+ override lazy val metrics =
--- End diff --
Thanks, make sense, I'll change to separate both read/write metrics and
pass them.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
