[GitHub] [spark] cloud-fan commented on a change in pull request #32330: [SPARK-35215][SQL] Update custom metric per certain rows and at the end of the task

cloud-fan commented on a change in pull request #32330: URL: https://github.com/apache/spark/pull/32330#discussion_r627140140 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/metric/CustomMetrics.scala ## @@ -17,11 +17,13 @@ package org.apache.spark.sql.

[GitHub] [spark] cloud-fan commented on a change in pull request #32330: [SPARK-35215][SQL] Update custom metric per certain rows and at the end of the task

cloud-fan commented on a change in pull request #32330: URL: https://github.com/apache/spark/pull/32330#discussion_r620010077 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceRDD.scala ## @@ -92,12 +104,15 @@ private class Partition