[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580807887 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580807887 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580529783 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580513620 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580514760 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r580513620 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r578898016 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r578265717 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r575701986 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r575695979 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/SupportsReportMetrics.java ## @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r573977591 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r572414083 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r572265001 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r571537663 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570503897 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/CustomMetric.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570695900 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570621632 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570579980 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/PartitionReader.java ## @@ -48,4 +49,12 @@ * Return the current record.

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570513249 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/Scan.java ## @@ -102,4 +102,13 @@ default MicroBatchStream

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570507222 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/CustomMetric.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570507446 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/LongMetric.java ## @@ -0,0 +1,43 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r570503897 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/CustomMetric.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache