Parth Chandra created SPARK-47291: ------------------------------------- Summary: Add Parquet file reader metrics to scan Key: SPARK-47291 URL: https://issues.apache.org/jira/browse/SPARK-47291 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: Parth Chandra
With the addition of external metrics support in Parquet ([PARQUET-2374|https://issues.apache.org/jira/browse/PARQUET-2374]), it is now possible to gather file level scan metrics and have them displayed in a Parquet Scan's metrics. This can be done for both DSV1 and DSV2 implementations by providing a ParquetMetricsCallback implementation -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org