Parth Chandra created SPARK-47291:
-------------------------------------

             Summary: Add Parquet file reader metrics to scan
                 Key: SPARK-47291
                 URL: https://issues.apache.org/jira/browse/SPARK-47291
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 4.0.0
            Reporter: Parth Chandra


With the addition of external metrics support in Parquet 
([PARQUET-2374|https://issues.apache.org/jira/browse/PARQUET-2374]), it is now 
possible to gather file level scan metrics and have them displayed in a Parquet 
Scan's metrics. This can be done for both DSV1 and DSV2 implementations by 
providing a ParquetMetricsCallback implementation



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to