[ 
https://issues.apache.org/jira/browse/SPARK-32703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chao Sun updated SPARK-32703:
-----------------------------
    Description: Currently in {{SpecificParquetRecordReaderBase}} we use 
deprecated APIs in a few places from Parquet, such as {{readFooter}}, 
{{ParquetInputSplit}}, deprecated ctor for {{ParquetFileReader}}, 
{{filterRowGroups}}, etc. These are going to be removed in some of the future 
Parquet versions so we should move to the new APIs for better maintainability.  
 (was: Parquet vectorized reader still uses the old API for {{filterRowGroups}} 
and only filters on statistics. It should switch to the new API and do 
dictionary filtering as well.)

> Replace deprecated API calls from SpecificParquetRecordReaderBase
> -----------------------------------------------------------------
>
>                 Key: SPARK-32703
>                 URL: https://issues.apache.org/jira/browse/SPARK-32703
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Chao Sun
>            Priority: Minor
>
> Currently in {{SpecificParquetRecordReaderBase}} we use deprecated APIs in a 
> few places from Parquet, such as {{readFooter}}, {{ParquetInputSplit}}, 
> deprecated ctor for {{ParquetFileReader}}, {{filterRowGroups}}, etc. These 
> are going to be removed in some of the future Parquet versions so we should 
> move to the new APIs for better maintainability. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to