[
https://issues.apache.org/jira/browse/FLINK-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek closed FLINK-19137.
------------------------------------
Fix Version/s: 1.12.0
Resolution: Fixed
master: 6760ef4cc4e6f4ed68a7659f374c03038114abde
> Bump Apache Parquet to 1.11.1
> -----------------------------
>
> Key: FLINK-19137
> URL: https://issues.apache.org/jira/browse/FLINK-19137
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Reporter: ABC
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
> Attachments: image-2020-09-04-10-21-00-688.png,
> image-2020-09-04-10-24-42-480.png
>
>
> Apache Parquet 1.11.1 fixed some important issues:
> * https://issues.apache.org/jira/browse/PARQUET-1309
> * https://issues.apache.org/jira/browse/PARQUET-1510
> * https://issues.apache.org/jira/browse/PARQUET-1485
> Now Flink master branch relies parquet 1.10.0, and flink-sql-parquet artifact
> shaded parquet class files into flink-sql-parquet.jar. So this may lead to
> direct memory leak in PARQUET-1485 or parquet properties bug in PARQUET-1309
> or repeat values with dictionary encoding error in PARQUET-1510.
>
> For example in PARQUET-1309:
> !image-2020-09-04-10-21-00-688.png!
> then in Flink:
> [https://github.com/C08061/flink/blob/master/flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/ParquetInputFormat.java#L166]
> !image-2020-09-04-10-24-42-480.png!
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
