[ https://issues.apache.org/jira/browse/ARROW-14089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17448212#comment-17448212 ]
Antoine Pitrou commented on ARROW-14089: ---------------------------------------- Are such files still around? Otherwise we may not bother and spend development time on more useful tasks :) > [C++] Read DELTA_BYTE_ARRAY data written with bug PARQUET-246 > ------------------------------------------------------------- > > Key: ARROW-14089 > URL: https://issues.apache.org/jira/browse/ARROW-14089 > Project: Apache Arrow > Issue Type: Improvement > Components: C++ > Reporter: Shan Huang > Priority: Major > > If a parquet file is written by parquet-mr before version 1.8.0, the bug > [PARQUET-246|https://issues.apache.org/jira/browse/PARQUET-246] will produce > data inconsistent with the encoding of DELTA_BYTE_ARRAY. > There are two solutions: > 1. We should update the read side to recover data written with this bug. > 2. We need to throw an exception if the parquet file is written by parquet-mr > before version 1.8.0 and has DELTA_BYTE_ARRAY encoding data. -- This message was sent by Atlassian Jira (v8.20.1#820001)