[ https://issues.apache.org/jira/browse/PARQUET-2222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17654524#comment-17654524 ]
Antoine Pitrou commented on PARQUET-2222: ----------------------------------------- cc [~julienledem] [~pnarang] [~rdblue] [~alexlevenson] > [Format] RLE encoding spec incorrect for v2 data pages > ------------------------------------------------------ > > Key: PARQUET-2222 > URL: https://issues.apache.org/jira/browse/PARQUET-2222 > Project: Parquet > Issue Type: Bug > Components: parquet-format > Reporter: Antoine Pitrou > Priority: Critical > Fix For: format-2.10.0 > > > The spec > (https://github.com/apache/parquet-format/blob/master/Encodings.md#run-length-encoding--bit-packing-hybrid-rle--3) > has this: > {code} > rle-bit-packed-hybrid: <length> <encoded-data> > length := length of the <encoded-data> in bytes stored as 4 bytes little > endian (unsigned int32) > {code} > But the length is actually prepended only in v1 data pages, not in v2 data > pages. -- This message was sent by Atlassian Jira (v8.20.10#820010)