[ https://issues.apache.org/jira/browse/PARQUET-2222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17732652#comment-17732652 ]
Xuwei Fu commented on PARQUET-2222: ----------------------------------- Yes this answers my question. I think arrow parquet c++ is same on this. In cpp user can write the rle but I just introduce it few month later, so maybe user haven't and should not use it in v1 format. As for RL/DL, I guess RLE is used > [Format] RLE encoding spec incorrect for v2 data pages > ------------------------------------------------------ > > Key: PARQUET-2222 > URL: https://issues.apache.org/jira/browse/PARQUET-2222 > Project: Parquet > Issue Type: Bug > Components: parquet-format > Reporter: Antoine Pitrou > Assignee: Gang Wu > Priority: Critical > Fix For: format-2.10.0 > > > The spec > (https://github.com/apache/parquet-format/blob/master/Encodings.md#run-length-encoding--bit-packing-hybrid-rle--3) > has this: > {code} > rle-bit-packed-hybrid: <length> <encoded-data> > length := length of the <encoded-data> in bytes stored as 4 bytes little > endian (unsigned int32) > {code} > But the length is actually prepended only in v1 data pages, not in v2 data > pages. -- This message was sent by Atlassian Jira (v8.20.10#820010)