mapleFU commented on PR #197: URL: https://github.com/apache/parquet-format/pull/197#issuecomment-1700303344
After your data in https://github.com/apache/parquet-format/pull/197#issuecomment-1699773196 , now I'm positive on having a size in `OffsetIndex`. As the implemention detail, can we ignore the `rep-def` histogram when `max-rep <= 1, max-def <= 1`? Since we already have page-ordinal in OffsetIndex and null-count in ColumnIndex? This might take less space but make it a bit tricky. @etseidl @emkornfield The second is that, I think should size better in `OffsetIndex` rather than `ColumnIndex`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
