tustvold edited a comment on issue #1270: URL: https://github.com/apache/arrow-rs/issues/1270#issuecomment-1030579638
Thank you for taking the time to respond, I figured that might be the case, but thought it couldn't hurt to check. I'm sure you're aware, but just as a heads up if you're reading the data directly, the RLE encoding is not length preserving (https://github.com/apache/arrow-rs/issues/1111#issuecomment-1003119362), and a column chunk may not be consistently dictionary encoded (e.g. if the dictionary gets too large). FWIW there were some generics added in #1041 and evolved since to aid decoding columns to custom in-memory representations. They're currently crate-local, but that could be changed if you wished to use them. Just let me know 😀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
