mailmindlin commented on issue #11665: URL: https://github.com/apache/arrow-rs/issues/11665#issuecomment-6342385224
@Jefffrey @alamb could #11817 (backport of #11694) be included in 58.4.1? Context: we (Rerun) store binary blobs such as video frames as List<UInt8>, so the all-ones validity bitmap the writer adds for the UInt8 child makes every IPC-encoded blob 12.5% larger (about 11% of our files). Our dependencies (DataFusion 54, Lance) keep us on arrow 58 for a while. Happy to open a 59_maintenance backport as well if that's useful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
