mapleFU commented on issue #38441: URL: https://github.com/apache/arrow/issues/38441#issuecomment-1779949044
Yeah, I mean, usally user would pickup a compression. For datapagev1, it doesn't support a `is_compression` flag. So, all the page should be compressed ( whenever the compression ratio is) The funny thing is that, if we meet some data, and have `PLAIN` `DELTA` as candidate. DELTA might be better if not compression, but considering compression, PLAIN is better. Sometimes, the compression size even grows larger for some input. DataPageV2 can reject to compress for these types, but DataPageV1 cannot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
