alamb commented on PR #6155: URL: https://github.com/apache/arrow-rs/pull/6155#issuecomment-2281774905
> Right so the question becomes whether the proposed optimisation is overfitting to a particular implementation that is known to be at least somewhat degenerate? Is this a general purpose improvement, or just something that helps a single use-case potentially to the detriment of others? Yes, I agree I am not yet convinced that this is a good general optimization for arrow-rs. In particular, I think we would need to show it doesn't slow anything else down. There is at least one small cost that it increases the sizes of arrays by 8 bytes I think -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
