alamb commented on issue #8844: URL: https://github.com/apache/arrow-rs/issues/8844#issuecomment-3649465923
An update: I have been hacking on https://github.com/apache/arrow-rs/pull/8902 for a while and found: 1. Creating a single (large) bitmap mask takes a non trivial amount of time --> use a representation for rowselection::mask that can handle multiple boolean arrays 2. In some of the benchmark queries, a row selector strategy gets forced anyway due to https://github.com/apache/arrow-rs/issues/8845 which means the effort to keep the boolean masks gets wasted Thus, I think I am going to switch focus for a while on https://github.com/apache/arrow-rs/issues/8845 and try to teach the reader how to skip entire pages with mask selections, and then come back to this one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
