XiangpengHao commented on issue #5523: URL: https://github.com/apache/arrow-rs/issues/5523#issuecomment-2427187531
I'll take a look at this. Here are some of my plans: - [ ] Implement a benchmark, e.g., RowSelection with 100k selectors (as used in ClickBench q21), benchmark `and_then`, `from_filters` and `intersection` - [ ] Implement a new RowSelection that uses a `BooleanBuffer` as the backend. Compare the performance. - [ ] Decide the policy when to use which. Some more context: I have to switch to a boolean buffer based row selection to reduce the selection overhead in another project. So I kind of already have all the implementation ready. The remaining work for me is to figure out a way to contribute back to arrow-rs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
