Dandandan commented on PR #10441: URL: https://github.com/apache/arrow-rs/pull/10441#issuecomment-5302836910
I found some other way to make OOB checks faster in other PRs (parquet) * do the computation in small chunks (8-16) * compute the max index for this chunk * only compare the max index (i.e. once per 16 values) * then perform the work on the chunk This reduces the checking overhead 8-16x, mostly removing it. Perhaps this is a good strategy going forward @Rich-T-kid ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
