wesm commented on pull request #7143: URL: https://github.com/apache/arrow/pull/7143#issuecomment-638884684
My anecdotal experience suggests that 1% is a higher-than-average rate of nulls, but I don't know how accurate that is. The popcount strategy could be adapted to do 64 bits at a time (instead of the 256 that's implemented now) which would mean a higher incidence of no-nulls blocks in the 1% case. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
