Dandandan commented on pull request #9070: URL: https://github.com/apache/arrow/pull/9070#issuecomment-754573137
@jorgecarleitao @andygrove Do you think this design is good enough for now? For now it means anyone storing > 4GB variable size data in a build-side column should opt to use 64-bit offsets, and in the future one option would be to automatically detect this and apply a `cast` when needed. I think that should have the least performance implications. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org