sunchao commented on PR #11279: URL: https://github.com/apache/arrow-rs/pull/11279#issuecomment-5899077615
@Rich-T-kid Thanks for the pointer! These look complementary: #11281 avoids duplicate references to the same buffer while preserving sharing. This PR adds an explicit operation that copies selected values into independent buffers. The motivation is spilling (in order to support spill-able hash join later on): a small retained partition can otherwise keep a much larger input buffer alive. It gathers and copies directly, avoiding the intermediate shared array from calling interleave followed by `gc()`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
