alamb commented on PR #16878: URL: https://github.com/apache/datafusion/pull/16878#issuecomment-3133806226
> But I'm wondering if we can wrap something like ViewItemBuilder that holds the similar logic as [here](https://docs.rs/arrow-array/55.2.0/src/arrow_array/builder/generic_bytes_view_builder.rs.html#315) and implement std::io::Write (or can be pushed/extended byte-by-byte) like StringArrayBuilder so that we don't need an intermediate container anymore? Indeed -- there is a ticket about this in arrow-rs: - https://github.com/apache/arrow-rs/issues/6373 I tried to make a PR here - https://github.com/apache/arrow-rs/pull/6777 Something that might be worth looking into is to use the underlying buffer as temp space, and then "rewind" the values (aka call `truncate()` if the data fit entirely in the view 🤔 ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
