Neuw84 commented on issue #17241: URL: https://github.com/apache/iceberg/issues/17241#issuecomment-4990781536
Have been studying a little bit. From DV write path. - This needs to be merged, I can collaborate if needed. https://github.com/apache/iceberg/pull/15927 . Although not used in this codepath.... it is going to be useful. - For big blobs maybe we need to think on "Streaming blob APIs" ( there is no api surface for that now). - For the driver thing... we should think on trimming state but ideally we should move all that work to the executors. Will think about it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
