amogh-jahagirdar commented on PR #9953:
URL: https://github.com/apache/iceberg/pull/9953#issuecomment-2007499715
@ajantha-bhat Replied my thoughts on the Trino PR and I'll summarize what I
think here:
To be clear, there is no extra I/O being done in practice for
`newInputfile(DataFile)` since that code path does not look to be exercised yet
in the latest release.
What's remaining is the `newInputFile(ManifestFile)` where there would be
an extra I/O during engine planning. Since the I/O is an extra head request to
object stores which typically is low double digit milliseconds + the fact that
only a subset of manifess are read during planning I think that it's not
significant enough to warrant a patch release, but I can be convinced otherwise
if folks hit a latency regression this in their workloads.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
