gitzwz commented on PR #11280: URL: https://github.com/apache/iceberg/pull/11280#issuecomment-2406797716
This works well when table's schema is over 1k, and when there is a need to read table specs & schema after table scan. In our case(2k column, 25.9TB, 460,000 files), this can reduce the time required to get all specs after tableScan from over 10 min to 30s. @aokolnychyi @RussellSpitzer please take a look when you have time~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
