pvary commented on PR #12721: URL: https://github.com/apache/iceberg/pull/12721#issuecomment-2995667593
> > The question is does it worth it? > @pvary I see the binary incompatible issue you pointed, and my assumption is it's relatively cheap to fix via reflection. This exception caught quiet late in the process, and this doesn't make me confident that we catch everything. Also Hive doesn't document changes between Hive 2 and Hive 4, so we can't be sure there will not be more when moving to newer version of Hive 4. Building on this brittle ground is problematic. > Each Spark binary releases have a single version of built-in Hive jars, the overhead of bundling Iceberg's Hive Catalog classes is quite low. If I understand correctly, it is now possible to use different versions of Hive in Spark than the version directly bundled. Again, this exposes us to even higher test matrix. Based on this, I support @wypoon's idea collected in https://github.com/apache/iceberg/pull/12721#issuecomment-2963811500. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
