massdosage commented on issue #170: Add support for Iceberg MR / InputFormat and OutputFormat APIs URL: https://github.com/apache/incubator-iceberg/issues/170#issuecomment-594555804 > Is an update to Hive 2.3 the main blocker for getting this into the Apache repo? If so, maybe we should look at upgrading Hive earlier. It's not just that, the problem is that Hive 2.3 relies on versions of Guava and Avro that are older than the versions in Iceberg. So if you run the InputFormat using Hive's libraries there are all kinds of "method not found" and other exceptions thrown. As I said, we couldn't get Gradle to allow us to override and shadow things properly within Iceberg itself which is why we created the above project separately. We then also needed to make these changes to Iceberg to shade the libraries it is using that cause problems with Hive: https://github.com/apache/incubator-iceberg/compare/master...ExpediaGroup:build-hiveberg-modules It would be nice to find some way to do all the above within Iceberg itself and then move the "hiveberg" code over there.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
