Some can't be relocated, it is pretty challenging to relocate them, one I remember is calcite, I tried that here: https://issues.apache.org/jira/browse/HIVE-23772 & it didn't work, I am not sure if things have changed now.
Relocated dependencies shouldn't be problematic I believe, having jars shaded but not relocated is problematic in some cases, you can't get rid of them via exclusion and then they tend to create classpath conflicts, we are exploring ways to get Spark move from 2.3.9 to 4.0, Our initial hunch is that it would be quite challenging without a hive-exec slim jar which doesn't have these dependencies or has minimal shading. -Ayush On Tue, 16 Apr 2024 at 21:07, László Bodor <bodorlaszlo0...@gmail.com> wrote: > isn't this as simple to solve as relocating joda (or what causes problems > in general)? I cannot recall when and why we removed the core jar, and I'm > not against it, but I feel that relocating something that is already shaded > in the uber jar is much easier > > looks like we shade a lot: > https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1032 > but relocate only a few: > https://github.com/apache/hive/blob/f06cc2920424817da6405e0efe268ce6cd64a363/ql/pom.xml#L1110 > > we already have a huge uber jar due to including everything, I feel > relocation doesn't make it any worse > relocation is only dangerous if the relocated classes are present in > hive-exec public method signatures (TODO check joda from this aspect) > > Mergu Ravi <mergu.r...@gaianconsultants.com.invalid> ezt írta (időpont: > 2024. ápr. 16., K, 17:21): > >> When can we expect the core jar for 4.0.0 version. >> >> On Tue, Apr 16, 2024 at 4:57 PM Denys Kuzmenko <dkuzme...@apache.org> >> wrote: >> >>> Hi Ravi, >>> >>> hive-exec is the uber jar, the same thing is done in Hive-3.x. We are >>> considering restoring the hive-core jar that only has classes from ql >>> >>> On 2024/04/16 06:24:20 Mergu Ravi wrote: >>> > Hi Hive Team, >>> > >>> > I'm currently using the Hive 4.0.0 libraries and facing an issue with >>> the >>> > hive-exec:4.0.0 library. It seems that the Joda-Time library is bundled >>> > within it, preventing me from excluding it and using my existing >>> Joda-Time >>> > library. Could you please provide insight into why this bundling has >>> been >>> > implemented? Additionally, is there any plan to unbundle the Joda-Time >>> > library in future releases? >>> > >>> > -- >>> > >>> > Thanks & Regards, >>> > >>> > >>> > <http://www.gaiansolutions.com/> >>> > Ravi Mergu >>> > SMTS-2 >>> > o: +91 40 64535355 >>> > m: +91 9959618687 >>> > w: www.gaiansolutions.com >>> > >>> > <http://www.facebook.com/GaianConsultants> >>> > <http://www.linkedin.com/company/gaian-consultants/> >>> > <http://twitter.com/gaianconsultant?lang=en> >>> > >>> > *Please consider the environment before printing this email.* This >>> message >>> > contains confidential information and is intended only for the >>> individual >>> > named. If you are not the named addressee you should not disseminate, >>> > distribute or copy this e-mail >>> > >>> >> >> >> -- >> >> Thanks & Regards, >> >> >> <http://www.gaiansolutions.com/> >> Ravi Mergu >> SMTS-2 >> o: +91 40 64535355 >> m: +91 9959618687 >> w: www.gaiansolutions.com >> >> <http://www.facebook.com/GaianConsultants> >> <http://www.linkedin.com/company/gaian-consultants/> >> <http://twitter.com/gaianconsultant?lang=en> >> >> *Please consider the environment before printing this email.* This >> message contains confidential information and is intended only for the >> individual named. If you are not the named addressee you should not >> disseminate, distribute or copy this e-mail >> >>
