[
https://issues.apache.org/jira/browse/HIVE-20032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555989#comment-16555989
]
Sahil Takiar commented on HIVE-20032:
-------------------------------------
Yeah, looks like the issue was with using the correct classloader. I think
{{Class.forName}} uses the system classloader rather than the
{{Thread.currentThread().getContextClassLoader()}} classloader. After switching
to the thread context class loader, things started to work and we don't have to
manually add the jar to the driver classpath anymore. Attached an updated patch.
Can you re-run your test with the latest patch (assuming Hive QA comes back
with a clean run)? I removed all the driver classpath logic I had added;
hopefully that fixed the issue.
> Don't serialize hashCode for repartitionAndSortWithinPartitions
> ---------------------------------------------------------------
>
> Key: HIVE-20032
> URL: https://issues.apache.org/jira/browse/HIVE-20032
> Project: Hive
> Issue Type: Improvement
> Components: Spark
> Reporter: Sahil Takiar
> Assignee: Sahil Takiar
> Priority: Major
> Attachments: HIVE-20032.1.patch, HIVE-20032.2.patch,
> HIVE-20032.3.patch, HIVE-20032.4.patch, HIVE-20032.5.patch,
> HIVE-20032.6.patch, HIVE-20032.7.patch, HIVE-20032.8.patch,
> HIVE-20032.9.patch, HIVE-20032.91.patch
>
>
> Follow up on HIVE-15104, if we don't enable RDD cacheing or groupByShuffles,
> then we don't need to serialize the hashCode when shuffling data in HoS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
