[
https://issues.apache.org/jira/browse/HIVE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989148#comment-13989148
]
Chris Drome commented on HIVE-6765:
-----------------------------------
[~adrian-wang] this does not appear to be an issue with hive-0.13 as they are
using Kryo for XML serialization.
For clarification, I found that several setting can impact whether this problem
arises or not. hive.auto.convert.join.noconditionaltask.size is used to
determine the big table candidate set. Then hive.mapjoin.smalltable.filesize is
used as a cutoff to determine whether a map-size join should be performed.
I found that when hive.auto.convert.join is true, it will try to perform a
map-side join first. Based on hive.auto.convert.join.noconditionaltask.size it
will return a set of big table candidates to the physical optimizer. The
physical optimizer will use hive.mapjoin.smalltable.filesize to determine
whether the map-side join should proceed. If not the clonePlan method is
called, which manifests the problem. I don't think it is solely influenced by
the size of the tables involved in the join. In my tests, shrinking the size of
the table allows the map-side join to proceed, while increasing the size of the
table causes this failure.
> ASTNodeOrigin unserializable leads to fail when join with view
> --------------------------------------------------------------
>
> Key: HIVE-6765
> URL: https://issues.apache.org/jira/browse/HIVE-6765
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.12.0
> Reporter: Adrian Wang
> Fix For: 0.13.0
>
> Attachments: HIVE-6765.patch.1
>
>
> when a view contains a UDF, and the view comes into a JOIN operation, Hive
> will encounter a bug with stack trace like
> Caused by: java.lang.InstantiationException:
> org.apache.hadoop.hive.ql.parse.ASTNodeOrigin
> at java.lang.Class.newInstance0(Class.java:359)
> at java.lang.Class.newInstance(Class.java:327)
> at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
