[
https://issues.apache.org/jira/browse/HIVE-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15688947#comment-15688947
]
liyunzhang_intel commented on HIVE-15259:
-----------------------------------------
[~ruili]: thanks for your reply. In yarn mode, after i only copy necessary
libraries which listed in HIVE-14825, the deserialization time is reduced from
4s to 1s.
i will continue to investigate why the deserialization time is reduced if i
copy less jars to $HIVE_HOME/lib/.
> The deserialization time of HOS20 is longer than what in HOS16
> ---------------------------------------------------------------
>
> Key: HIVE-15259
> URL: https://issues.apache.org/jira/browse/HIVE-15259
> Project: Hive
> Issue Type: Improvement
> Reporter: liyunzhang_intel
> Attachments: Deserialization_HOS16.PNG, Deserialization_HOS20.PNG
>
>
> deploy Hive on Spark on spark 1.6 version and spark 2.0 version.
> run query and in latest code(with spark2.0) the deserialization time of a
> task is 4 sec while the deserialization time of spark1.6 is 1 sec. The detail
> is in attached picture.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
