[
https://issues.apache.org/jira/browse/HIVE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15973590#comment-15973590
]
Xuefu Zhang commented on HIVE-15302:
------------------------------------
[~lirui] I think Marcelo's suggestion makes sense. It's quite tedious and
error-prone to figured out what classes are needed for HoS. It's better if we
utilize a maven plugin that figures out this and pack them in an archive to be
used as spark.yarn.jars. I'm pretty positive that such a plugin exists.
Under the cover, Hive depends on spark-core, which has its own dependencies.
the plugin should be able to figure out all dependencies. The plugin should
also allow you to exclude anything that you don't want to include.
(As a fyi, spark-core.jar direct dependencies can be found in its maven pom
file.)
> Relax the requirement that HoS needs Spark built w/o Hive
> ---------------------------------------------------------
>
> Key: HIVE-15302
> URL: https://issues.apache.org/jira/browse/HIVE-15302
> Project: Hive
> Issue Type: Improvement
> Reporter: Rui Li
> Assignee: Rui Li
>
> This requirement becomes more and more unacceptable as SparkSQL becomes
> widely adopted. Let's use this JIRA to find out how we can relax the
> limitation.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
