[
https://issues.apache.org/jira/browse/PIG-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738127#comment-14738127
]
Srikanth Sundarrajan commented on PIG-4667:
-------------------------------------------
{quote}
would spark-assembly.jar help in this case? If so, it's fine to require this
jar to be in Pig /lib directory.
{quote}
Spark-assembly isn't published to maven after v1.1.1, If we depend on the
spark-assembly inside SPARK_HOME it might work.
I will try to use SPARK_DIST_CLASSPATH. In the event, I run into issues will
make an assumption about SPARK_HOME being available. Either way will try and
get a patch out to enable this on pig.
> Enable Pig on Spark to run on Yarn Client/Cluster mode
> ------------------------------------------------------
>
> Key: PIG-4667
> URL: https://issues.apache.org/jira/browse/PIG-4667
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Srikanth Sundarrajan
> Assignee: Srikanth Sundarrajan
> Fix For: spark-branch
>
> Attachments: PIG-4667-logs.tgz
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
