[ 
https://issues.apache.org/jira/browse/PIG-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737405#comment-14737405
 ] 

Marcelo Vanzin commented on PIG-4667:
-------------------------------------

Unfortunately, Spark currently assumes that there is an assembly with all the 
dependencies included. So if that's not how you're setting things up, you're 
gonna have to hack around that to add stuff to the AM's classpath. A good 
pointer might be the patch for OOZIE-2277 - Robert did a lot of the 
investigation into what's needed to get Spark working without the assembly 
around. It's not pretty, but currently that's the only way we know. :-/

> Enable Pig on Spark to run on Yarn Client/Cluster mode
> ------------------------------------------------------
>
>                 Key: PIG-4667
>                 URL: https://issues.apache.org/jira/browse/PIG-4667
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>            Reporter: Srikanth Sundarrajan
>            Assignee: Srikanth Sundarrajan
>             Fix For: spark-branch
>
>         Attachments: PIG-4667-logs.tgz
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to