[ https://issues.apache.org/jira/browse/PIG-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737405#comment-14737405 ]
Marcelo Vanzin commented on PIG-4667: ------------------------------------- Unfortunately, Spark currently assumes that there is an assembly with all the dependencies included. So if that's not how you're setting things up, you're gonna have to hack around that to add stuff to the AM's classpath. A good pointer might be the patch for OOZIE-2277 - Robert did a lot of the investigation into what's needed to get Spark working without the assembly around. It's not pretty, but currently that's the only way we know. :-/ > Enable Pig on Spark to run on Yarn Client/Cluster mode > ------------------------------------------------------ > > Key: PIG-4667 > URL: https://issues.apache.org/jira/browse/PIG-4667 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: Srikanth Sundarrajan > Assignee: Srikanth Sundarrajan > Fix For: spark-branch > > Attachments: PIG-4667-logs.tgz > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)