[ https://issues.apache.org/jira/browse/PIG-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909168#comment-14909168 ]
Srikanth Sundarrajan commented on PIG-4681: ------------------------------------------- In the cluster mode the Spark Context will be created on the AM and all the pig execution need to move to the AM. This requires us to initialize pigContext on the AM as well. Given that pig has always had a thick client which controlled the execution from this client, am inclined to mark this as "Wont Fix". I intend to add necessary notes in Docs/FAQs as a patch as part of this JIRA for future reference. [~xuefuz], What are your thoughts? > Enable Pig on Spark to run on Yarn Cluster mode > ----------------------------------------------- > > Key: PIG-4681 > URL: https://issues.apache.org/jira/browse/PIG-4681 > Project: Pig > Issue Type: Sub-task > Components: spark > Affects Versions: spark-branch > Reporter: Srikanth Sundarrajan > Assignee: Srikanth Sundarrajan > Labels: spork > Fix For: spark-branch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)