[ 
https://issues.apache.org/jira/browse/PIG-4681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14909168#comment-14909168
 ] 

Srikanth Sundarrajan commented on PIG-4681:
-------------------------------------------

In the cluster mode the Spark Context will be created on the AM and all the pig 
execution need to move to the AM. This requires us to initialize pigContext on 
the AM as well. Given that pig has always had a thick client which controlled 
the execution from this client, am inclined to mark this as "Wont Fix". I 
intend to add necessary notes in Docs/FAQs as a patch as part of this JIRA for 
future reference.

[~xuefuz], What are your thoughts?

> Enable Pig on Spark to run on Yarn Cluster mode
> -----------------------------------------------
>
>                 Key: PIG-4681
>                 URL: https://issues.apache.org/jira/browse/PIG-4681
>             Project: Pig
>          Issue Type: Sub-task
>          Components: spark
>    Affects Versions: spark-branch
>            Reporter: Srikanth Sundarrajan
>            Assignee: Srikanth Sundarrajan
>              Labels: spork
>             Fix For: spark-branch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to