[
https://issues.apache.org/jira/browse/PIG-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929384#comment-15929384
]
liyunzhang_intel commented on PIG-5189:
---------------------------------------
[~zjffdu]: you found other configuration items applicable for pig on spark if
we upgrade to spark2.0?
currently we only force users to upload spark-assembly*jar to hdfs in Pig on
Spark(spark1.6), so i think after upgrade to spark2.0, we need force users to
export {{spark.yarn.archive}} or {{spark.yarn.jars}}
> Support spark.yarn.archive for spark branch
> -------------------------------------------
>
> Key: PIG-5189
> URL: https://issues.apache.org/jira/browse/PIG-5189
> Project: Pig
> Issue Type: Bug
> Reporter: liyunzhang_intel
>
> spark.yarn.archive is a configuration item in spark2.0 which is a similar as
> SPARK_JAR in spark1.6. The detail use we can refer SPARK-13955. After we
> upgrade to spark2.0, we can use this configuration item.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
