[
https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16069728#comment-16069728
]
liyunzhang_intel commented on PIG-5157:
---------------------------------------
[~nkollar]: with PIG-5157_13.patch on review board.
the test result ：
pass on spark1 or spark2 on local mode
failed on yarn-client mode( add spark.master=yarn-client in conf/pig.properties)
exception message found in log
{noformat}
[shuffle-server-0] 2017-06-30 14:24:25,501 WARN
server.TransportChannelHandler
(TransportChannelHandler.java:exceptionCaught(79)) - Excepti on in connection
from /10.239.47.58:58214
1264 java.lang.NoSuchMethodError:
org.apache.spark.network.client.TransportClient.getChannel()Lio/netty/channel/Channel;
{noformat}
If you can not reproduce in your env, also tell me, will check whether it is
caused by configuraion or not.
> Upgrade to Spark 2.0
> --------------------
>
> Key: PIG-5157
> URL: https://issues.apache.org/jira/browse/PIG-5157
> Project: Pig
> Issue Type: Improvement
> Components: spark
> Reporter: Nandor Kollar
> Assignee: Nandor Kollar
> Fix For: 0.18.0
>
> Attachments: PIG-5157.patch
>
>
> Upgrade to Spark 2.0 (or latest)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
