[
https://issues.apache.org/jira/browse/LENS-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573333#comment-14573333
]
Yash Sharma commented on LENS-515:
----------------------------------
+0
I have successfully tested the patch against Hadoop 2.6.0.
But have downgraded to 2.4.0 recently and am hitting error against the patch.
Need some time to drill down the issue.
Error Log-
[Stage 0:> (0 + 2) /
3]2015-06-04 23:34:07,002 [sparkDriver-akka.actor.default-dispatcher-2] ERROR
org.apache.spark.scheduler.cluster.YarnScheduler - Lost executor 3 on yash:
remote Akka client disassociated
2015-06-04 23:34:07,065 [sparkDriver-akka.actor.default-dispatcher-2] ERROR
org.apache.spark.scheduler.cluster.YarnScheduler - Lost executor 4 on yash:
remote Akka client disassociated
[Stage 0:> (0 + 2) /
3]2015-06-04 23:34:32,148 [sparkDriver-akka.actor.default-dispatcher-4] ERROR
org.apache.spark.scheduler.cluster.YarnScheduler - Lost executor 1 on yash:
remote Akka client disassociated
2015-06-04 23:34:32,180 [sparkDriver-akka.actor.default-dispatcher-3] ERROR
org.apache.spark.scheduler.cluster.YarnScheduler - Lost executor 2 on yash:
remote Akka client disassociated
[Stage 0:> (0 + 1) /
3]2015-06-04 23:34:45,512 [sparkDriver-akka.actor.default-dispatcher-5] ERROR
org.apache.spark.scheduler.cluster.YarnScheduler - Lost executor 3 on yash:
remote Akka client disassociated
2015-06-04 23:34:45,514 [sparkDriver-akka.actor.default-dispatcher-5] ERROR
org.apache.spark.scheduler.TaskSetManager - Task 0 in stage 0.0 failed 4 times;
aborting job
> Support to run spark in yarn-client mode
> ----------------------------------------
>
> Key: LENS-515
> URL: https://issues.apache.org/jira/browse/LENS-515
> Project: Apache Lens
> Issue Type: Improvement
> Components: ml
> Reporter: Sharad Agarwal
> Assignee: Yash Sharma
> Attachments: Lens-515-1.patch
>
>
> currently spark only runs in embedded mode. support to run in yarn-client
> mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
