[
https://issues.apache.org/jira/browse/OOZIE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797296#comment-15797296
]
Dongying Jiao commented on OOZIE-2767:
--------------------------------------
>From spark code, spark will find sparkr.zip in SPARK_HOME/R/lib dir, if can't
>find this zip file, the error will come out.
I install spark on every nodes on my cluster, and also try to define SPARK_HOME
in /etc/profile, but the error is still there.
Thanks
> Oozie 4.3.0 with spark 2.0 run spark R job on yarn cluster mode failed
> -----------------------------------------------------------------------
>
> Key: OOZIE-2767
> URL: https://issues.apache.org/jira/browse/OOZIE-2767
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.3.0
> Reporter: Dongying Jiao
>
> Erro seen from yarn log:
> Warning: Master yarn-cluster is deprecated since 2.0. Please use master
> "yarn" with specified deploy mode instead.
> Error: sparkr.zip does not exist for R application in YARN mode.
> Run with --help for usage help or --verbose for debug output
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
> End of LogType:stderr
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
