[
https://issues.apache.org/jira/browse/OOZIE-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797679#comment-15797679
]
Dongying Jiao commented on OOZIE-2767:
--------------------------------------
I think this is related to OOZIE-2482, the SPARK_HOME is set to current dir in
SparkActionExecutor, so when spark check R/lib in SPARK_HOME, nothing can be
found.
Maybe oozie should create R lib in SparkMain like createPySparkLibFolder.
> Oozie 4.3.0 with spark 2.0 run spark R job on yarn cluster mode failed
> -----------------------------------------------------------------------
>
> Key: OOZIE-2767
> URL: https://issues.apache.org/jira/browse/OOZIE-2767
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.3.0
> Reporter: Dongying Jiao
>
> Erro seen from yarn log:
> Warning: Master yarn-cluster is deprecated since 2.0. Please use master
> "yarn" with specified deploy mode instead.
> Error: sparkr.zip does not exist for R application in YARN mode.
> Run with --help for usage help or --verbose for debug output
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
> End of LogType:stderr
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
