[
https://issues.apache.org/jira/browse/SPARK-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-18643:
---------------------------------
Description:
1) Install SparkR from source package, ie.
R CMD INSTALL SparkR_2.1.0.tar.gz
2) Start SparkR (not from sparkR shell)
library(SparkR)
sparkR.session()
Notice SparkR hangs when it couldn't find spark-submit to launch the JVM
backend.
{code}
Launching java with spark-submit command spark-submit sparkr-shell
/tmp/RtmpYbAYt5/backend_port5849dc2273
sh: 1: spark-submit: not found
{code}
If SparkR is running as a package and it has previously downloaded Spark Jar it
should be able to run as before without having to set SPARK_HOME. Basically
with this bug the auto install Spark will only work in the first session.
This seems to be a regression on the earlier behavior.
was:
1) Install SparkR from source package, ie.
R CMD INSTALL SparkR_2.1.0.tar.gz
2) Start SparkR (not from sparkR shell)
library(SparkR)
sparkR.session()
Notice SparkR hangs when it couldn't find spark-submit to launch the JVM
backend.
If SparkR is running as a package and it has previously downloaded Spark Jar it
should be able to run as before without having to set SPARK_HOME. Basically
with this bug the auto install Spark will only work in the first session.
This seems to be a regression on the earlier behavior.
> SparkR hangs at session start when installed as a package without SPARK_HOME
> set
> --------------------------------------------------------------------------------
>
> Key: SPARK-18643
> URL: https://issues.apache.org/jira/browse/SPARK-18643
> Project: Spark
> Issue Type: Bug
> Components: SparkR
> Affects Versions: 2.1.0
> Reporter: Felix Cheung
> Assignee: Felix Cheung
> Priority: Critical
>
> 1) Install SparkR from source package, ie.
> R CMD INSTALL SparkR_2.1.0.tar.gz
> 2) Start SparkR (not from sparkR shell)
> library(SparkR)
> sparkR.session()
> Notice SparkR hangs when it couldn't find spark-submit to launch the JVM
> backend.
> {code}
> Launching java with spark-submit command spark-submit sparkr-shell
> /tmp/RtmpYbAYt5/backend_port5849dc2273
> sh: 1: spark-submit: not found
> {code}
> If SparkR is running as a package and it has previously downloaded Spark Jar
> it should be able to run as before without having to set SPARK_HOME.
> Basically with this bug the auto install Spark will only work in the first
> session.
> This seems to be a regression on the earlier behavior.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
