It seems the problem is with creating Usage: RBackend <tempFilePath> From: Sun, Rui [mailto:rui....@intel.com] Sent: Wednesday, October 07, 2015 10:23 PM To: Khandeshi, Ami; Hossein Cc: akhandeshi; user@spark.apache.org Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Can you extract the spark-submit command from the console output, and run it on the Shell, and see if there is any error message? From: Khandeshi, Ami [mailto:ami.khande...@fmr.com] Sent: Wednesday, October 7, 2015 9:57 PM To: Sun, Rui; Hossein Cc: akhandeshi; user@spark.apache.org<mailto:user@spark.apache.org> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio Tried, multiple permutation of setting home… Still same issue > Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1") > .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths())) > library(SparkR) Attaching package: ‘SparkR’ The following objects are masked from ‘package:stats’: filter, na.omit The following objects are masked from ‘package:base’: intersect, rbind, sample, subset, summary, table, transform > sc<-sparkR.init(master = "local") Launching java with spark-submit command c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd Error in sparkR.init(master = "local") : JVM is not ready after 10 seconds From: Sun, Rui [mailto:rui....@intel.com] Sent: Wednesday, October 07, 2015 2:35 AM To: Hossein; Khandeshi, Ami Cc: akhandeshi; user@spark.apache.org<mailto:user@spark.apache.org> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid? From: Hossein [mailto:fal...@gmail.com] Sent: Wednesday, October 7, 2015 12:46 AM To: Khandeshi, Ami Cc: Sun, Rui; akhandeshi; user@spark.apache.org<mailto:user@spark.apache.org> Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio Have you built the Spark jars? Can you run the Spark Scala shell? --Hossein On Tuesday, October 6, 2015, Khandeshi, Ami <ami.khande...@fmr.com.invalid<mailto:ami.khande...@fmr.com.invalid>> wrote: > Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell") > Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1) > > sc <- sparkR.init(master="local") Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391 Error in sparkR.init(master = "local") : JVM is not ready after 10 seconds In addition: Warning message: running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127 -----Original Message----- From: Sun, Rui [mailto:rui....@intel.com<javascript:;>] Sent: Tuesday, October 06, 2015 9:39 AM To: akhandeshi; user@spark.apache.org<javascript:;> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio What you have done is supposed to work. Need more debugging information to find the cause. Could you add the following lines before calling sparkR.init()? Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell") Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1) Then to see if you can find any hint in the console output -----Original Message----- From: akhandeshi [mailto:ami.khande...@gmail.com<javascript:;>] Sent: Tuesday, October 6, 2015 8:21 PM To: user@spark.apache.org<javascript:;> Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio I couldn't get this working... I have have JAVA_HOME set. I have defined SPARK_HOME Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1") .libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib") library(SparkR) sc<-sparkR.init(master="local") I get Error in sparkR.init(master = "local") : JVM is not ready after 10 seconds What am I missing?? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org<javascript:;> For additional commands, e-mail: user-h...@spark.apache.org<javascript:;> --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org<javascript:;> For additional commands, e-mail: user-h...@spark.apache.org<javascript:;> --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org<javascript:;> For additional commands, e-mail: user-h...@spark.apache.org<javascript:;> -- --Hossein
