RE: Connecting SparkR through Yarn

2015-11-13 Thread Sun, Rui
To: Sun, Rui; user@spark.apache.org Subject: Re: Connecting SparkR through Yarn Hi Sun, Thank you for reply. I did the same, but now I am getting another issue. i.e: Not able to connect to ResourceManager after submitting the job the Error message showing something like this Connecting

RE: Connecting SparkR through Yarn

2015-11-10 Thread Sun, Rui
r example Sys.setenv ("SPARKR_SUBMIT_ARGS", " --master yarn-client --num-executors 4 sparkr-shell" Before calling sparkR.init(). From: Amit Behera [mailto:amit.bd...@gmail.com] Sent: Monday, November 9, 2015 2:36 AM To: user@spark.apache.org Subject: Connecting SparkR through Yar

Connecting SparkR through Yarn

2015-11-08 Thread Amit Behera
Hi All, Spark Version = 1.5.1 Hadoop Version = 2.6.0 I set up the cluster in Amazon EC2 machines (1+5) I am able create a SparkContext object using *init* method from *RStudio.* But I do not know how can I create a SparkContext object in *yarn mode.* I got the below link to run on yarn. but in