It's what it said on the document. For yarn-standalone mode, it will be the
host of where spark AM runs, while for yarn-client mode, it will be the local
host you run the cmd.
And what's cmd you run SparkPi ? I think you actually don't need to set
sprak.driver.host manually for Yarn mode ,
Thanks, Raymond!
My command for Yarn mode:
SPARK_JAR=spark-0.8.1/lib/spark-assembly_2.9.3-0.8.1-incubating-hadoop1.2.1.jar
./spark-0.8.1/bin/spark-class org.apache.spark.deploy.yarn.Client --jar
spark-0.8.1/spark-examples_2.9.3-0.8.1-incubating.jar --class
org.apache.spark.examples.SparkPi
Raymond:
Add addtional: Yes, I build Spark-0.8.1 with -Pnew-yarn, and I followed
run-on-yarn.cmd strictly.
Spark web UI shows good for everything.
On Tue, Dec 17, 2013 at 12:36 PM, Azuryy Yu azury...@gmail.com wrote:
Thanks, Raymond!
My command for Yarn mode:
Subject: Re: About spark.driver.host
Raymond:
Add addtional: Yes, I build Spark-0.8.1 with -Pnew-yarn, and I followed
run-on-yarn.cmd strictly.
Spark web UI shows good for everything.
On Tue, Dec 17, 2013 at 12:36 PM, Azuryy Yu
azury...@gmail.commailto:azury...@gmail.com wrote:
Thanks, Raymond!
My
:43 PM
*To:* user@spark.incubator.apache.org
*Subject:* Re: About spark.driver.host
Raymond:
Add addtional: Yes, I build Spark-0.8.1 with -Pnew-yarn, and I followed
run-on-yarn.cmd strictly.
Spark web UI shows good for everything.
On Tue, Dec 17, 2013 at 12:36 PM, Azuryy Yu azury
To: user@spark.incubator.apache.org
Subject: Re: About spark.driver.host
Hi raymond,
I specified Master and Slaves in the conf.
As for yarn-standalone and yarn-client, I have some confusion:
If I am use yarn-standalone, does that mean, It's not run on yarn cluster, only
pseudo-http://dict.cn/pseudo
.
Best Regards,
*Raymond Liu*
*From:* Azuryy Yu [mailto:azury...@gmail.com]
*Sent:* Tuesday, December 17, 2013 1:19 PM
*To:* user@spark.incubator.apache.org
*Subject:* Re: About spark.driver.host
Hi raymond,
I specified Master and Slaves in the conf.
As for yarn-standalone
