Hi,
I am using spark-0,8,1, and what's the meaning of spark.driver.host? I ran
SparkPi failed.(either yarn-standalone or yarn-client)
It was 'Hostname or IP address for the driver to listen on.' in the
document. but what host the Driver will listen on? the RM on the yarn? if
yes, I configured
@spark.incubator.apache.org
Subject: About spark.driver.host
Hi,
I am using spark-0,8,1, and what's the meaning of spark.driver.host? I ran
SparkPi failed.(either yarn-standalone or yarn-client)
It was 'Hostname or IP address for the driver to listen on.' in the document.
but what host the Driver
To: user@spark.incubator.apache.org
Subject: About spark.driver.host
Hi,
I am using spark-0,8,1, and what's the meaning of spark.driver.host? I ran
SparkPi failed.(either yarn-standalone or yarn-client)
It was 'Hostname or IP address for the driver to listen on.' in the
document. but what host
in Automatically and pass it to AM and Executor to use to connect to
Driver.
Did you follow the guide in docs/running-on-yarn.md ?
Best Regards,
Raymond Liu
From: Azuryy Yu [mailto:azury...@gmail.com]
Sent: Tuesday, December 17, 2013 11:16 AM
To: user@spark.incubator.apache.org
Subject: About
Subject: Re: About spark.driver.host
Raymond:
Add addtional: Yes, I build Spark-0.8.1 with -Pnew-yarn, and I followed
run-on-yarn.cmd strictly.
Spark web UI shows good for everything.
On Tue, Dec 17, 2013 at 12:36 PM, Azuryy Yu
azury...@gmail.commailto:azury...@gmail.com wrote:
Thanks, Raymond!
My
:43 PM
*To:* user@spark.incubator.apache.org
*Subject:* Re: About spark.driver.host
Raymond:
Add addtional: Yes, I build Spark-0.8.1 with -Pnew-yarn, and I followed
run-on-yarn.cmd strictly.
Spark web UI shows good for everything.
On Tue, Dec 17, 2013 at 12:36 PM, Azuryy Yu azury
To: user@spark.incubator.apache.org
Subject: Re: About spark.driver.host
Hi raymond,
I specified Master and Slaves in the conf.
As for yarn-standalone and yarn-client, I have some confusion:
If I am use yarn-standalone, does that mean, It's not run on yarn cluster, only
pseudo-http://dict.cn/pseudo
.
Best Regards,
*Raymond Liu*
*From:* Azuryy Yu [mailto:azury...@gmail.com]
*Sent:* Tuesday, December 17, 2013 1:19 PM
*To:* user@spark.incubator.apache.org
*Subject:* Re: About spark.driver.host
Hi raymond,
I specified Master and Slaves in the conf.
As for yarn-standalone