That's not true in yarn-cluster mode, where the driver runs in a
container that YARN creates, which may not be on the machine that runs
spark-submit.
As far as I know, however, you can't control where YARN allocates
that, and shouldn't need to.
You can probably query YARN to find where it did end up running though.
On Fri, Dec 19, 2014 at 5:44 AM, madhu phatak phatak@gmail.com wrote:
Hi,
The driver runs on the machine from where you did the spark-submit. You
cannot change that.
On Thu, Dec 18, 2014 at 3:44 PM, LinQili lin_q...@outlook.com wrote:
Hi all,
On yarn-cluster mode, can we let the driver running on a specific machine
that we choose in cluster ? Or, even the machine not in the cluster?
--
Regards,
Madhukara Phatak
http://www.madhukaraphatak.com
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
