Hi,
I am wondering: Is it possible to run spark-submit in a mode where it will
start an application on a YARN cluster (i.e., driver and executors run on
the cluster) and then forget about it in the sense that the Spark
application is completely independent from the host that ran the
spark-submit
Thanks Tobias, I have filed a JIRA for it.
2014-09-18 10:09 GMT-07:00 Patrick Wendell pwend...@gmail.com:
I agree, that's a good idea Marcelo. There isn't AFAIK any reason the
client needs to hang there for correct operation.
On Thu, Sep 18, 2014 at 9:39 AM, Marcelo Vanzin
And for the record, the issue is here:
https://issues.apache.org/jira/browse/SPARK-3591
On Thu, Sep 18, 2014 at 1:19 PM, Andrew Or and...@databricks.com wrote:
Thanks Tobias, I have filed a JIRA for it.
2014-09-18 10:09 GMT-07:00 Patrick Wendell pwend...@gmail.com:
I agree, that's a good
Hi,
thanks for everyone's replies!
On Thu, Sep 18, 2014 at 7:37 AM, Sandy Ryza sandy.r...@cloudera.com
wrote:
YARN cluster mode should have the behavior you're looking for. The
client
process will stick around to report on things, but should be able to be
killed without affecting the
