Got help from Marcelo and Josh. Now it is running smoothly. In case you need
this info - Just use "yarn-client" instead of "yarn-cluster"
Thanks folks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-run-python-app-in-yarn-tp2
: Josh Rosen
To: Marcelo Vanzin
Cc: freedafeng ; "user@spark.apache.org"
Sent: Wednesday, January 14, 2015 3:20 PM
Subject: Re: how to run python app in yarn?
There's an open PR for supporting yarn-cluster mode in PySpark:
https://github.com/apache/spark/pull/3976 (curre
There's an open PR for supporting yarn-cluster mode in PySpark:
https://github.com/apache/spark/pull/3976 (currently blocked on reviewer
attention / time)
On Wed, Jan 14, 2015 at 3:16 PM, Marcelo Vanzin wrote:
> As the error message says...
>
> On Wed, Jan 14, 2015 at 3:14 PM, freedafeng wrote:
As the error message says...
On Wed, Jan 14, 2015 at 3:14 PM, freedafeng wrote:
> Error: Cluster deploy mode is currently not supported for python
> applications.
Use "yarn-client" instead of "yarn-cluster" for pyspark apps.
--
Marcelo
erbose for debug output
Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-run-python-app-in-yarn-tp21141.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
--
