: Josh Rosen rosenvi...@gmail.com
To: Marcelo Vanzin van...@cloudera.com
Cc: freedafeng freedaf...@yahoo.com; user@spark.apache.org
user@spark.apache.org
Sent: Wednesday, January 14, 2015 3:20 PM
Subject: Re: how to run python app in yarn?
There's an open PR for supporting yarn-cluster mode
for debug output
Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-run-python-app-in-yarn-tp21141.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
Got help from Marcelo and Josh. Now it is running smoothly. In case you need
this info - Just use yarn-client instead of yarn-cluster
Thanks folks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/how-to-run-python-app-in-yarn-tp21141p21142.html
Sent from
There's an open PR for supporting yarn-cluster mode in PySpark:
https://github.com/apache/spark/pull/3976 (currently blocked on reviewer
attention / time)
On Wed, Jan 14, 2015 at 3:16 PM, Marcelo Vanzin van...@cloudera.com wrote:
As the error message says...
On Wed, Jan 14, 2015 at 3:14 PM,
As the error message says...
On Wed, Jan 14, 2015 at 3:14 PM, freedafeng freedaf...@yahoo.com wrote:
Error: Cluster deploy mode is currently not supported for python
applications.
Use yarn-client instead of yarn-cluster for pyspark apps.
--
Marcelo
