cluster.YarnClusterScheduler start? where's the Client?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-spark-submit-command-hangs-tp10308p10392.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
That's what my problem is:)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-spark-submit-command-hangs-tp10308p10394.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
:25 GMT-07:00 Earthson earthson...@gmail.com:
That's what my problem is:)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Why-spark-submit-command-hangs-tp10308p10394.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Hi Experts,
I setup Yarn and Spark env: all services runs on a single node. And then
submited a WordCount job using spark-submit script with
command:./bin/spark-submit tests/wordcount-spark-scala.jar --class
scala.spark.WordCount --num-executors 1 --driver-memory 300M --executor-memory
300M
Hi Sam,
Did you specify the MASTER in your spark-env.sh? I ask because I didn't see
a --master in your launch command. Also, your app seems to take in a master
(yarn-standalone). This is not exactly correct because by the time the
SparkContext is launched locally, which is the default, it is too
