You're specifying the queue in the spark-submit command line:
--queue thequeue
Are you sure that queue exists?
On Thu, Jan 15, 2015 at 11:23 AM, Manoj Samel wrote:
> Hi,
>
> Setup is as follows
>
> Hadoop Cluster 2.3.0 (CDH5.0)
> - Namenode HA
> - Resource manager HA
> - Secured with Kerbero
Hi,
Setup is as follows
Hadoop Cluster 2.3.0 (CDH5.0)
- Namenode HA
- Resource manager HA
- Secured with Kerberos
Spark 1.2
Run SparkPi as follows
- conf/spark-defaults.conf has following entries
spark.yarn.queue myqueue
spark.yarn.access.namenodes hdfs://namespace (remember this is namenode HA
