Re: Spark on Yarn: java.lang.IllegalArgumentException: Invalid rule

2015-01-27 Thread Niranjan Reddy
Thanks, Ted. Kerberos is enabled on the cluster. I'm new to the world of kerberos, so pease excuse my ignorance here. Do you know if there are any additional steps I need to take in addition to setting HADOOP_CONF_DIR? For instance, does hadoop.security.auth_to_local require any specific setting

Re: java.lang.ExceptionInInitializerError/Unable to load YARN support

2014-12-19 Thread Niranjan Reddy
Sean, Thanks for your response. My MapReduce and Spark 1.0 (prepackaged in CDH5) jobs are running fine. It's only Spark1.2 jobs that I'm unable to run NR On Dec 19, 2014 5:03 AM, Sean Owen so...@cloudera.com wrote: You've got Kerberos enabled, and it's complaining that it YARN doesn't like