Have you removed all the code dealing with Kerberos that you posted? You should not be setting those principal / keytab configs.
Literally all you have to do is login with kinit then run spark-submit. Try with the SparkPi example for instance, instead of your own code. If that doesn't work, you have a configuration issue somewhere. On Wed, Dec 7, 2016 at 1:09 PM, Gerard Casey <gerardhughca...@gmail.com> wrote: > Thanks. > > I’ve checked the TGT, principal and key tab. Where to next?! > >> On 7 Dec 2016, at 22:03, Marcelo Vanzin <van...@cloudera.com> wrote: >> >> On Wed, Dec 7, 2016 at 12:15 PM, Gerard Casey <gerardhughca...@gmail.com> >> wrote: >>> Can anyone point me to a tutorial or a run through of how to use Spark with >>> Kerberos? This is proving to be quite confusing. Most search results on the >>> topic point to what needs inputted at the point of `sparks submit` and not >>> the changes needed in the actual src/main/.scala file >> >> You don't need to write any special code to run Spark with Kerberos. >> Just write your application normally, and make sure you're logged in >> to the KDC (i.e. "klist" shows a valid TGT) before running your app. >> >> >> -- >> Marcelo > -- Marcelo --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
