?
Checking to see if you provide a keytab and principal in your invocation.
-
Neelesh S. Salian
Cloudera
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Creating-new-Spark-context-when-running-in-Secure-YARN-fails-tp25361p26873.html
Sent from the Apache Spark
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Creating-new-Spark-context-when-running-in-Secure-YARN-fails-tp25361.html
Sent from the Apache Spark User List mailing list archive at
ih...@gmail.com>
To: Michael V Le/Watson/IBM@IBMUS
Cc: user <user@spark.apache.org>
Date: 11/11/2015 01:55 PM
Subject: Re: Creating new Spark context when running in Secure YARN
fails
Looks like the delegation token should be renewed.
Mind trying the followi
ine.invoke(ReflectionEngine.java:379)
> at py4j.Gateway.invoke(Gateway.java:214)
> at
>
> py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
> at
> py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68
gmail.com>
> To: Michael V Le/Watson/IBM@IBMUS
> Cc: user <user@spark.apache.org>
> Date: 11/11/2015 01:55 PM
> Subject: Re: Creating new Spark context when running in Secure YARN fails
> --
>
>
>
> Looks like the delegat
e: 11/11/2015 03:35 PM
Subject: Re: Creating new Spark context when running in Secure YARN
fails
I assume your config contains "spark.yarn.credentials.file" -
otherwise startExecutorDelegationTokenRenewer(conf) call would be skipped.
On Wed, Nov 11, 2015 at 12:16 PM,
Thanks,
>Mike
>
>[image: Inactive hide details for Ted Yu ---11/11/2015 01:55:02
>PM---Looks like the delegation token should be renewed. Mind trying the]Ted
>Yu ---11/11/2015 01:55:02 PM---Looks like the delegation token should be
>
