Hi Steve,
Thanks a lot for such an elaborative email (though it brought more
questions than answers but it's because I'm new to YARN in general and
Kerberos/tokens/tickets in particular).
Thanks also for liking my notes. I'm very honoured to hear it from
you. I value your work with Spark/YARN/Had
> On 23 Aug 2016, at 11:26, Jacek Laskowski wrote:
>
> Hi Steve,
>
> Could you share your opinion on whether the token gets renewed or not?
> Is the token going to expire after 7 days anyway?
There's Hadoop service tokens, and Kerberos tickets. They are similar-ish, but
not quite the same.
Hi Steve,
Could you share your opinion on whether the token gets renewed or not?
Is the token going to expire after 7 days anyway? Why is the change in
the recent version for token renewal? See
https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d198cb94ffa
Pozdrawiam,
Jacek Lasko
On 21 Aug 2016, at 20:43, Mich Talebzadeh
mailto:mich.talebza...@gmail.com>> wrote:
Hi Kamesh,
The message you are getting after 7 days:
PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$
Hi Kamesh,
The message you are getting after 7 days:
PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
cause:org.apache.hadoop.ipc.RemoteException(org.apache.
hadoop.security.token.SecretManager$InvalidToken): Token has expired
Sounds like an IPC issue with Kerberos Authentication
Hi Kamesh,
I believe your only option is to re-start your application every 7
days (perhaps you need to enable checkpointing). See
https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d198cb94ffa
for a change with automatic security token renewal.
Pozdrawiam,
Jacek Laskowski
Hi all,
I am running a spark streaming application that store events into
Secure(Kerborized) HBase cluster. I launched this spark streaming
application by passing --principal and --keytab. Despite this, spark
streaming application is failing after *7days* with Token issue. Can
someone please sugg
