Hi Steve, Could you share your opinion on whether the token gets renewed or not? Is the token going to expire after 7 days anyway? Why is the change in the recent version for token renewal? See https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d198cb94ffa
Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Tue, Aug 23, 2016 at 11:51 AM, Steve Loughran <ste...@hortonworks.com> wrote: > > On 21 Aug 2016, at 20:43, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > > Hi Kamesh, > > The message you are getting after 7 days: > > PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS) > cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): > Token has expired > > Sounds like an IPC issue with Kerberos Authentication time out. Suggest you > talk to your Linux admin and also check this link: > > https://support.f5.com/kb/en-us/products/big-ip_apm/manuals/product/apm-authentication-single-sign-on-11-5-0/9.print.html > > > > > 7 days is one of the big kerberos timeout events; why its best to deploy a > new system on a tuesday morning. > > You are going to need to configure your spark app with a keytab in > spark.yarn.keytab; see > http://spark.apache.org/docs/latest/running-on-yarn.html --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org