Re: HiveContext creation failed with Kerberos

2015-12-09 Thread Neal Yin
ate: Tuesday, December 8, 2015 at 4:09 AM To: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Re: HiveContext creation failed with Kerberos On 8 Dec 2015, at 06:52, Neal Yin <neal@workday.com<

Re: HiveContext creation failed with Kerberos

2015-12-08 Thread Steve Loughran
On 8 Dec 2015, at 06:52, Neal Yin > wrote: 15/12/08 04:12:28 ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism

HiveContext creation failed with Kerberos

2015-12-07 Thread Neal Yin
Hi I am using Spark 1.5.1 with CDH 5.4.2. My cluster is kerberos protected. Here is pseudocode for what I am trying to do. ugi = UserGroupInformation.loginUserFromKeytabAndReturnUGI(“foo", “…") ugi.doAs( new PrivilegedExceptionAction() { val sparkConf: SparkConf = createSparkConf(…)