Re: spark.authenticate=true YARN mode doesn't work

Prasad, As I mentioned in my first reply, you need to enable spark.authenticate in the shuffle service's configuration too for this to work. It doesn't seem like you have done that. On Sun, Dec 6, 2015 at 5:09 PM, Prasad Reddy wrote: > Hi Marcelo, > > I am attaching all

Re: spark.authenticate=true YARN mode doesn't work

Hi Prasad, please reply to the list so that others can benefit / help. On Sat, Dec 5, 2015 at 4:06 PM, Prasad Reddy wrote: > Have you had a chance to try this authentication for any of your projects > earlier. Yes, we run with authenticate=true by default. It works fine.

Re: spark.authenticate=true YARN mode doesn't work

On Fri, Dec 4, 2015 at 5:47 PM, prasadreddy wrote: > I am running Spark YARN and trying to enable authentication by setting > spark.authenticate=true. After enable authentication I am not able to Run > Spark word count or any other programs. Define "I am not able to run".

spark.authenticate=true YARN mode doesn't work

Hi All, I am running Spark YARN and trying to enable authentication by setting spark.authenticate=true. After enable authentication I am not able to Run Spark word count or any other programs. Any help will be appreciated. Thanks -- View this message in context:

Re: spark.authenticate=true YARN mode doesn't work

Which release are you using ? Please take a look at https://spark.apache.org/docs/latest/running-on-yarn.html There're several config parameters related to security: spark.yarn.keytab spark.yarn.principal ... FYI On Fri, Dec 4, 2015 at 5:47 PM, prasadreddy wrote: > Hi

Re: spark.authenticate=true YARN mode doesn't work

Did you try setting "spark.authenticate.secret" ? Cheers On Fri, Dec 4, 2015 at 7:07 PM, Prasad Reddy wrote: > Hi Ted, > > Thank you for the reply. > > I am using 1.5.2. > > I am implementing SASL encryption. Authentication is required to implement > SASL Encryption. > >

Re: spark.authenticate=true YARN mode doesn't work

I did tried. Same problem. as you said earlier. spark.yarn.keytab spark.yarn.principal are required. On Fri, Dec 4, 2015 at 7:25 PM, Ted Yu wrote: > Did you try setting "spark.authenticate.secret" ? > > Cheers > > On Fri, Dec 4, 2015 at 7:07 PM, Prasad Reddy