Phoenix Plugin for Spark - connecting to Phoenix in secured cluster.

2016-12-08 Thread Marcin Pastecki
Hello all, I have problem accessing HBase using Spark Phoenix Plugin in secured cluster. Versions: Spark 1.6.1, HBase 1.1.2.2.4, Phoenix 4.4.0 Using sqlline.py works just fine. I have valid Kerberos ticket. Trying to get this to work in local mode first. What I'm doing is basic test as

Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode

2016-12-07 Thread Marcin Pastecki
My understanding is that the token generation is handled by Spark itself as long as you were authenticated in Kerberos when submitting the job and spark.authenticate is set to true. --keytab and --principal options should be used for "long" running job, when you may need to do ticket renewal.