Re: Spark thrift service and Hive impersonation.

2015-10-06 Thread Steve Loughran
On 5 Oct 2015, at 22:51, Jagat Singh > wrote: Hello Steve, Thanks for confirmation. Is there any work planned work on this. Not that I'm aware of, though somebody may be doing it. SparkSQL is not hive. It uses some of the libraries -the

Re: Spark thrift service and Hive impersonation.

2015-10-05 Thread Jagat Singh
Hello Steve, Thanks for confirmation. Is there any work planned work on this. Thanks, Jagat Singh On Wed, Sep 30, 2015 at 9:37 PM, Vinay Shukla wrote: > Steve is right, > The Spark thing server does not profs page end user identity downstream > yet. > > > > On

Re: Spark thrift service and Hive impersonation.

2015-09-30 Thread Steve Loughran
On 30 Sep 2015, at 03:24, Mohammed Guller > wrote: Does each user needs to start own thrift server to use it? No. One of the benefits of the Spark Thrift Server is that it allows multiple users to share a single SparkContext. Most likely,

Re: Spark thrift service and Hive impersonation.

2015-09-30 Thread Vinay Shukla
Steve is right, The Spark thing server does not profs page end user identity downstream yet. On Wednesday, September 30, 2015, Steve Loughran wrote: > > On 30 Sep 2015, at 03:24, Mohammed Guller

RE: Spark thrift service and Hive impersonation.

2015-09-29 Thread Mohammed Guller
Jagat Singh [mailto:jagatsi...@gmail.com] Sent: Tuesday, September 29, 2015 6:32 PM To: Mohammed Guller Cc: SparkUser Subject: Re: Spark thrift service and Hive impersonation. Hi, Thanks for your reply. If you see the log message Error: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to

RE: Spark thrift service and Hive impersonation.

2015-09-29 Thread Mohammed Guller
Does each user needs to start own thrift server to use it? No. One of the benefits of the Spark Thrift Server is that it allows multiple users to share a single SparkContext. Most likely, you have file permissions issue. Mohammed From: Jagat Singh [mailto:jagatsi...@gmail.com] Sent: Tuesday,

Re: Spark thrift service and Hive impersonation.

2015-09-29 Thread Jagat Singh
Hi, Thanks for your reply. If you see the log message Error: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table mytable. java.security.AccessControlException: Permission denied: user=spark, access=READ, inode="/data/mytable":tdcprdr:tdcprdr:drwxr-x--x Spark is trying to