multiple Spark Thrift Servers running in the same machine throws org.apache.hadoop.security.AccessControlException

I have two users (etl , dev ) start Spark Thrift Server in the same machine . I connected by beeline etl STS to execute a command,and throwed org.apache.hadoop.security.AccessControlException.I don't know why is dev user perform,not etl. It is a spark bug? I am using spark2.0.2 Caused by:

hive.exec.stagingdir not effect in spark2.0.1

Hi , I have set property "hive.exec.stagingdir" to hdfs dir "/tmp/spark_log/${user.name}/.hive-staging" in hive-site.xml ,but it not effect in spark2.0.1, directory name that still be created inside table locations .It works in spark 1.6,and creates hive-staging files in hdfs dir

How to share cached tables when the Thrift server runs in multi-session mode in spark 1.6

HI I created a cached table through Session A via beeline, through which I am able to access data. I tried to access this cached table from another session, but I cannot find it. Got the solution from spark site itself: From Spark 1.6, by default the Thrift server runs in

答复: My notes on Spark Performance & Tuning Guide

Thanks for your sharing! Please include me too 发件人: Mich Talebzadeh 发送时间: ‎2016/‎5/‎18 5:16 收件人: user @spark 主题: Re: My notes on Spark Performance & Tuning Guide Hi all, Many thanks for your

insert into a partition table take a long time

Hello Sir/Madam I want to insert into a partition table using dynamic partition (about 300G ,dst table created in a orc format), but in stage "get_partition_with_auth" take a long time , while I have set hive.exec.dynamic.partition=true