Re: spark on yarn history server + hdfs permissions issue

2014-09-11 Thread Greg Hill
...@rackspace.com Date: Tuesday, September 9, 2014 2:30 PM To: user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Subject: spark on yarn history server + hdfs permissions issue I am running Spark on Yarn with the HDP 2.1 technical preview. I'm having

spark on yarn history server + hdfs permissions issue

2014-09-09 Thread Greg Hill
I am running Spark on Yarn with the HDP 2.1 technical preview. I'm having issues getting the spark history server permissions to read the spark event logs from hdfs. Both sides are configured to write/read logs from: hdfs:///apps/spark/events The history server is running as user spark, the