Re: run spark job in yarn cluster mode as specified user

mar...@roo.ee>: > Hi > > org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor requires > user in each node and right permissions set in necessary directories. > > Br > Margus > > > On 22 Jan 2018, at 13:41, sd

Re: run spark job in yarn cluster mode as specified user

user who executes script. > > Br > Margus > > > > On 22 Jan 2018, at 09:28, sd wang <pingwang1...@gmail.com> wrote: > > Hi Advisers, > When submit spark job in yarn cluster mode, the job will be executed by > "yarn" user. Any parameters can change the

run spark job in yarn cluster mode as specified user

Hi Advisers, When submit spark job in yarn cluster mode, the job will be executed by "yarn" user. Any parameters can change the user? I tried setting HADOOP_USER_NAME but it did not work. I'm using spark 2.2. Thanks for any help!