Re: Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-17 Thread Jasson Chenwei
I got it. I will check your info. Many thanks for the help. Wei On Tue, May 16, 2017 at 9:14 PM, Miklos Szegedi wrote: > Hello Weiwei, > > Thank you for the information. > > Narrowing audience, since this is a yarn specific question: > I am curious why do the parent dirs need to be owned by r

Re: Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-16 Thread Jasson Chenwei
Make sense to me. I will check the configuration. Many thanks for the guide. Wei On Tue, May 16, 2017 at 8:40 PM, Weiwei Yang wrote: > Hi Jasson > > They need to be owned by root is to prevent malicious user modifying them. > I don’t think you need to set 6050 to container-executor.cfg, that

Re: Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-16 Thread Miklos Szegedi
Hello Weiwei, Thank you for the information. Narrowing audience, since this is a yarn specific question: I am curious why do the parent dirs need to be owned by root? Is not the config file enough? Thank you, Miklos On Tue, May 16, 2017 at 7:40 PM, Weiwei Yang wrote: > Hi Jasson > > They nee

Re: Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-16 Thread Jasson Chenwei
hi, Weiwei Thanks for the reply. I have configured the permission as required: [image: Inline image 1] However, I still have the error, 2017-05-16 20:04:32,448 FATAL *org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager* *org.apache.hadoop.yarn.exceptions.YarnRuntim

Re: Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-16 Thread Weiwei Yang
Hi Jasson The container executor document is here  https://hadoop.apache.org/docs/r3.0.0-alpha2/hadoop-yarn/hadoop-yarn-site/SecureContainer.html The problem seems to the incorrect file permission, the doc says: The container-executor program must be owned by root and have the permission set ---

Errors when init LinuxContianerExecutor on Hadoop-3.0.0-alpha2

2017-05-16 Thread Jasson Chenwei
hi, all I am trying to configuring Cgroup and Docker runtime on Hadoop-3.0.0-alpha2. Based on the documentation, LinuxContainerExecutor is required. However, I do not want to set up a secure cluster. So, Is any way to bypass this? I also noticed that Cgroup doesn't need a secured cluster. Howev