Yarn containers creating child process

2017-02-10 Thread Sandesh Hegde
Hi, What are the features available to limit the Yarn containers from creating the child process? Thanks

Re: HDFS Shell tool

2017-02-10 Thread Ravi Prakash
Hi Vity! Please let me reiterate that I think its great work and I'm glad you thought of sharing it with the community. Thanks a lot. I can think of a few reasons for using WebHDFS, although, if these are not important to you, it may not be worth the effort: 1. You can point to an HttpFS gateway

YARN and memory management with CapacityScheduler and with cgroups

2017-02-10 Thread Marco B.
Hello everyone, I am trying to figure out how to share among users a Hadoop cluster which is primarily going to be used with Spark and YARN. I have seen that YARN 2.7 provides a scheduler called CapacityScheduler which would help with multi-tenancy. What is not fully clear to me is how resource

Re: HDFS Shell tool

2017-02-10 Thread Vitásek , Ladislav
Hello Ravi, I am glad you like it. Why should I use WebHDFS? Our cluster sysops, include me, prefer command line. :-) -Vity 2017-02-09 22:21 GMT+01:00 Ravi Prakash : > Great job Vity! > > Thanks a lot for sharing. Have you thought about using WebHDFS? > > Thanks > Ravi > >