Re: Yarn - specify hosts in ContainerRequest

2014-02-17 Thread Anand Mundada
Amazing thanks, it worked. I didn't mentioned last flag 'false' Thanks kishor. :) Sent from my iPhone On Feb 16, 2014, at 11:55 PM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi Anand, Which version of Hadoop are you using? It works from 2.2.0 Try like this, and it

Re: Yarn - specify hosts in ContainerRequest

2014-02-16 Thread Krishna Kishore Bonagiri
Hi Anand, Which version of Hadoop are you using? It works from 2.2.0 Try like this, and it should work. I am using this feature on 2.2.0 String[] hosts = new String[1]; hosts[0] = node_name; ContainerRequest request = new ContainerRequest(capability, hosts, null, p,

Yarn - specify hosts in ContainerRequest

2014-02-14 Thread Anand Mundada
Hi All, How can I launch container on a particular host? I tried specifying host name in new ContainerRequest() Thanks, Anand

Re: YARN - specify hosts in ContainerRequest

2013-04-12 Thread Brian C. Huffman
Yes, this is exactly the DistributedShell example in the 2.0.3 source (except for the added specification of containerNode). So, it's doing the following: ContainerRequest containerAsk = setupContainerAskForRM(askCount); resourceManager.addContainerRequest(containerAsk);

Re: YARN - specify hosts in ContainerRequest

2013-04-12 Thread Brian C. Huffman
I get a container, but not on the node I'm asking for. Thanks, Brian On 04/12/2013 03:01 PM, Sandy Ryza wrote: What do you mean when you say it doesn't seem to use the code? That you're not getting containers back? -Sandy On Fri, Apr 12, 2013 at 7:44 AM, Brian C. Huffman

Re: YARN - specify hosts in ContainerRequest

2013-04-12 Thread Sandy Ryza
YARN currently does not provide any guarantees that a container will be placed where you ask for it. This is being addressed in YARN-392 and YARN-398. For now, the Fair Scheduler and Capacity Scheduler will make a best effort to do this through delay scheduling. If you use the Fair Scheduler,

YARN - specify hosts in ContainerRequest

2013-04-11 Thread Brian C. Huffman
All, I'm starting to work with YARN and I'm trying to make some changes to the distributedshell example. Specifically I'm trying to set the host where the distributed shell container will run. I added the following code into ApplicationMaster.java: final String[] containerNodes = {

Re: YARN - specify hosts in ContainerRequest

2013-04-11 Thread Harsh J
Hi Brian, Your way of creation seems fine. Are you adding this to the AMRMClient somewhere though, via [1], right before you call allocate(progress)? Cause otherwise this object's not used at all. P.s. I'm not sure we'll handle that null for racks all that well in certain places yet; I've

Re: YARN - specify hosts in ContainerRequest

2013-04-11 Thread Arun C Murthy
There shouldn't be issues handling nulls etc. - obviously depends on scheduler, but if you see any we will fix it ASAP. On Apr 12, 2013, at 12:20 AM, Harsh J wrote: Hi Brian, Your way of creation seems fine. Are you adding this to the AMRMClient somewhere though, via [1], right before you