RE: worker affinity and YARN scheduling

2013-11-13 Thread John Lilley
Thanks! john From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Monday, November 11, 2013 7:25 PM To: user@hadoop.apache.org Subject: Re: worker affinity and YARN scheduling On Nov 11, 2013, at 6:28 AM, John Lilley john.lil...@redpoint.netmailto:john.lil...@redpoint.net wrote: I would

worker affinity and YARN scheduling

2013-11-11 Thread John Lilley
I would like to better understand YARN's scheduling with named workers and relaxedLocality==true. For example, suppose that I have a three-node cluster with nodes A,B,C. Each node has capacity to run two tasks of the kind I desire simultaneously. My AM then requests nine containers with

Re: worker affinity and YARN scheduling

2013-11-11 Thread Arun C Murthy
On Nov 11, 2013, at 6:28 AM, John Lilley john.lil...@redpoint.net wrote: I would like to better understand YARN’s scheduling with named workers and relaxedLocality==true. For example, suppose that I have a three-node cluster with nodes A,B,C. Each node has capacity to run two tasks of the