RE: how to add a shareable node label?

2016-10-12 Thread Frank Luo
Thanks, Sunil. It makes a lot of sense. I will try it out. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Wednesday, October 12, 2016 9:21 AM To: Frank Luo ; user@hadoop.apache.org Subject: Re: how to add a shareable node label? Hi Frank Thanks for sharing more details. Let me try

Re: how to add a shareable node label?

2016-10-12 Thread Sunil Govind
ly go to LabelledQ. If something else is on LabelledQ, JobA waits. > > > > Do you mind to illustrate how to config the queues to achieve what I am > looking for? > > > > Thank you Sunil. > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > > > *Sent:

RE: how to add a shareable node label?

2016-10-11 Thread Frank Luo
com>>; user@hadoop.apache.org<mailto:user@hadoop.apache.org> Subject: Re: how to add a shareable node label? HI Frank In that case, preemption may not be needed. So over-utilizing resources of queueB will be running till it completes. Since queueA is under served, then any next fr

Re: how to add a shareable node label?

2016-10-11 Thread Sunil Govind
t; > Just to confirm, the Node Labeling feature on 2.8 or 3.0 alpha won’t > satisfy my need, right? > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Friday, October 07, 2016 12:09 PM > > > *To:* Frank Luo ; user@hadoop.apache.org > *Subject:* Re:

RE: how to add a shareable node label?

2016-10-07 Thread Frank Luo
That is correct, Sunil. Just to confirm, the Node Labeling feature on 2.8 or 3.0 alpha won’t satisfy my need, right? From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Friday, October 07, 2016 12:09 PM To: Frank Luo ; user@hadoop.apache.org Subject: Re: how to add a shareable node label

Re: how to add a shareable node label?

2016-10-07 Thread Sunil Govind
ly running in queueB might not be > preemptable. So if they overflow to queueA then got preempted, then that is > not good. > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Friday, October 07, 2016 10:50 AM > > > *To:* Frank Luo ; user@hadoop.

RE: how to add a shareable node label?

2016-10-07 Thread Frank Luo
preemptable. So if they overflow to queueA then got preempted, then that is not good. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Friday, October 07, 2016 10:50 AM To: Frank Luo ; user@hadoop.apache.org Subject: Re: how to add a shareable node label? HI Frank Thanks for the details. I am

Re: how to add a shareable node label?

2016-10-07 Thread Sunil Govind
doop jobs inserting into sql-server, or just pure linux jobs that are not preemptable in nature. So preempt jobs is not an option for me. I hope it makes sense. Frank *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] *Sent:* Thursday, October 06, 2016 2:15 PM *To:* Frank Luo ; user@h

RE: how to add a shareable node label?

2016-10-06 Thread Frank Luo
that are not preemptable in nature. So preempt jobs is not an option for me. I hope it makes sense. Frank From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Thursday, October 06, 2016 2:15 PM To: Frank Luo ; user@hadoop.apache.org Subject: Re: how to add a shareable node label? HI Frank

Re: how to add a shareable node label?

2016-10-06 Thread Sunil Govind
ehavior. The jobs that steals labelled resources are not preemptable, and > I’d rather waiting instead of killing. > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Thursday, October 06, 2016 1:59 AM > > > *To:* Frank Luo ; user@hadoop.apache.org > > *Subje

RE: how to add a shareable node label?

2016-10-06 Thread Frank Luo
rather waiting instead of killing. From: Sunil Govind [mailto:sunil.gov...@gmail.com] Sent: Thursday, October 06, 2016 1:59 AM To: Frank Luo ; user@hadoop.apache.org Subject: Re: how to add a shareable node label? Hi Frank I think as of today this is not possible. You could try and experience the

Re: how to add a shareable node label?

2016-10-05 Thread Sunil Govind
chines be shared if no dedicated job running? > > > > *From:* Sunil Govind [mailto:sunil.gov...@gmail.com] > *Sent:* Wednesday, October 05, 2016 12:50 AM > *To:* Frank Luo ; user@hadoop.apache.org; > u...@yarn.apache.org > > > *Subject:* Re: how to add a shareable node label? &g

RE: how to add a shareable node label?

2016-10-05 Thread Frank Luo
@hadoop.apache.org; u...@yarn.apache.org Subject: Re: how to add a shareable node label? Hi Frank, As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8 release, we can get "non-exclusive" or sharable node labels. Thanks Sunil On Wed, Oct 5, 2016 at 8:40 AM

Re: how to add a shareable node label?

2016-10-04 Thread Sunil Govind
Hi Frank, As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8 release, we can get "non-exclusive" or sharable node labels. Thanks Sunil On Wed, Oct 5, 2016 at 8:40 AM Frank Luo wrote: > I am using Hadoop 2.7.3, when I run: > > $ yarn rmadmin -addToClusterNodeLabels "Label1(

how to add a shareable node label?

2016-10-04 Thread Frank Luo
I am using Hadoop 2.7.3, when I run: $ yarn rmadmin -addToClusterNodeLabels "Label1(exclusive=false)" I got an error as: … addToClusterNodeLabels: java.io.IOException: label name should only contains {0-9, a-z, A-Z, -, _} and should not started with {-,_} If I just use “Label1”, it will work fi