Thanks, Sunil. It makes a lot of sense. I will try it out.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Wednesday, October 12, 2016 9:21 AM
To: Frank Luo ; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
Thanks for sharing more details. Let me try
ly go to LabelledQ. If something else is on LabelledQ, JobA waits.
>
>
>
> Do you mind to illustrate how to config the queues to achieve what I am
> looking for?
>
>
>
> Thank you Sunil.
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
>
>
> *Sent:
com>>;
user@hadoop.apache.org<mailto:user@hadoop.apache.org>
Subject: Re: how to add a shareable node label?
HI Frank
In that case, preemption may not be needed. So over-utilizing resources of
queueB will be running till it completes. Since queueA is under served, then
any next fr
t;
> Just to confirm, the Node Labeling feature on 2.8 or 3.0 alpha won’t
> satisfy my need, right?
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Friday, October 07, 2016 12:09 PM
>
>
> *To:* Frank Luo ; user@hadoop.apache.org
> *Subject:* Re:
That is correct, Sunil.
Just to confirm, the Node Labeling feature on 2.8 or 3.0 alpha won’t satisfy
my need, right?
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Friday, October 07, 2016 12:09 PM
To: Frank Luo ; user@hadoop.apache.org
Subject: Re: how to add a shareable node label
ly running in queueB might not be
> preemptable. So if they overflow to queueA then got preempted, then that is
> not good.
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Friday, October 07, 2016 10:50 AM
>
>
> *To:* Frank Luo ; user@hadoop.
preemptable. So if they overflow to queueA then got preempted, then that is not
good.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Friday, October 07, 2016 10:50 AM
To: Frank Luo ; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
HI Frank
Thanks for the details.
I am
doop jobs inserting into sql-server,
or just pure linux jobs that are not preemptable in nature. So preempt jobs
is not an option for me.
I hope it makes sense.
Frank
*From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
*Sent:* Thursday, October 06, 2016 2:15 PM
*To:* Frank Luo ; user@h
that
are not preemptable in nature. So preempt jobs is not an option for me.
I hope it makes sense.
Frank
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Thursday, October 06, 2016 2:15 PM
To: Frank Luo ; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
HI Frank
ehavior. The jobs that steals labelled resources are not preemptable, and
> I’d rather waiting instead of killing.
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Thursday, October 06, 2016 1:59 AM
>
>
> *To:* Frank Luo ; user@hadoop.apache.org
>
> *Subje
rather waiting instead of killing.
From: Sunil Govind [mailto:sunil.gov...@gmail.com]
Sent: Thursday, October 06, 2016 1:59 AM
To: Frank Luo ; user@hadoop.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank
I think as of today this is not possible. You could try and experience the
chines be shared if no dedicated job running?
>
>
>
> *From:* Sunil Govind [mailto:sunil.gov...@gmail.com]
> *Sent:* Wednesday, October 05, 2016 12:50 AM
> *To:* Frank Luo ; user@hadoop.apache.org;
> u...@yarn.apache.org
>
>
> *Subject:* Re: how to add a shareable node label?
&g
@hadoop.apache.org; u...@yarn.apache.org
Subject: Re: how to add a shareable node label?
Hi Frank,
As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8
release, we can get "non-exclusive" or sharable node labels.
Thanks
Sunil
On Wed, Oct 5, 2016 at 8:40 AM
Hi Frank,
As far as I checked, all labels are "exclusive" in 2.7. In upcoming 2.8
release, we can get "non-exclusive" or sharable node labels.
Thanks
Sunil
On Wed, Oct 5, 2016 at 8:40 AM Frank Luo wrote:
> I am using Hadoop 2.7.3, when I run:
>
> $ yarn rmadmin -addToClusterNodeLabels "Label1(
I am using Hadoop 2.7.3, when I run:
$ yarn rmadmin -addToClusterNodeLabels "Label1(exclusive=false)"
I got an error as:
… addToClusterNodeLabels: java.io.IOException: label name should only contains
{0-9, a-z, A-Z, -, _} and should not started with {-,_}
If I just use “Label1”, it will work fi
15 matches
Mail list logo