Hi Rishi,
> P.S. - What credentials are required for commenting on an issue in Jira
>
It's open source. I'd say none :)
My feature request is for a regular hadoop clusters whereas yours is pretty
unique.
Not sure if that Jira applies to your need or not.
Koji
On 1/31/11 9:21 AM, "rishi patha
Still need to figure out whether a queue can be associated with a TT. i.e.
TT acl for a queue
in which tasks submitted to that queue will only be relayed to TT in the acl
list for the queue.
On Mon, Jan 31, 2011 at 10:51 PM, rishi pathak wrote:
> Hi Koji,
>Thanks for opening feature r
Hi Koji,
Thanks for opening feature request. Right now for the purpose
stated earlier
I have upgraded to hadoop to 0.21. , and trying to see if creating
individual leaf level queues for every tasktracker and changing the state of
it to 'stopped' before the expiry of the walltime. Seems l
Rishi,
> Using exclude list for TT will not help as Koji has already mentioned
>
It'll help a bit in a sense that no more tasks are assigned to that TaskTracker
once excluded.
As for TT decommissioning and map outputs handling, opened a Jira for further
discussion.
https://issues.apache.org/jir
HI,
Here is a description of what we are trying to achieve(whether it is
possible or not is still not cear):
We have large computing clusters used majorly for MPI jobs. We use
PBS/Torque and Maui for resource allocation and scheduling.
At most times utilization is very high except for very sma
Hi Rishi,
https://issues.apache.org/jira/browse/HADOOP-5643
is added to version 0.21. Some 0.20 branches may have this as well.
However, even with this feature, I believe TaskTracker immediately kills itself
when all the tasks on the TaskTrackers finish but doesn't take care of the
jobs still
Moving discussion to the MapReduce-User list: mapreduce-user@hadoop.apache.org
Reply inline:
On Fri, Jan 28, 2011 at 2:39 PM, rishi pathak wrote:
> Hi,
> Is there a way to drain a tasktracker. What we require is not to
> schedule any more map/red tasks onto a tasktracker(mark it offline)
Hi,
Is there a way to drain a tasktracker. What we require is not to
schedule any more map/red tasks onto a tasktracker(mark it offline) but
still the running tasks should not be affected.
--
---
Rishi Pathak
National PARAM Supercomputing Facility
C-DAC, Pune, India
--
---
Rishi P
