Re: task slots problem

2011-01-25 Thread Harsh J
This is fine. 40 may be ending, while the next 40 may be starting. The tasks will run a cleanup operation at their end (and be in such a 'status'), during which the TaskTracker is allowed to schedule the next wave of maps it needs. In these moments, it may appear as if 80 concurrent tasks may be ru

task slots problem

2011-01-25 Thread exception
Hi, My cluster contains 5 DataNodes, each with 8 map slots and 2 reduce slots. So there are up to 40 slots in my cluster and 40 tasks can run in parallel. But when running a particular job, I have noticed that 80 tasks running in parallel. The cluster looks fine when running other jobs. This par