Hi, I am trying to submit many independent jobs in paralllel (same user). This works for up to 16 jobs, but after that I only get 16 jobs in parallel no matter how many I try to submit. I am using fair scheduler with the following config:
<allocations> <pool name="user2"> <minMaps>12</minMaps> <minReduces>12</minReduces> <maxRunningJobs>100</maxRunningJobs> <weight>4</weight> </pool> <userMaxJobsDefault>100</userMaxJobsDefault> </allocations> Judging by this config, I would expect my job limit to be 100, not 16 jobs. I am using hadoop-0.20.1. Am I missing some other config option? any suggestions are welcome, - Vasilis
