Re: Hadoop fair scheduler doubt: allocate jobs to pool

2012-03-01 Thread Merto Mertek
I think that ${user.name} variable is obtained from system proprietes class, where I can not find the group.name propriety, so probably it is not possible to create pools depending on the user group, despite in the

Re: Hadoop fair scheduler doubt: allocate jobs to pool

2012-03-01 Thread Austin Chungath
Hi, I tried what you had said. I added the following to mapred-site.xml: mapred.fairscheduler.poolnameproperty pool.name pool.name ${mapreduce.job.group.name} Funny enough it created a pool with the name "${mapreduce.job.group.name}" so I tried ${mapred.job.group.name} and ${group.

Re: Hadoop fair scheduler doubt: allocate jobs to pool

2012-03-01 Thread Austin Chungath
time you set the "mapred.fairscheduler.pool" property on the > Job Conf to the name of the pool you want the job to use. > > Dave > > > -Original Message- > From: Merto Mertek [mailto:masmer...@gmail.com] > Sent: Thursday, March 01, 2012 9:33 AM > To: common-user@hadoop.apache.or

RE: Hadoop fair scheduler doubt: allocate jobs to pool

2012-03-01 Thread Dave Shine
gmail.com] Sent: Thursday, March 01, 2012 9:33 AM To: common-user@hadoop.apache.org Subject: Re: Hadoop fair scheduler doubt: allocate jobs to pool >From the fairscheduler docs I assume the following should work: mapred.fairscheduler.poolnameproperty pool.name pool.name ${mapred

Re: Hadoop fair scheduler doubt: allocate jobs to pool

2012-03-01 Thread Merto Mertek
>From the fairscheduler docs I assume the following should work: mapred.fairscheduler.poolnameproperty pool.name pool.name ${mapreduce.job.group.name} which means that the default pool will be the group of the user that has submitted the job. In your case I think that allocations

Hadoop fair scheduler doubt: allocate jobs to pool

2012-02-29 Thread Austin Chungath
How can I set the fair scheduler such that all jobs submitted from a particular user group go to a pool with the group name? I have setup fair scheduler and I have two users: A and B (belonging to the user group hadoop) When these users submit hadoop jobs, the jobs from A got to a pool named A an