Hi Derek,
You should set poolnameproperty to "pool.name", not "${pool.name}"
That should fix your issues.
-Todd
On Wed, Dec 2, 2009 at 7:46 PM, Derek Brown <de...@media6degrees.com> wrote:
> I'm using Cloudera's distribution of 0.20.1, but this seems like a general
> question to I'm posting here.
>
> I'm having some issues getting the Fair Scheduler setup. I followed the
> basic instructions, from
> http://hadoop.apache.org/common/docs/current/fair_scheduler.html:
>
> * Added to mapred-site.xml:
>
> <property>
> <name>mapred.jobtracker.taskScheduler</name>
> <value>org.apache.hadoop.mapred.FairScheduler</value>
> </property>
>
> <property>
> <name>mapred.fairscheduler.allocation.file</name>
> <value>/etc/hadoop/conf/fairscheduler.xml</value>
> </property>
>
> The fair scheduler jar was already in the installation's root lib/
>
> * Added the basic fairscheduler.xml, based on the example in the docs.
>
> <property>
> <name>mapred.fairscheduler.poolnameproperty</name>
> <value>${pool.name}</value>
> <description>...</description>
> </property>
>
> <property>
> <name>pool.name</name>
> <value>${user.name}</value>
> <description>...</description>
> </property>
>
> Running a job (say, one of the examples, such as the pi estimator, word
> count, or sleep) and check myhost:50030/scheduler, I see the job listed in
> the Pools table in the "hadoop" row, since that's the user. That makes
> sense. In the Running Jobs table, the dropdown in the Pool column sometimes
> shows "hadoop" and sometimes "default" when I reload the page, which is
> odd.
>
> Then if I change the xml's pool.name entry's value to a hardcoded value,
> say
> "foo", with a matching "foo" <pool> entry in the xml, and run a job (and
> restart the JobTracker to be safe), I do see a "foo" row in the Pools
> table,
> but it shows 0 Running Jobs, and "default" shows the one job. Also, the
> Pool
> listed in the dropdown in the Running Jobs table remains "default", rather
> than "foo" (although "foo" is a choice, and I CAN select it to change the
> pool).
>
> I'd expect that if I set the pool.name in fairscheduler.xml that jobs
> would
> run, and appear, under that pool. Am I missing something in my setup or in
> my understanding of how this should work? Thanks for any insight. What I'd
> like to be able to do is set the pool name on the command line when running
> a job, with an arg of "-Dpool.name=bar".
>
> Thanks,
> Derek
>
