Re: Persistent completed jobs status not showing in jobtracker UI

2009-02-19 Thread Bill Au 
The idea behind persistent completed jobs status is that they are still
available in case of a jobtracker failure, right?  The job history is stored
as files under the log directory on the jobtracker node.  So they won't be
available when the jobtraker node fails.  For folks who have enabled this
feature, how do you retrieve the presistended completed jobs status?

Bill

On Wed, Feb 18, 2009 at 10:48 PM, Amareshwari Sriramadasu 
amar...@yahoo-inc.com wrote:

 Bill Au wrote:

 I have enabled persistent completed jobs status and can see them in HDFS.
 However, they are not listed in the jobtracker's UI after the jobtracker
 is
 restarted.  I thought that jobtracker will automatically look in HDFS if
 it
 does not find a job in its memory cache.  What am I missing?  How to I
 retrieve the persistent completed job status?

 Bill



 JobTracker web ui doesn't look at persistence storage after a restart. You
 can access the old jobs from job history. History link is accesible from web
 ui.
 -Amareshwari

Persistent completed jobs status not showing in jobtracker UI

2009-02-18 Thread Bill Au 
I have enabled persistent completed jobs status and can see them in HDFS.
However, they are not listed in the jobtracker's UI after the jobtracker is
restarted.  I thought that jobtracker will automatically look in HDFS if it
does not find a job in its memory cache.  What am I missing?  How to I
retrieve the persistent completed job status?

Bill

Re: Persistent completed jobs status not showing in jobtracker UI

2009-02-18 Thread Amareshwari Sriramadasu 

Bill Au wrote:

I have enabled persistent completed jobs status and can see them in HDFS.
However, they are not listed in the jobtracker's UI after the jobtracker is
restarted.  I thought that jobtracker will automatically look in HDFS if it
does not find a job in its memory cache.  What am I missing?  How to I
retrieve the persistent completed job status?

Bill

  
JobTracker web ui doesn't look at persistence storage after a restart. 
You can access the old jobs from job history. History link is accesible 
from web ui.

-Amareshwari