The idea behind persistent completed jobs status is that they are still available in case of a jobtracker failure, right? The job history is stored as files under the log directory on the jobtracker node. So they won't be available when the jobtraker node fails. For folks who have enabled this feature, how do you retrieve the presistended completed jobs status?
Bill On Wed, Feb 18, 2009 at 10:48 PM, Amareshwari Sriramadasu < amar...@yahoo-inc.com> wrote: > Bill Au wrote: > >> I have enabled persistent completed jobs status and can see them in HDFS. >> However, they are not listed in the jobtracker's UI after the jobtracker >> is >> restarted. I thought that jobtracker will automatically look in HDFS if >> it >> does not find a job in its memory cache. What am I missing? How to I >> retrieve the persistent completed job status? >> >> Bill >> >> >> > JobTracker web ui doesn't look at persistence storage after a restart. You > can access the old jobs from job history. History link is accesible from web > ui. > -Amareshwari > >
