[
https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12556876#action_12556876
]
amareshwari edited comment on HADOOP-2178 at 1/8/08 4:30 AM:
--------------------------------------------------------------------------
To address both the issues (HADOOP-1876 and this), we will store job history
files in a centralized location like
_{/logs/history/<jobtracker.hostname>_<user.name>_<jobid>}_ on DFS. This
location will avoid name conficts among users and hostnames.
The job history viewer(centralized) can display available history files sorted
based on the creation time on the dfs and user can select the job he wants to
view from there.
For 1876, job status can be queried giving the jobid, hostname and username.
The hostname can be inferred and the username if not specified will be ignored
and the first occurence of the jobid string taken.
was (Author: amareshwari):
To address both the issues (HADOOP-1876 and this), we will store job
history files in a centralized location like
_{/logs/history/<jobtracker.hostname>_<user.name>_<jobid>}_ on DFS. This
location will avoid name conficts among users and hostnames.
The job history viewer(centralized) can display available history files and
user can select the job he wants to view from there.
For 1876, job status can be queried giving the jobid and hostname.
> Job history on HDFS
> -------------------
>
> Key: HADOOP-2178
> URL: https://issues.apache.org/jira/browse/HADOOP-2178
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.16.0
>
>
> This issue addresses the following items :
> 1. Check for accuracy of job tracker history logs.
> 2. After completion of the job, copy the JobHistory.log(Master index file)
> and the job history files to the DFS.
> 3. User can load the history with commands
> bin/hadoop job -history <directory>
> or
> bin/hadoop job -history <jobid>
> This will start a stand-alone jetty and load jsps
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
