[
https://issues.apache.org/jira/browse/HADOOP-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559867#action_12559867
]
Amareshwari Sri Ramadasu commented on HADOOP-2178:
--------------------------------------------------
This patch logs history in hadoop.job.history.location whose default value is
local file system.
In addition to that it logs at hadoop.job.history.user.location whose default
value isuser output directory.
And now the history jsp files are in seperate webapps i.e src/webapps/history,
ratherthan in src/webapps/job .
We start a statushttpserver from job tracker with hadoop.job.history.location
as history log directory and view history files. This page is linked from job
tracker.
User can view history files in output directory by giving the following command
bin/hadoop job -history <outputdir>
This will start a jetty on that machine and user can view the jsps of the
history directory he has given.
Now we have centralised location of history as "hadoop.job.history.location" .
> Job history on HDFS
> -------------------
>
> Key: HADOOP-2178
> URL: https://issues.apache.org/jira/browse/HADOOP-2178
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.16.0
>
> Attachments: patch-2178.txt
>
>
> This issue addresses the following items :
> 1. Check for accuracy of job tracker history logs.
> 2. After completion of the job, copy the JobHistory.log(Master index file)
> and the job history files to the DFS.
> 3. User can load the history with commands
> bin/hadoop job -history <directory>
> or
> bin/hadoop job -history <jobid>
> This will start a stand-alone jetty and load jsps
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
