Hadoop should provide a simplified way of fetching user-logs
------------------------------------------------------------
Key: HADOOP-6651
URL: https://issues.apache.org/jira/browse/HADOOP-6651
Project: Hadoop Common
Issue Type: New Feature
Affects Versions: 0.20.2, 0.20.1, 0.20.0
Reporter: Alok Singh
Hi,
Currently , in both streaming and normal mode hadoop mapred program, user
can't download the
logs programatically.
jobclient.output.filter=ALL, allows user to print output in the stdout/stderr
We need to have the ability to fetch the user logs from the framework.
in 0.18, under the hod , we used to store the logs in the hdfs.
For 0.20, as long as the jobhistory resides user can view the logs but then
it's gone.
So in short , I am proposing that hadoop
1) provide the options to the JobClient (i.e jobconf var
jobclient.output.logs.location), so that it will download the output in the
hdfs location instead of printing to stdout.
Thanks
Alok
Alok
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
