[
https://issues.apache.org/jira/browse/MAPREDUCE-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
JasonZhu updated MAPREDUCE-6159:
--------------------------------
Description:
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the
position of which is at `JHAdminConfig:73`, to get some comprehension on
history server. This argument is referenced at
`JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file
from
"${yarn.app.mapreduce.am.staging-dir}/${user}/.staging"
to
"${mapreduce.jobhistory.intermediate-done-dir}/${user}".
Since the following code snippet in `moveToDoneNow()` will definitely write
some logs out to log file, but I can found no any sign of it in all logs in
$HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
if (copied)
LOG.info("Copied to done location: " + toPath);
else
LOG.info("copy failed");
Is there anything that I missed?
was:
I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the
position of which is at `JHAdminConfig:73`, to get some comprehension on
history server. This argument is referenced at
`JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
summary file from "#{yarn.app.mapreduce.am.staging-dir}/#{user}/.staging" to
"#{mapreduce.jobhistory.intermediate-done-dir}/${user}".
Since the following code snippet in `moveToDoneNow()` will definitely write
some logs out to log file, but I can found no any sign of it in all logs in
$HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
if (copied)
LOG.info("Copied to done location: " + toPath);
else
LOG.info("copy failed");
Is there anything that I missed?
> No log of JobHistory found in every logs.
> -----------------------------------------
>
> Key: MAPREDUCE-6159
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
> Affects Versions: 2.2.0
> Environment: Hadoop-2.2.0
> Reporter: JasonZhu
>
> I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument,
> the position of which is at `JHAdminConfig:73`, to get some comprehension on
> history server. This argument is referenced at
> `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job
> summary file
> from
> "${yarn.app.mapreduce.am.staging-dir}/${user}/.staging"
> to
> "${mapreduce.jobhistory.intermediate-done-dir}/${user}".
> Since the following code snippet in `moveToDoneNow()` will definitely write
> some logs out to log file, but I can found no any sign of it in all logs in
> $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
> if (copied)
> LOG.info("Copied to done location: " + toPath);
> else
> LOG.info("copy failed");
> Is there anything that I missed?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
