[
https://issues.apache.org/jira/browse/MAPREDUCE-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13133504#comment-13133504
]
Tsz Wo (Nicholas), SZE commented on MAPREDUCE-2708:
---------------------------------------------------
> Now, if I kill the AM after a couple of tasks, NN shows the #bytes to be
> zero: ...
Since the file is not closed, the size in NN won't be updated. We have to call
getVisibleLength() to get the length from one of the datanodes, i.e.
{code}
final DFSDataInputStream in = (DFSDataInputStream)fs.open(p);
finel long currentFileSize = in.getVisibleLength();
{code}
> [MR-279] Design and implement MR Application Master recovery
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2708
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2708
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0
> Reporter: Sharad Agarwal
> Assignee: Sharad Agarwal
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2708-20111021.1.txt,
> MAPREDUCE-2708-20111021.txt, MAPREDUCE-2708-20111022.txt, mr2708_v1.patch,
> mr2708_v2.patch
>
>
> Design recovery of MR AM from crashes/node failures. The running job should
> recover from the state it left off.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
