[
https://issues.apache.org/jira/browse/MAPREDUCE-1254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785788#action_12785788
]
Zheng Shao commented on MAPREDUCE-1254:
---------------------------------------
Can you explain why the sub task jvm will continue if it doesn't successfully
load the job.xml?
Shouldn't it error out with an IOException?
> job.xml should add crc check in tasktracker and sub jvm.
> --------------------------------------------------------
>
> Key: MAPREDUCE-1254
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1254
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: task, tasktracker
> Affects Versions: 0.22.0
> Reporter: ZhuGuanyin
>
> Currently job.xml in tasktracker and subjvm are write to local disk through
> ChecksumFilesystem, and already had crc checksum information, but load the
> job.xml file without crc check. It would cause the mapred job finished
> successful but with wrong data because of disk error. Example: The
> tasktracker and sub task jvm would load the default configuration if it
> doesn't successfully load the job.xml which maybe replace the mapper with
> IdentityMapper.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
