[ 
https://issues.apache.org/jira/browse/HADOOP-4190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amar Kamat updated HADOOP-4190:
-------------------------------

    Attachment: HADOOP-4190-v3.patch

Attaching a patch that 
- adds version to job history which is logged to the history file as the 1st 
line 
- switches to old/default regex for line-end matching if the version info is 
missing else uses the new regex
- adds a test case that tests the job history parser with old and new file 
formats

Manually tested the patch with old and new history files and works fine. More 
testing in progress. Will try and make it more cleaner and optimized.

> Changes to JobHistory makes it backward incompatible
> ----------------------------------------------------
>
>                 Key: HADOOP-4190
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4190
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Amar Kamat
>            Assignee: Amar Kamat
>            Priority: Blocker
>             Fix For: 0.19.0
>
>         Attachments: HADOOP-4190-v3.patch
>
>
> With HADOOP-3245, the job history format has changed. Every log line now ends 
> with a '.' (dot). JobHistory's parser will consider a history line valid only 
> if it ends in a dot
> Hence the new parser wont be able to parse old history files.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to