[
https://issues.apache.org/jira/browse/MAPREDUCE-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836520#action_12836520
]
Rodrigo Schmidt commented on MAPREDUCE-1519:
--------------------------------------------
Just checked and the new unit test doesn't work on trunk if we don't change the
code for the RaidNode.
The unit test blocks and the logs start to report the following error when the
RaidNode tries to move the parity file to the new location:
[junit] 10/02/21 21:56:15 INFO raid.RaidNode: Exception while invoking
action on policy RaidTest1 srcPath
hdfs://localhost:59030/user/dhruba/policytest exception java.io.IOException:
Unable to rename tmp file
hdfs://localhost:59030/destraid/user/dhruba/policytest/file2.tmp to
hdfs://localhost:59030/destraid/user/dhruba/policytest/file2
[junit] at
org.apache.hadoop.raid.RaidNode.generateParityFile(RaidNode.java:817)
[junit] at org.apache.hadoop.raid.RaidNode.doRaid(RaidNode.java:705)
[junit] at org.apache.hadoop.raid.RaidNode.doRaid(RaidNode.java:642)
[junit] at
org.apache.hadoop.raid.RaidNode$TriggerMonitor.doProcess(RaidNode.java:401)
[junit] at
org.apache.hadoop.raid.RaidNode$TriggerMonitor.run(RaidNode.java:307)
[junit] at java.lang.Thread.run(Thread.java:637)
Everything works fine with the proposed change.
> RaidNode fails to create new parity file if an older version already exists
> ---------------------------------------------------------------------------
>
> Key: MAPREDUCE-1519
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1519
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/raid
> Reporter: Rodrigo Schmidt
> Assignee: Rodrigo Schmidt
> Attachments: MAPREDUCE-1519.patch
>
>
> When RaidNode tries to recreate a parity file for a source file that has been
> modified (recreated) recently, it crashes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
