[
https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156335#comment-14156335
]
Hudson commented on HDFS-6929:
------------------------------
FAILURE: Integrated in Hadoop-Yarn-trunk #698 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/698/])
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas
from namespace. (Arpit Agarwal) (aagarwal: rev
2e987148e02d0087fc70ce5b1ce571d3324bf1dd)
* hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
* hadoop-hdfs-project/hadoop-hdfs/CHANGES-HDFS-6581.txt
*
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
*
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestLazyPersistFiles.java
> NN periodically unlinks lazy persist files with missing replicas from
> namespace
> -------------------------------------------------------------------------------
>
> Key: HDFS-6929
> URL: https://issues.apache.org/jira/browse/HDFS-6929
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode
> Reporter: Arpit Agarwal
> Assignee: Arpit Agarwal
> Fix For: 3.0.0
>
> Attachments: HDFS-6929.01.patch, HDFS-6929.02.patch
>
>
> Occasional data loss is expected when using the lazy persist flag due to node
> restarts. The NN will optionally unlink lazy persist files from the namespace
> to avoid them from showing up as corrupt files.
> This behavior can be turned off with a global option. In the future this may
> be made a per-file option controllable by the client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
