[ 
https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13834813#comment-13834813
 ] 

Hudson commented on HDFS-5563:
------------------------------

FAILURE: Integrated in Hadoop-Mapreduce-trunk #1622 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1622/])
HDFS-5563. NFS gateway should commit the buffered data when read request comes 
after write to the same file. Contributed by Brandon Li (brandonli: 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1546233)
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java
* 
/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt


> NFS gateway should commit the buffered data when read request comes after 
> write to the same file
> ------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-5563
>                 URL: https://issues.apache.org/jira/browse/HDFS-5563
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: nfs
>            Reporter: Brandon Li
>            Assignee: Brandon Li
>             Fix For: 2.2.1
>
>         Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch, 
> HDFS-5563.003.patch
>
>
> HDFS write is asynchronous and data may not be available to read immediately 
> after write.
> One of the main reason is that DFSClient doesn't flush data to DN until its 
> local buffer is full.
> To workaround this problem, when a read comes after write to the same file, 
> NFS gateway should sync the data so the read request can get the latest 
> content. The drawback is that, the frequent hsync() call can slow down data 
> write.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to