[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Fix Version/s: 2.2.1 > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Fix For: 2.2.1 > > Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch, > HDFS-5563.003.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch, > HDFS-5563.003.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Attachment: HDFS-5563.003.patch > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch, > HDFS-5563.003.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Attachment: HDFS-5563.002.patch > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Attachments: HDFS-5563.001.patch, HDFS-5563.002.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Attachment: HDFS-5563.001.patch > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Attachments: HDFS-5563.001.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5563) NFS gateway should commit the buffered data when read request comes after write to the same file
[ https://issues.apache.org/jira/browse/HDFS-5563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5563: - Status: Patch Available (was: Open) > NFS gateway should commit the buffered data when read request comes after > write to the same file > > > Key: HDFS-5563 > URL: https://issues.apache.org/jira/browse/HDFS-5563 > Project: Hadoop HDFS > Issue Type: Improvement > Components: nfs >Reporter: Brandon Li >Assignee: Brandon Li > Attachments: HDFS-5563.001.patch > > > HDFS write is asynchronous and data may not be available to read immediately > after write. > One of the main reason is that DFSClient doesn't flush data to DN until its > local buffer is full. > To workaround this problem, when a read comes after write to the same file, > NFS gateway should sync the data so the read request can get the latest > content. The drawback is that, the frequent hsync() call can slow down data > write. -- This message was sent by Atlassian JIRA (v6.1#6144)
