[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-10614: -- Target Version/s: 2.7.8 (was: 2.7.7) > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > Attachments: HDFS-10614.01.patch, HDFS-10614.02.patch, > HDFS-10614.03.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10614: --- Status: Open (was: Patch Available) Canceling the patch as it is not applying anymore. > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B >Priority: Major > Attachments: HDFS-10614.01.patch, HDFS-10614.02.patch, > HDFS-10614.03.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10614: - Attachment: HDFS-10614.03.patch Updated the patch. Added genstamp check before removing the storage. Thanks [~jingzhao] for good suggestion. Apologies for delayed updated on patch. > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Attachments: HDFS-10614.01.patch, HDFS-10614.02.patch, > HDFS-10614.03.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10614: - Attachment: HDFS-10614.02.patch Uploaded patch with different fix. I feel this is logically correct place to fix this. Please review. > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Attachments: HDFS-10614.01.patch, HDFS-10614.02.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10614: - Target Version/s: 2.7.4 Status: Patch Available (was: Open) > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Attachments: HDFS-10614.01.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-10614) Appended blocks can be closed even before IBRs from DataNodes
[ https://issues.apache.org/jira/browse/HDFS-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10614: - Attachment: HDFS-10614.01.patch Uploaded the patch for trunk, > Appended blocks can be closed even before IBRs from DataNodes > - > > Key: HDFS-10614 > URL: https://issues.apache.org/jira/browse/HDFS-10614 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Vinayakumar B >Assignee: Vinayakumar B > Attachments: HDFS-10614.01.patch > > > Scenario: >1. Open the file for append() >2. Trigger append pipeline setup by adding some data. >3. Consider RECEIVING IBRs of DNs reaches NN first. >4. updatePipeline() rpc sent to namenode to update the pipeline. >5. Now, if complete() is called on the file even before closing the > pipeline, then block will be COMPLETE, even before block is actually > FINALIZED at DN side and file will be closed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
