[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated HDFS-761: -- Release Note: An error checking quota policy resulted in a failure to read the edits log, stopping the primary/secondary name node. (was: An error checking quota policy resulted in a failure to read the edits log, stopping the secondary name node.) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch, hdfs-761.rel21.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HDFS-761: - Release Note: Corrected an error when checking quota policy that resulted in a failure to read the edits log, stopping the primary/secondary name node. (was: An error checking quota policy resulted in a failure to read the edits log, stopping the primary/secondary name node.) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch, hdfs-761.rel21.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Resolution: Fixed Status: Resolved (was: Patch Available) The test failure related to TestBlockReport is unrelated to this change. I committed this change to trunk and branch 0.21. Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch, hdfs-761.rel21.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Description: When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. Environment: (was: When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up.) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Attachment: hdfs-761.patch Attached patch has test that duplicates the problem and tests the fix. Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Status: Patch Available (was: Open) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Attachment: hdfs-761.rel20.patch Attaching a version of the patch for branch 0.20 Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Attachment: hdfs-761.1.rel20.patch hdfs-761.1.patch Added the check to verifyQuotaForRename() instead of relying upon the check in verifyQuota(). Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Status: Patch Available (was: Open) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Status: Open (was: Patch Available) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Status: Open (was: Patch Available) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Attachment: hdfs-761.1.patch Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-761) Failure to process rename operation from edits log due to quota verification
[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-761: - Status: Patch Available (was: Open) Failure to process rename operation from edits log due to quota verification Key: HDFS-761 URL: https://issues.apache.org/jira/browse/HDFS-761 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.2, 0.21.0, 0.22.0 Reporter: Suresh Srinivas Assignee: Suresh Srinivas Fix For: 0.20.2, 0.21.0, 0.22.0 Attachments: hdfs-761.1.patch, hdfs-761.1.patch, hdfs-761.1.rel20.patch, hdfs-761.patch, hdfs-761.rel20.patch When processing edits log, quota verification is not done and the used quota for directories is not updated. The update is done at the end of processing edits log. This rule is broken by change introduced in HDFS-677. This causes namenode from handling rename operation from edits log due to quota verification failure. Once this happens, namenode does not proceed edits log any further. This results in check point failure on backup node or secondary namenode. This also prevents namenode from coming up. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
