[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch This patch adds BlockReport03 through BlockReport08 cases according to HDFS-551's test plan. The modifications are done against Append branch > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Component/s: test Affects Version/s: Append Branch > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch All testcases are now in place. 3 of them keep failing for some of the functionality isn't yet implemented. > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch Merged with branch-0.21 (works for the trunk as well) > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch This patch accommodates modifications of the tests for new design of BlockReport and fixes some bugs in the original two tests. Last two tests in this patch will have to fixed later on when a new access method to a replica's copy will be implemented as HDFS-680 > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch After HDFS-680 this test had to be moved to {{a.o.h.hdfs.server.datanode}} package to be able to access package-private methods of {{FSDataset}} All tests pass but {{blockReport_05}} It is affected by infinite close file problem and by inability to access client's name from the current test's package. The latter problem might be solved either by changing the visibility of the field (bad idea!) or by injecting an access method for the field. > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch {{blockReport_05()}} needs to be excluded from the test for it corrupts physical block's file but sends in-memory block report. To test the actual case it needs to wait for block scanner's next run. Thus it'll be actually testing of the block scanner rather than block report (similar to {{blockReport_05()}}) > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch This is more appropriate version of the patch for the last one was using new file from automatic refactoring thus was diff'ing nonexistent version from the new location. The content of the patch is the same but is expressed differently. Test-patch results and test results to follow shortly. > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch Some unused methods are removed from the patch. Also, new some useful methods are moved to the new {{GenericTestUtils}} class > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Status: Patch Available (was: Open) The patch seems to be ready > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Status: Open (was: Patch Available) Newer version of the patch is available > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Status: Patch Available (was: Open) Latest version addresses the timeout problem > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch Tests won't timeout anymore. Instead {{prepareSecondReplica()}} will assert if at any point it has been waiting for more than 4 seconds > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch A file has been missed in the previous patch. Fixed > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Status: Open (was: Patch Available) > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Status: Patch Available (was: Open) Missing file problem in the previous patch has been fixed. Resubmitting > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-616: - Attachment: HDFS-616.patch HDFS-512 broke case #3 here, because now blocks with incorrect GS are considered corrupt rather than invalid, which was intended from the very beginning, but was not possible to implement correctly until the block keys changed. I corrected the tets. It looks good now +1. > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Attachment: HDFS-616.patch I've modified the assertion message in case #3. Also, have added javadoc @param for new method in {{NameNodeAdapter}} Thanks for the review, Konstantin! > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I've just committed this. > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: Append Branch >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Fix For: 0.22.0 > > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HDFS-616) Create functional tests for new design of the block report
[ https://issues.apache.org/jira/browse/HDFS-616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-616: Affects Version/s: (was: Append Branch) 0.22.0 0.21.0 Fix Version/s: 0.21.0 > Create functional tests for new design of the block report > -- > > Key: HDFS-616 > URL: https://issues.apache.org/jira/browse/HDFS-616 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: test >Affects Versions: 0.21.0, 0.22.0 >Reporter: Konstantin Boudnik >Assignee: Konstantin Boudnik > Fix For: 0.21.0, 0.22.0 > > Attachments: HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, HDFS-616.patch, > HDFS-616.patch, HDFS-616.patch, HDFS-616.patch > > -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.