[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.5 2.7.3 Status: Resolved (was: Patch Available) Thanks Andrew for the review! I just committed the patch to branch-2.7 and branch-2.6. > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Fix For: 2.7.3, 2.6.5 > > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.7.03.patch, > HDFS-9688-branch-2.7.04.patch, HDFS-9688-branch-2.8.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[
https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9688:
Attachment: HDFS-9688-branch-2.7.04.patch
Attaching a duplicate patch as {{HDFS-9688-branch-2.7.03.patch}}. Since
HADOOP-12800 is in, precommit should work.
> Test the effect of nested encryption zones in HDFS downgrade
>
>
> Key: HDFS-9688
> URL: https://issues.apache.org/jira/browse/HDFS-9688
> Project: Hadoop HDFS
> Issue Type: Test
> Components: encryption, test
>Reporter: Zhe Zhang
>Assignee: Zhe Zhang
> Attachments: HDFS-9688-branch-2.6.00.patch,
> HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.7.03.patch,
> HDFS-9688-branch-2.7.04.patch, HDFS-9688-branch-2.8.03.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.8.03.patch Attaching a duplicate patch, renamed with 2.8 suffix to work with Yetus. > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.7.03.patch, > HDFS-9688-branch-2.8.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: (was: HDFS-9688-branch-2.8.02.patch) > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.7.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[
https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-9688:
Attachment: HDFS-9688-branch-2.7.03.patch
Updating the patch after HDFS-9244. There are 2 differences between the 2
versions of {{TestNestedEncryptionZones.java}}:
# Need to call the hooks of allowing and disallowing nested EZs
# An error message change because of the new logic in trunk / 2.8 of checking
parent EZ.
{code}
> // Allow setting nested EZ temporarily
> cluster.getNamesystem().getFSDirectory().ezManager.setAllowNestedEZ();
104a108
> cluster.getNamesystem().getFSDirectory().ezManager.setDisallowNestedEZ();
183c187,188
< "can't be moved into an encryption zone"));
---
> "can't be moved from encryption zone " + topEZ2Dir.toString() +
> " to encryption zone"));
{code}
[~andrew.wang] Could you take another look? Thanks!
> Test the effect of nested encryption zones in HDFS downgrade
>
>
> Key: HDFS-9688
> URL: https://issues.apache.org/jira/browse/HDFS-9688
> Project: Hadoop HDFS
> Issue Type: Test
> Components: encryption, test
>Reporter: Zhe Zhang
>Assignee: Zhe Zhang
> Attachments: HDFS-9688-branch-2.6.00.patch,
> HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.7.03.patch,
> HDFS-9688-branch-2.8.02.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Target Version/s: 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.5) > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.8.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9688: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.8.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.8.02.patch Thanks for the update [~aw]. I discussed with Andrew offline, this patch should actually be targeted for 2.8, and future maint releases of 2.6 and 2.7. Attaching a branch-2.8 patch. [~andrew.wang] Could you take another look? A tricky issue is "rename of root dir of EZ". I just found it's not allowed in 2.6, but allowed in 2.7 and forward. So we need to update the patch when backporting to 2.6. Also, renaming the root dir of a nested EZ won't be allowed, because the destination will be in an EZ (the parent EZ). I think this is the right behavior for nested EZ, but please see if you agree. > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch, HDFS-9688-branch-2.8.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Target Version/s: 2.8.0, 2.7.3, 2.6.4 (was: 2.6.4) > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.6.01.patch Thanks Andrew for the review! I initially preferred not modifying any existing code (hence added a new method with much dup code). But it's actually hard that way, because create EZ goes through multiple levels, including namesystem, directory. Version 0 patch didn't persist the XAttr to edit logs. So the new patch added a test-only flag instead. Please let me know if you see any additional tests we should add. > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch, > HDFS-9688-branch-2.6.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Attachment: HDFS-9688-branch-2.6.00.patch Initial patch to demonstrate the idea. Actually I don't think restarting NN is necessary, because the restarting process merely loads XAttrs without trying to interpret them as EZs. > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > Attachments: HDFS-9688-branch-2.6.00.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9688: Status: Patch Available (was: Open) > Test the effect of nested encryption zones in HDFS downgrade > > > Key: HDFS-9688 > URL: https://issues.apache.org/jira/browse/HDFS-9688 > Project: Hadoop HDFS > Issue Type: Test > Components: encryption, test >Reporter: Zhe Zhang >Assignee: Zhe Zhang > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
