[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9843: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1 for patch v02. I have committed this to trunk, branch-2 and branch-2.8. [~xyao], thank you for the patch. > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Fix For: 2.8.0 > > Attachments: HDFS-9843.00.patch, HDFS-9843.01.patch, > HDFS-9843.02.patch > > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.02.patch Thanks [~cnauroth]! Update the patch with the fixed the link. > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HDFS-9843.00.patch, HDFS-9843.01.patch, > HDFS-9843.02.patch > > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.01.patch Thanks [~cnauroth] for the review. Patch 01 fix the anchor to distcp command line options. > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HDFS-9843.00.patch, HDFS-9843.01.patch > > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Status: Patch Available (was: Open) > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HDFS-9843.00.patch > > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.00.patch Attach a initial patch. > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > Attachments: HDFS-9843.00.patch > > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Affects Version/s: 2.6.0 > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations
[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Component/s: encryption documentation distcp > Document distcp options required for copying between encrypted locations > > > Key: HDFS-9843 > URL: https://issues.apache.org/jira/browse/HDFS-9843 > Project: Hadoop HDFS > Issue Type: Improvement > Components: distcp, documentation, encryption >Affects Versions: 2.6.0 >Reporter: Xiaoyu Yao >Assignee: Xiaoyu Yao > > In TransparentEncryption.md#Distcp_considerations document section, we have > "Copying_between_encrypted_and_unencrypted_locations" which requires > -skipcrccheck and -update. > These options should be documented as required for "Copying between encrypted > locations" use cases as well because this involves decrypting source file and > encrypting destination file with a different EDEK, resulting in different > checksum at the destination. Distcp will fail at crc check if -skipcrccheck > if not specified. > This ticket is opened to document the required options for "Copying between > encrypted locations" use cases when using distcp with HDFS encryption. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
