[
https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HDFS-10939:
-------------------------------
Attachment: HDFS-10939.patch
Full use of IIP in EncryptionZoneManager and FsDirEncryptionZoneOp required a
few minor IIP xattr api changes with a small ripple into other classes.
Main changes are:
# a few more shorts via hasCreatedEncryptionZone()
# moved EZ specific code from FsDirWriteFileOp into FsDirEncryptionZoneOp
# significantly cleaned up startFile method
# forced multi-stage locking is removed. Instead of read lock, resolve,
pre-conditions, read unlock, may generate EDEK, write lock, resolve,
pre-conditions, do create; it's now write lock, resolve, pre-conditions, (iff
need EDEK: write unlock, generate EDEK, write lock, re-resolve,
pre-conditions), do create
# don't allocate BlocksMapUpdateInfo until just before needed so failed creates
don't waste allocations
# tweaked how skipSync is set to avoid nothing to sync logging in some cases
> Reduce performance penalty of encryption zones
> ----------------------------------------------
>
> Key: HDFS-10939
> URL: https://issues.apache.org/jira/browse/HDFS-10939
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs
> Affects Versions: 2.7
> Reporter: Daryn Sharp
> Assignee: Daryn Sharp
> Attachments: HDFS-10939.patch
>
>
> The encryption zone APIs should be optimized to extensively use IIPs to
> eliminate path resolutions. The performance penalties incurred by common
> operations like creation of file statuses may be reduced by more extensive
> short-circuiting of EZ lookups when no EZs exist. All file creates should
> not be subjected to the multi-stage locking performance penalty required only
> for EDEK generation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
