[jira] [Resolved] (HDFS-16132) SnapshotDiff report fails with invalid path assertion with external Attribute provider

[ https://issues.apache.org/jira/browse/HDFS-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-16132. -- Resolution: Won't Fix Closing this as it is no longer relevant after HDFS-16144 reverte

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Resolution: Fixed Status: Resolved (was: Patch Available) > Revert HDFS-15372 (F

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Fix Version/s: 3.3.2 3.4.0 > Revert HDFS-15372 (Files in snapshots no

[jira] [Commented] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388784#comment-17388784 ] Stephen O'Donnell commented on HDFS-16144: -- The only changes between 003 and 004

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388638#comment-17388638 ] Stephen O'Donnell commented on HDFS-14617: -- [~mofei] Would you like to create a

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: HDFS-16144.004.patch > Revert HDFS-15372 (Files in snapshots no longer see at

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: HDFS-16144.004.patch > Revert HDFS-15372 (Files in snapshots no longer see at

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: (was: HDFS-16144.004.patch) > Revert HDFS-15372 (Files in snapshots no lo

[jira] [Commented] (HDFS-16145) CopyListing fails with FNF exception with snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-16145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388595#comment-17388595 ] Stephen O'Donnell commented on HDFS-16145: -- I cherry-picked this to branch-3.3 b

[jira] [Updated] (HDFS-16145) CopyListing fails with FNF exception with snapshot diff

[ https://issues.apache.org/jira/browse/HDFS-16145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16145: - Fix Version/s: 3.4.0 > CopyListing fails with FNF exception with snapshot diff >

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388549#comment-17388549 ] Stephen O'Donnell commented on HDFS-15175: -- I am +1 on the current patch. The fa

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388275#comment-17388275 ] Stephen O'Donnell commented on HDFS-15175: -- This is a tricky problem. If I under

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: HDFS-16144.003.patch > Revert HDFS-15372 (Files in snapshots no longer see at

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: HDFS-16144.002.patch > Revert HDFS-15372 (Files in snapshots no longer see at

[jira] [Commented] (HDFS-15886) Add a way to get protected dirs from a special configuration file

[ https://issues.apache.org/jira/browse/HDFS-15886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17387273#comment-17387273 ] Stephen O'Donnell commented on HDFS-15886: -- {quote} As for reload the config con

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Status: Patch Available (was: Open) > Revert HDFS-15372 (Files in snapshots no longer se

[jira] [Updated] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

[ https://issues.apache.org/jira/browse/HDFS-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16144: - Attachment: HDFS-16144.001.patch > Revert HDFS-15372 (Files in snapshots no longer see at

[jira] [Created] (HDFS-16144) Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions)

Stephen O'Donnell created HDFS-16144: Summary: Revert HDFS-15372 (Files in snapshots no longer see attribute provider permissions) Key: HDFS-16144 URL: https://issues.apache.org/jira/browse/HDFS-16144

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15796: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed down the act

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15796: - Fix Version/s: 3.3.2 3.2.3 3.4.0 > ConcurrentModifi

[jira] [Updated] (HDFS-16121) Iterative snapshot diff report can generate duplicate records for creates, deletes and Renames

[ https://issues.apache.org/jira/browse/HDFS-16121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16121: - Fix Version/s: 3.3.2 3.2.3 > Iterative snapshot diff report can genera

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377451#comment-17377451 ] Stephen O'Donnell commented on HDFS-15796: -- +1 on this from me. I will commit to

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377279#comment-17377279 ] Stephen O'Donnell commented on HDFS-15796: -- [~Daniel Ma] When this problem occur

[jira] [Commented] (HDFS-16121) Iterative snapshot diff report can generate duplicate records for creates, deletes and Renames

[ https://issues.apache.org/jira/browse/HDFS-16121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377262#comment-17377262 ] Stephen O'Donnell commented on HDFS-16121: -- Does it look like this change was in

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376667#comment-17376667 ] Stephen O'Donnell commented on HDFS-15796: -- Thanks [~Daniel Ma] - the latest pat

[jira] [Assigned] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15796: Assignee: Daniel Ma > ConcurrentModificationException error happens on NameNode oc

[jira] [Updated] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15796: - Target Version/s: 3.4.0 (was: 3.3.1) Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376568#comment-17376568 ] Stephen O'Donnell commented on HDFS-15796: -- For the latest patch, why not just u

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376421#comment-17376421 ] Stephen O'Donnell commented on HDFS-15796: -- [~Hemanth Boyina] Would you have tim

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376419#comment-17376419 ] Stephen O'Donnell commented on HDFS-15796: -- Looking at the changes in this area,

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375453#comment-17375453 ] Stephen O'Donnell commented on HDFS-15796: -- [~Daniel Ma] I understand how a Conc

[jira] [Commented] (HDFS-15796) ConcurrentModificationException error happens on NameNode occasionally

[ https://issues.apache.org/jira/browse/HDFS-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375386#comment-17375386 ] Stephen O'Donnell commented on HDFS-15796: -- I don't think the patch will help an

[jira] [Commented] (HDFS-16098) ERROR tools.DiskBalancerCLI: java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-16098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371921#comment-17371921 ] Stephen O'Donnell commented on HDFS-16098: -- HDFS-13728 and HDFS-13727 may be rel

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17371298#comment-17371298 ] Stephen O'Donnell commented on HDFS-16093: -- I'm not sure it we can simply remove

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15150: - Resolution: Fixed Status: Resolved (was: Patch Available) Closing this again as

[jira] [Updated] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15150: - Fix Version/s: 2.10.2 > Introduce read write lock to Datanode > -

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367468#comment-17367468 ] Stephen O'Donnell commented on HDFS-15150: -- [~ahussein] Thanks for the reminder.

[jira] [Updated] (HDFS-15140) Replace FoldedTreeSet in Datanode with SortedSet or TreeMap

[ https://issues.apache.org/jira/browse/HDFS-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15140: - Resolution: Won't Fix Status: Resolved (was: Patch Available) HDFS-13671 has bee

[jira] [Resolved] (HDFS-15131) FoldedTreeSet appears to degrade over time

[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15131. -- Resolution: Won't Fix HDFS-13671 is now committed which removes the FoldedTreeSet from

[jira] [Commented] (HDFS-16077) OIV parsing tool throws NPE for a FSImage with multiple InodeSections

[ https://issues.apache.org/jira/browse/HDFS-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365410#comment-17365410 ] Stephen O'Donnell commented on HDFS-16077: -- I didn't think that OIV had been mod

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364514#comment-17364514 ] Stephen O'Donnell commented on HDFS-15150: -- +1 on the 003 patch. Your plan on th

[jira] [Commented] (HDFS-15150) Introduce read write lock to Datanode

[ https://issues.apache.org/jira/browse/HDFS-15150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363696#comment-17363696 ] Stephen O'Donnell commented on HDFS-15150: -- [~ahussein] Thanks for backporting t

[jira] [Commented] (HDFS-16032) DFSClient#delete supports Trash

[ https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351659#comment-17351659 ] Stephen O'Donnell commented on HDFS-16032: -- I agree with [~ayushtkn]. It does no

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351652#comment-17351652 ] Stephen O'Donnell commented on HDFS-13671: -- Did anyone spend any time trying to

[jira] [Commented] (HDFS-16023) Improve blockReportLeaseId acquisition to avoid repeated FBR

[ https://issues.apache.org/jira/browse/HDFS-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342653#comment-17342653 ] Stephen O'Donnell commented on HDFS-16023: -- {quote} When the NameNode receives t

[jira] [Commented] (HDFS-16013) DirectoryScan operation holds dataset lock for long time

[ https://issues.apache.org/jira/browse/HDFS-16013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340866#comment-17340866 ] Stephen O'Donnell commented on HDFS-16013: -- You want these ones: HDFS-15406. Im

[jira] [Updated] (HDFS-15865) Interrupt DataStreamer thread

[ https://issues.apache.org/jira/browse/HDFS-15865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15865: - Fix Version/s: 3.4.0 3.3.1 > Interrupt DataStreamer thread > -

[jira] [Updated] (HDFS-16000) HDFS : Rename performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-16000: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > HDFS : Renam

[jira] [Resolved] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15621. -- Resolution: Fixed > Datanode DirectoryScanner uses excessive memory > -

[jira] [Updated] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15621: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Commented] (HDFS-15250) Setting `dfs.client.use.datanode.hostname` to true can crash the system because of unhandled UnresolvedAddressException

[ https://issues.apache.org/jira/browse/HDFS-15250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326902#comment-17326902 ] Stephen O'Donnell commented on HDFS-15250: -- I am reviewing some backports and ca

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15850: - Status: Patch Available (was: Reopened) > Superuser actions should be reported to extern

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15850: - Attachment: HDFS-15850.branch-3.3.001.patch > Superuser actions should be reported to ext

[jira] [Reopened] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-15850: -- > Superuser actions should be reported to external enforcers >

[jira] [Commented] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326442#comment-17326442 ] Stephen O'Donnell commented on HDFS-15850: -- We should backport this to branch-3.

[jira] [Commented] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325930#comment-17325930 ] Stephen O'Donnell commented on HDFS-15990: -- Both strategies are different ways o

[jira] [Updated] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15569: - Fix Version/s: 3.3.1 > Speed up the Storage#doRecover during datanode rolling upgrade >

[jira] [Updated] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14999: - Fix Version/s: 3.3.1 > Avoid Potential Infinite Loop in DFSNetworkTopology >

[jira] [Commented] (HDFS-15990) No need to write to sub_section when serialize SnapshotDiff Section

[ https://issues.apache.org/jira/browse/HDFS-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325056#comment-17325056 ] Stephen O'Donnell commented on HDFS-15990: -- The reason the sub-sections are writ

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17323796#comment-17323796 ] Stephen O'Donnell commented on HDFS-15985: -- [~jianghuazhu] Any idea on how a sec

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15160: - Resolution: Fixed Status: Resolved (was: Patch Available) This is backported to

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15160: - Fix Version/s: 3.3.1 > ReplicaMap, Disk Balancer, Directory Scanner and various FsDataset

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15942: - Fix Version/s: 3.3.1 > Increase Quota initialization threads > --

[jira] [Resolved] (HDFS-15937) Reduce memory used during datanode layout upgrade

[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15937. -- Resolution: Fixed > Reduce memory used during datanode layout upgrade > ---

[jira] [Commented] (HDFS-15937) Reduce memory used during datanode layout upgrade

[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317117#comment-17317117 ] Stephen O'Donnell commented on HDFS-15937: -- Committed this from 3.1 up to trunk.

[jira] [Updated] (HDFS-15937) Reduce memory used during datanode layout upgrade

[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15937: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15942: - Attachment: HDFS-15942.001.patch > Increase Quota initialization threads > --

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15942: - Component/s: namenode Target Version/s: 3.4.0 > Increase Quota initialization th

[jira] [Created] (HDFS-15942) Increase Quota initialization threads

Stephen O'Donnell created HDFS-15942: Summary: Increase Quota initialization threads Key: HDFS-15942 URL: https://issues.apache.org/jira/browse/HDFS-15942 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

[ https://issues.apache.org/jira/browse/HDFS-15621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313253#comment-17313253 ] Stephen O'Donnell commented on HDFS-15621: -- I posted a PR for an improvement on

[jira] [Updated] (HDFS-15937) Reduce memory used during datanode layout upgrade

[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15937: - Attachment: heap-dump-before.png heap-dump-after.png > Reduce memory used

[jira] [Created] (HDFS-15937) Reduce memory used during datanode layout upgrade

Stephen O'Donnell created HDFS-15937: Summary: Reduce memory used during datanode layout upgrade Key: HDFS-15937 URL: https://issues.apache.org/jira/browse/HDFS-15937 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15924) Log4j will cause Server handler blocked when audit log boom.

[ https://issues.apache.org/jira/browse/HDFS-15924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309347#comment-17309347 ] Stephen O'Donnell commented on HDFS-15924: -- Do you have async audit logging enab

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308697#comment-17308697 ] Stephen O'Donnell commented on HDFS-13639: -- Thanks [~leosun08]. This was was a c

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-13639: - Fix Version/s: 3.3.1 > SlotReleaser is not fast enough > ---

[jira] [Commented] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308675#comment-17308675 ] Stephen O'Donnell commented on HDFS-15919: -- Thanks all for the reviews and commi

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308030#comment-17308030 ] Stephen O'Donnell commented on HDFS-15160: -- [~weichiu] Could you give the branch

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307823#comment-17307823 ] Stephen O'Donnell commented on HDFS-15160: -- After backporting this to branch-3.3

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307804#comment-17307804 ] Stephen O'Donnell commented on HDFS-15907: -- Thanks for committing [~ayushtkn]. T

[jira] [Updated] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15919: - Attachment: HDFS-15919.001.patch > BlockPoolManager should log stack trace if unable to g

[jira] [Created] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

Stephen O'Donnell created HDFS-15919: Summary: BlockPoolManager should log stack trace if unable to get Namenode addresses Key: HDFS-15919 URL: https://issues.apache.org/jira/browse/HDFS-15919 Pro

[jira] [Updated] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15160: - Attachment: HDFS-15160.branch-3-3.001.patch > ReplicaMap, Disk Balancer, Directory Scanne

[jira] [Reopened] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-15160: -- Reopening to backport to branch-3.3 > ReplicaMap, Disk Balancer, Directory Scanner and var

[jira] [Updated] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-10792: - Fix Version/s: 3.3.1 > RedundantEditLogInputStream should log caught exceptions > ---

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15093: - Fix Version/s: 3.3.1 > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified > --

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17307027#comment-17307027 ] Stephen O'Donnell commented on HDFS-13639: -- [~leosun08] Are you running this cha

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306193#comment-17306193 ] Stephen O'Donnell commented on HDFS-15160: -- Are there any objections to backport

[jira] [Updated] (HDFS-15439) Setting dfs.mover.retry.max.attempts to negative value will retry forever.

[ https://issues.apache.org/jira/browse/HDFS-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15439: - Fix Version/s: 3.2.3 3.1.5 3.3.1 > Setting dfs.move

[jira] [Updated] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15443: - Fix Version/s: 3.3.1 > Setting dfs.datanode.max.transfer.threads to a very small value ca

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306134#comment-17306134 ] Stephen O'Donnell commented on HDFS-15907: -- Let me re-trigger Yetus / check the

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306125#comment-17306125 ] Stephen O'Donnell commented on HDFS-15907: -- Yea, Shiv was concerned about the me

[jira] [Commented] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305227#comment-17305227 ] Stephen O'Donnell commented on HDFS-15438: -- This was a clean cherry-pick down to

[jira] [Updated] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15438: - Fix Version/s: 3.2.3 3.1.5 3.3.1 > Setting dfs.disk

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305030#comment-17305030 ] Stephen O'Donnell commented on HDFS-15907: -- [~prasad-acit] [~hexiaoqiao] What do

[jira] [Updated] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15907: - Status: Patch Available (was: Open) > Reduce Memory Overhead of AclFeature by avoiding A

[jira] [Updated] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15907: - Attachment: HDFS-15907.001.patch > Reduce Memory Overhead of AclFeature by avoiding Atomi

[jira] [Created] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

Stephen O'Donnell created HDFS-15907: Summary: Reduce Memory Overhead of AclFeature by avoiding AtomicInteger Key: HDFS-15907 URL: https://issues.apache.org/jira/browse/HDFS-15907 Project: Hadoop

[jira] [Commented] (HDFS-15633) Avoid redundant RPC calls for getDiskStatus

[ https://issues.apache.org/jira/browse/HDFS-15633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304860#comment-17304860 ] Stephen O'Donnell commented on HDFS-15633: -- [~ayushtkn] This looks like another

[jira] [Commented] (HDFS-15886) Add a way to get protected dirs from a special configuration file

[ https://issues.apache.org/jira/browse/HDFS-15886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17299699#comment-17299699 ] Stephen O'Donnell commented on HDFS-15886: -- I checked the PR, and I think we cou

[jira] [Commented] (HDFS-13677) Dynamic refresh Disk configuration results in overwriting VolumeMap

[ https://issues.apache.org/jira/browse/HDFS-13677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293977#comment-17293977 ] Stephen O'Donnell commented on HDFS-13677: -- I pushed this change to branch 2.10,

<    1   2   3   4   5   6   7   8   9   10   >