[jira] [Assigned] (HDFS-15581) Access Controlled HTTPFS Proxy

2020-09-18 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15581: Assignee: Richard (was: Stephen O'Donnell) > Access Controlled HTTPFS Proxy > ---

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15583: - Affects Version/s: 3.2.0 3.2.1 Status: Patch Availab

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15583: - Attachment: HDFS-15583.branch-3.2.001.patch > Backport DirectoryScanner improvements HDFS

[jira] [Created] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-09-17 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15583: Summary: Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1 Key: HDFS-15583 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197710#comment-17197710 ] Stephen O'Donnell commented on HDFS-15415: -- All tests passed locally. I have co

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Fix Version/s: 3.4.0 > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.branch-3.3.001.patch > Reduce locking in Datanode DirectoryScanner

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197203#comment-17197203 ] Stephen O'Donnell commented on HDFS-15574: -- [~hemanthboyina] Looks like jenkins

[jira] [Assigned] (HDFS-15581) Access Controlled HTTPFS Proxy

2020-09-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15581: Assignee: Stephen O'Donnell (was: Richard) > Access Controlled HTTPFS Proxy > ---

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.3.002.patch > Remove unnecessary sort of block list in Di

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196971#comment-17196971 ] Stephen O'Donnell commented on HDFS-15574: -- The 3.2 patch looks good, and it sho

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.005.patch > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.2.002.patch > Remove unnecessary sort of block list in Di

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196232#comment-17196232 ] Stephen O'Donnell commented on HDFS-15415: -- [~weichiu] Thanks for the review. Yo

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.004.patch > Reduce locking in Datanode DirectoryScanner >

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196144#comment-17196144 ] Stephen O'Donnell commented on HDFS-15574: -- I'm not sure - I think I got jenkins

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.003.patch > Reduce locking in Datanode DirectoryScanner >

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.2.001.patch > Remove unnecessary sort of block list in Di

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.3.001.patch > Remove unnecessary sort of block list in Di

[jira] [Reopened] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-15574: -- Reopening to backport to earlier branches. > Remove unnecessary sort of block list in Dire

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195940#comment-17195940 ] Stephen O'Donnell commented on HDFS-15574: -- [~hemanthboyina] Thanks for committi

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195711#comment-17195711 ] Stephen O'Donnell commented on HDFS-15574: -- [~liuml07] Thanks for the review.

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195342#comment-17195342 ] Stephen O'Donnell commented on HDFS-15574: -- Ran all the failing test classes and

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-13 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.003.patch > Remove unnecessary sort of block list in DirectoryScan

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-13 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194942#comment-17194942 ] Stephen O'Donnell commented on HDFS-15574: -- [~hemanthboyina] If a block changes

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194652#comment-17194652 ] Stephen O'Donnell commented on HDFS-15574: -- [~hemanthboyina] I am not sure what

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.002.patch > Remove unnecessary sort of block list in DirectoryScan

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Description: In HDFS-15406, we have a small change to greatly reduce the runtime and lock

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194195#comment-17194195 ] Stephen O'Donnell commented on HDFS-15415: -- This patch needs rebased against cur

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Status: Patch Available (was: Open) > Remove unnecessary sort of block list in Directory

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.001.patch > Remove unnecessary sort of block list in DirectoryScan

[jira] [Created] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-11 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15574: Summary: Remove unnecessary sort of block list in DirectoryScanner Key: HDFS-15574 URL: https://issues.apache.org/jira/browse/HDFS-15574 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194145#comment-17194145 ] Stephen O'Donnell commented on HDFS-15573: -- [~leosun08] Could you give this simp

[jira] [Updated] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15573: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > Only log war

[jira] [Updated] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15573: - Attachment: HDFS-15573.001.patch > Only log warning if considerLoad and considerStorageTy

[jira] [Updated] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15573: - Affects Version/s: 3.4.0 3.3.1 > Only log warning if considerLoad

[jira] [Created] (HDFS-15573) Only log warning if considerLoad and considerStorageType are both true

2020-09-11 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15573: Summary: Only log warning if considerLoad and considerStorageType are both true Key: HDFS-15573 URL: https://issues.apache.org/jira/browse/HDFS-15573 Project:

[jira] [Commented] (HDFS-14997) BPServiceActor processes commands from NameNode asynchronously

2020-09-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17193490#comment-17193490 ] Stephen O'Donnell commented on HDFS-14997: -- [~Captainhzy] Do you have this patch

[jira] [Commented] (HDFS-15131) FoldedTreeSet appears to degrade over time

2020-08-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186050#comment-17186050 ] Stephen O'Donnell commented on HDFS-15131: -- [~maniaabdi] We caught this bug as o

[jira] [Commented] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185390#comment-17185390 ] Stephen O'Donnell commented on HDFS-15540: -- [~ferhui] you worked on HDFS-14802 

[jira] [Updated] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15540: - Attachment: HDFS-15540.001.patch > Directories protected from delete can still be moved t

[jira] [Updated] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15540: - Status: Patch Available (was: Open) > Directories protected from delete can still be mov

[jira] [Commented] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185386#comment-17185386 ] Stephen O'Donnell commented on HDFS-15540: -- I will post a patch for this shortly

[jira] [Created] (HDFS-15540) Directories protected from delete can still be moved to the trash

2020-08-26 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-15540: Summary: Directories protected from delete can still be moved to the trash Key: HDFS-15540 URL: https://issues.apache.org/jira/browse/HDFS-15540 Project: Hado

[jira] [Updated] (HDFS-14852) Removing from LowRedundancyBlocks does not remove the block from all queues

2020-08-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14852: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk and

[jira] [Updated] (HDFS-14852) Removing from LowRedundancyBlocks does not remove the block from all queues

2020-08-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14852: - Fix Version/s: 3.1.5 3.4.0 3.3.1

[jira] [Updated] (HDFS-14852) Removing from LowRedundancyBlocks does not remove the block from all queues

2020-08-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14852: - Summary: Removing from LowRedundancyBlocks does not remove the block from all queues (wa

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-25 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183885#comment-17183885 ] Stephen O'Donnell commented on HDFS-14852: -- +1 on v7 from me too. > Remove of L

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2020-08-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180621#comment-17180621 ] Stephen O'Donnell commented on HDFS-14852: -- I just re-checked some of the older

[jira] [Updated] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15493: - Target Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was:

[jira] [Updated] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-12 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15493: - Fix Version/s: 3.4.0 3.3.1 > Update block map and name cache in parall

[jira] [Updated] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15493: - Attachment: HDFS-15493.008.patch > Update block map and name cache in parallel while load

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175872#comment-17175872 ] Stephen O'Donnell commented on HDFS-15493: -- The find bugs warnings have been int

[jira] [Commented] (HDFS-15520) Use visitor pattern to visit namespace tree

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175871#comment-17175871 ] Stephen O'Donnell commented on HDFS-15520: -- [~szetszwo] This change seems to hav

[jira] [Comment Edited] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175562#comment-17175562 ] Stephen O'Donnell edited comment on HDFS-15493 at 8/11/20, 1:20 PM: ---

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175562#comment-17175562 ] Stephen O'Donnell commented on HDFS-15493: -- +1 on 007 patch. I will commit it la

[jira] [Assigned] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-11 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-15493: Assignee: Chengwei Wang > Update block map and name cache in parallel while loadin

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174438#comment-17174438 ] Stephen O'Donnell commented on HDFS-15493: -- [~smarthan]Thanks for the update. I

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-08-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173653#comment-17173653 ] Stephen O'Donnell commented on HDFS-15493: -- Hi [~smarthan] Thanks for the latest

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168917#comment-17168917 ] Stephen O'Donnell commented on HDFS-15493: -- I tested with the 004 patch: * Par

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168670#comment-17168670 ] Stephen O'Donnell commented on HDFS-15493: -- {quote} After reviewed code about up

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesystem are not deleted during snapshot delete

2020-07-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Resolution: Fixed Status: Resolved (was: Patch Available) > Ensure inodes in act

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesystem are not deleted during snapshot delete

2020-07-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167980#comment-17167980 ] Stephen O'Donnell commented on HDFS-15313: -- Commited HDFS-15313.branch-2.10.001.

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesystem are not deleted during snapshot delete

2020-07-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Fix Version/s: 2.10.1 > Ensure inodes in active filesystem are not deleted during snapsho

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167831#comment-17167831 ] Stephen O'Donnell commented on HDFS-15493: -- {quote} So, awaitTermination 1 ms wo

[jira] [Comment Edited] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-30 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167831#comment-17167831 ] Stephen O'Donnell edited comment on HDFS-15493 at 7/30/20, 11:20 AM: --

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167341#comment-17167341 ] Stephen O'Donnell commented on HDFS-15495: -- Here is a unit test which can be add

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM: ---

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM: ---

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

2020-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell commented on HDFS-15495: -- There are a few things to think abou

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-29 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167143#comment-17167143 ] Stephen O'Donnell commented on HDFS-15493: -- {quote} I had tested loading the cac

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-28 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17166393#comment-17166393 ] Stephen O'Donnell commented on HDFS-15493: -- I did a bit more testing: 1. Change

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165980#comment-17165980 ] Stephen O'Donnell commented on HDFS-15493: -- I tested this change with at image o

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-27 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165674#comment-17165674 ] Stephen O'Donnell commented on HDFS-15493: -- Hi [~smarthan]. Thanks for this patc

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

2020-07-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17164336#comment-17164336 ] Stephen O'Donnell commented on HDFS-15493: -- This looks like another good speed i

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-20 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161298#comment-17161298 ] Stephen O'Donnell commented on HDFS-15313: -- HDFS-15313.branch-2.10.001.patch LGT

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159219#comment-17159219 ] Stephen O'Donnell commented on HDFS-14498: -- With HDFS-14498-branch-2.10.004.pat

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Fix Version/s: 3.1.5 > Ensure inodes in active filesytem are not deleted during snapshot

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159134#comment-17159134 ] Stephen O'Donnell commented on HDFS-14498: -- Upload a v004 branch-2.10 patch to a

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-16 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14498: - Attachment: HDFS-14498-branch-2.10.004.patch > LeaseManager can loop forever on the file

[jira] [Comment Edited] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158709#comment-17158709 ] Stephen O'Donnell edited comment on HDFS-15313 at 7/15/20, 9:09 PM: ---

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158709#comment-17158709 ] Stephen O'Donnell commented on HDFS-15313: -- Looks to me like the only difference

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Attachment: (was: HDFS-15313.branch-3.1.patch) > Ensure inodes in active filesytem ar

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Attachment: HDFS-15313-branch-3.1.001.patch > Ensure inodes in active filesytem are not d

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Target Version/s: 3.4.0 Status: Patch Available (was: Reopened) > Ensure i

[jira] [Reopened] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-15313: -- Reopening to see if we can trigger jenkins on the 3.1 and 2.10 patches. > Ensure inodes in

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158476#comment-17158476 ] Stephen O'Donnell commented on HDFS-14498: -- The revised patches LGTM. For the fi

[jira] [Commented] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158140#comment-17158140 ] Stephen O'Donnell commented on HDFS-15313: -- This Jira was originally created, be

[jira] [Updated] (HDFS-15313) Ensure inodes in active filesytem are not deleted during snapshot delete

2020-07-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15313: - Fix Version/s: 3.3.1 3.2.2 > Ensure inodes in active filesytem are not

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157357#comment-17157357 ] Stephen O'Donnell commented on HDFS-14498: -- I applied the HDFS-14498-branch-2.10

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157256#comment-17157256 ] Stephen O'Donnell commented on HDFS-14498: -- Were the compile issues all around t

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17155256#comment-17155256 ] Stephen O'Donnell commented on HDFS-14498: -- [~hexiaoqiao] Thanks for following u

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17153740#comment-17153740 ] Stephen O'Donnell commented on HDFS-14498: -- [~hexiaoqiao] Thanks for the review.

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14498: - Attachment: HDFS-14498.002.patch > LeaseManager can loop forever on the file for which cr

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14498: - Attachment: HDFS-14498.001.patch > LeaseManager can loop forever on the file for which cr

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14498: - Target Version/s: 3.4.0 Status: Patch Available (was: Open) > LeaseManager

[jira] [Updated] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14498: - Component/s: namenode > LeaseManager can loop forever on the file for which create has fa

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152345#comment-17152345 ] Stephen O'Donnell commented on HDFS-14498: -- [~hexiaoqiao] Thanks for confirming

[jira] [Assigned] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reassigned HDFS-14498: Assignee: Stephen O'Donnell > LeaseManager can loop forever on the file for which

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-06 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152206#comment-17152206 ] Stephen O'Donnell commented on HDFS-14498: -- {quote} IMO, if client never renew l

<    1   2   3   4   5   6   7   8   9   10   >