[jira] [Updated] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-07-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-16042: --- Fix Version/s: 3.3.2 3.2.3 2.10.2 Resolution: Fixed

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15659: --- Fix Version/s: 3.2.3 2.10.2 Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363057#comment-17363057 ] Jim Brennan commented on HDFS-15659: [~ahussein] I cherry-picked this to branch-3.3, but there are

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15659: --- Fix Version/s: 3.3.2 > Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster >

[jira] [Resolved] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-16042. Fix Version/s: 3.4.0 Resolution: Fixed Thanks for the contribution [~ahussein]! [~kihwal]

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2021-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361877#comment-17361877 ] Jim Brennan commented on HDFS-15659: [~ayushtkn], [~aajisaka], [~ahussein] any objection to pulling

[jira] [Updated] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15671: --- Fix Version/s: 3.4.0 > TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk >

[jira] [Commented] (HDFS-15671) TestBalancerRPCDelay#testBalancerRPCDelayQpsDefault fails on Trunk

2021-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361871#comment-17361871 ] Jim Brennan commented on HDFS-15671: [~ahussein] +1 I have committed this to trunk. It does not

[jira] [Commented] (HDFS-15971) Make mkstemp cross platform

2021-06-09 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360371#comment-17360371 ] Jim Brennan commented on HDFS-15971: [~gautham], thanks for your response. I have upgraded everything

[jira] [Commented] (HDFS-15971) Make mkstemp cross platform

2021-06-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359559#comment-17359559 ] Jim Brennan commented on HDFS-15971: I'm also puzzled by this failing check. This did not fail on

[jira] [Commented] (HDFS-15971) Make mkstemp cross platform

2021-06-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359551#comment-17359551 ] Jim Brennan commented on HDFS-15971: [~gautham], [~elgoiri], [~ebadger] There still seems to be a

[jira] [Commented] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

2021-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17356468#comment-17356468 ] Jim Brennan commented on HDFS-16042: [~ahussein] I believe this was filed due to an incident where

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

2021-04-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319677#comment-17319677 ] Jim Brennan commented on HDFS-15660: I share [~weichiu]'s confusion. If this change was put in

[jira] [Updated] (HDFS-15821) Add metrics for in-service datanodes

2021-02-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15821: --- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15821) Add metrics for in-service datanodes

2021-02-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284867#comment-17284867 ] Jim Brennan commented on HDFS-15821: Thanks for the contribution [~zehao.chen]! I have committed

[jira] [Updated] (HDFS-15821) Add metrics for in-service datanodes

2021-02-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15821: --- Status: Patch Available (was: Open) > Add metrics for in-service datanodes >

[jira] [Updated] (HDFS-15811) completeFile should log final file size

2021-02-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15811: --- Status: Patch Available (was: Open) > completeFile should log final file size >

[jira] [Updated] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15813: --- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279753#comment-17279753 ] Jim Brennan commented on HDFS-15308: Still seeing similar failures in pre-commit builds. I filed

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279751#comment-17279751 ] Jim Brennan commented on HDFS-15813: Thanks for the review [~kihwal]! Jira for

[jira] [Created] (HDFS-15823) TestReconstructStripedFileWithRandomECPolicy failures

2021-02-05 Thread Jim Brennan (Jira)
Jim Brennan created HDFS-15823: -- Summary: TestReconstructStripedFileWithRandomECPolicy failures Key: HDFS-15823 URL: https://issues.apache.org/jira/browse/HDFS-15823 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9243) TestUnderReplicatedBlocks#testSetrepIncWithUnderReplicatedBlocks test timeout

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279740#comment-17279740 ] Jim Brennan commented on HDFS-9243: --- [~kihwal] analyzed this as well. Including his comment here:

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278973#comment-17278973 ] Jim Brennan commented on HDFS-15813: patch 004 fixes the checkstyle issue. I don't think the unit

[jira] [Updated] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15813: --- Attachment: HDFS-15813.004.patch > DataStreamer: keep sending heartbeat packets while streaming >

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278406#comment-17278406 ] Jim Brennan commented on HDFS-15813: [~kihwal] thanks for the detailed test suggestion. I have added

[jira] [Updated] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15813: --- Attachment: HDFS-15813.003.patch > DataStreamer: keep sending heartbeat packets while streaming >

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278239#comment-17278239 ] Jim Brennan commented on HDFS-15813: Thanks [~kihwal]. I will try this. > DataStreamer: keep

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278185#comment-17278185 ] Jim Brennan commented on HDFS-15813: I searched again and found this had been put up in [HDFS-12763]

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278054#comment-17278054 ] Jim Brennan commented on HDFS-15813: [~kihwal] do you think we need a unit test for this? >

[jira] [Updated] (HDFS-15799) Make DisallowedDatanodeException terse

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15799: --- Affects Version/s: 3.4.0 2.10.1 > Make DisallowedDatanodeException terse >

[jira] [Updated] (HDFS-15799) Make DisallowedDatanodeException terse

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15799: --- Target Version/s: (was: 3.3.0) > Make DisallowedDatanodeException terse >

[jira] [Updated] (HDFS-15799) Make DisallowedDatanodeException terse

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15799: --- Status: Patch Available (was: Open) > Make DisallowedDatanodeException terse >

[jira] [Updated] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15813: --- Attachment: HDFS-15813.002.patch > DataStreamer: keep sending heartbeat packets while streaming >

[jira] [Commented] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277309#comment-17277309 ] Jim Brennan commented on HDFS-15813: Looks like I need to update the patch. > DataStreamer: keep

[jira] [Updated] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15813: --- Attachment: HDFS-15813.001.patch Status: Patch Available (was: Open) Submitting patch - we

[jira] [Created] (HDFS-15813) DataStreamer: keep sending heartbeat packets while streaming

2021-02-02 Thread Jim Brennan (Jira)
Jim Brennan created HDFS-15813: -- Summary: DataStreamer: keep sending heartbeat packets while streaming Key: HDFS-15813 URL: https://issues.apache.org/jira/browse/HDFS-15813 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-15799) Make DisallowedDatanodeException terse

2021-01-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned HDFS-15799: -- Assignee: Richard > Make DisallowedDatanodeException terse >

[jira] [Updated] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15789: --- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273917#comment-17273917 ] Jim Brennan commented on HDFS-15789: The unit test failures are not related. I verified they pass

[jira] [Updated] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2021-01-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-10498: --- Fix Version/s: 3.2.3 2.10.2 3.1.5 3.4.0

[jira] [Commented] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272277#comment-17272277 ] Jim Brennan commented on HDFS-15789: I don't think we need a new unit test for this. [~daryn],

[jira] [Commented] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2021-01-26 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272275#comment-17272275 ] Jim Brennan commented on HDFS-10498: [~kihwal] can you please review? > Intermittent test failure

[jira] [Updated] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15789: --- Attachment: HDFS-15789.001.patch > Lease renewal does not require namesystem lock >

[jira] [Updated] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-15789: --- Status: Patch Available (was: Open) > Lease renewal does not require namesystem lock >

[jira] [Created] (HDFS-15789) Lease renewal does not require namesystem lock

2021-01-25 Thread Jim Brennan (Jira)
Jim Brennan created HDFS-15789: -- Summary: Lease renewal does not require namesystem lock Key: HDFS-15789 URL: https://issues.apache.org/jira/browse/HDFS-15789 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2021-01-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-10498: --- Status: Patch Available (was: Reopened) > Intermittent test failure >

[jira] [Updated] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2021-01-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-10498: --- Attachment: HDFS-10498.001.patch > Intermittent test failure >

[jira] [Reopened] (HDFS-10498) Intermittent test failure org.apache.hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength.testSnapshotfileLength

2021-01-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HDFS-10498: Assignee: Jim Brennan (was: Ahmed Hussein) We did end up fixing this internally, I will put up

[jira] [Updated] (HDFS-13723) Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh

2021-01-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-13723: --- Fix Version/s: 2.10.2 > Occasional "Should be different group" error in >

[jira] [Commented] (HDFS-13723) Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh

2021-01-21 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269570#comment-17269570 ] Jim Brennan commented on HDFS-13723: [~ahussein], I pulled this back to branch-2.10.   > Occasional

[jira] [Assigned] (HDFS-13009) Creation of Encryption zone should succeed even if directory is not empty.

2021-01-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned HDFS-13009: -- Assignee: Zehao Chen (was: Rushabh Shah) > Creation of Encryption zone should succeed even

[jira] [Assigned] (HDFS-12102) VolumeScanner throttle dropped (fast scan enabled) when there is a corrupt block

2021-01-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned HDFS-12102: -- Assignee: Zehao Chen (was: Ahmed Hussein) > VolumeScanner throttle dropped (fast scan

[jira] [Commented] (HDFS-15717) Improve fsck logging

2021-01-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266105#comment-17266105 ] Jim Brennan commented on HDFS-15717: Thanks for back-porting [~aajisaka]!   > Improve fsck logging

[jira] [Commented] (HDFS-15679) DFSOutputStream close should be a no-op when called multiple times

2020-12-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251824#comment-17251824 ] Jim Brennan commented on HDFS-15679: [~eddyxu], [~andrew.wang], we would appreciate your review.  We

[jira] [Commented] (HDFS-15679) DFSOutputStream close should be a no-op when called multiple times

2020-12-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251346#comment-17251346 ] Jim Brennan commented on HDFS-15679: [~ahussein], I believe this change was originally done on our

[jira] [Resolved] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

2020-12-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15704. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15679) DFSOutputStream close should be a no-op when called multiple times

2020-12-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251214#comment-17251214 ] Jim Brennan commented on HDFS-15679: [~ahussein], I think you should close HDFS-15678, since you are

[jira] [Commented] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

2020-12-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249739#comment-17249739 ] Jim Brennan commented on HDFS-15704: Copying my comment about the TreeMap to HashMap change here:

[jira] [Commented] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

2020-12-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249737#comment-17249737 ] Jim Brennan commented on HDFS-15704: Thanks for the updated PR [~ahussein]. I am +1 on this patch.

[jira] [Resolved] (HDFS-15718) Optimize hdfs token op writeLock

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15718. Resolution: Later Closing this.  This change is part of a larger feature that we are not ready to

[jira] [Commented] (HDFS-15718) Optimize hdfs token op writeLock

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248188#comment-17248188 ] Jim Brennan commented on HDFS-15718: [~ahussein] this change is a portion of a march larger feature

[jira] [Resolved] (HDFS-15717) Improve fsck logging

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15717. Fix Version/s: 3.4.0 3.3.1 3.2.2 Resolution: Fixed

[jira] [Resolved] (HDFS-15711) Add Metrics to HttpFS Server

2020-12-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15711. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15717) Improve fsck logging

2020-12-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247384#comment-17247384 ] Jim Brennan commented on HDFS-15717: It should be noted that this also adds a superuser check for the

[jira] [Resolved] (HDFS-15716) TestUpgradeDomainBlockPlacementPolicy flaky

2020-12-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15716. Fix Version/s: 3.2.3 2.10.2 3.1.5 3.4.0

[jira] [Commented] (HDFS-15716) TestUpgradeDomainBlockPlacementPolicy flaky

2020-12-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245956#comment-17245956 ] Jim Brennan commented on HDFS-15716: Thanks [~ahussein] for the contribution.  I am +1 on this,

[jira] [Resolved] (HDFS-15707) NNTop counts don't add up as expected

2020-12-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15707. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15707) NNTop counts don't add up as expected

2020-12-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245497#comment-17245497 ] Jim Brennan commented on HDFS-15707: Thanks for putting this up [~ahussein].  I believe you and

[jira] [Resolved] (HDFS-15703) Don't generate edits for set operations that are no-op

2020-12-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15703. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Resolved] (HDFS-15695) NN should not let the balancer run in safemode

2020-12-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15695. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15703) Don't generate edits for set operations that are no-op

2020-12-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242738#comment-17242738 ] Jim Brennan commented on HDFS-15703: Thanks for putting this up [~ahussein]!  We have been running

[jira] [Commented] (HDFS-15695) NN should not let the balancer run in safemode

2020-12-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241920#comment-17241920 ] Jim Brennan commented on HDFS-15695: +1 this looks good to me.  This is another change that we have

[jira] [Resolved] (HDFS-15694) Avoid calling UpdateHeartBeatState inside DataNodeDescriptor

2020-12-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15694. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15694) Avoid calling UpdateHeartBeatState inside DataNodeDescriptor

2020-12-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241895#comment-17241895 ] Jim Brennan commented on HDFS-15694: Thanks [~kshukla] and [~ahussein]!  I have committed this to

[jira] [Commented] (HDFS-15694) Avoid calling UpdateHeartBeatState inside DataNodeDescriptor

2020-12-01 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241869#comment-17241869 ] Jim Brennan commented on HDFS-15694: +1 this looks good to me.  We have been running with this change

[jira] [Commented] (HDFS-14277) [SBN read] Observer benchmark results

2020-09-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192445#comment-17192445 ] Jim Brennan commented on HDFS-14277: [~jhung], you removed the release-blocker label for 2.10.0, but

[jira] [Commented] (HDFS-12548) HDFS Jenkins build is unstable on branch-2

2020-09-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190411#comment-17190411 ] Jim Brennan commented on HDFS-12548: I propose we close this issue or at least reduce the priority.

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158203#comment-17158203 ] Jim Brennan commented on HDFS-14498: I verified that the most recent patch for branch-2.10 builds and

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17158184#comment-17158184 ] Jim Brennan commented on HDFS-14498: [~hexiaoqiao] there are multiple patches with the same names. I

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156969#comment-17156969 ] Jim Brennan commented on HDFS-14498: Note that [~hexiaoqiao] also reverted the original cherry-pick

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156910#comment-17156910 ] Jim Brennan commented on HDFS-14498: I've also verified that TestLeaseRecovery passes when I run it

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156908#comment-17156908 ] Jim Brennan commented on HDFS-14498: [~hexiaoqiao] I have verified that branch-2.10 compiles with the

[jira] [Commented] (HDFS-14498) LeaseManager can loop forever on the file for which create has failed

2020-07-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156774#comment-17156774 ] Jim Brennan commented on HDFS-14498: [~sodonnell], [~hexiaoqiao], branch-2.10 is failing to compile

[jira] [Commented] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17134362#comment-17134362 ] Jim Brennan commented on HDFS-12453: [~arp], [~kihwal] would one of you be willing to pull this fix

[jira] [Commented] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133676#comment-17133676 ] Jim Brennan commented on HDFS-12453: The failed unit test TestJournalNodeRespectsBindHostKeys is

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-12453: --- Release Note: Submitted version of patch for branch-2.10 Status: Patch Available (was:

[jira] [Reopened] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reopened HDFS-12453: Re-opening so I can submit patch for branch-2.10. > TestDataNodeHotSwapVolumes fails in trunk Jenkins

[jira] [Commented] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-06 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127125#comment-17127125 ] Jim Brennan commented on HDFS-12453: [~eddyxu], [~arp], [~kihwal] we have seen this failure in our

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2020-06-06 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-12453: --- Attachment: HDFS-12453-branch-2.10.001.patch > TestDataNodeHotSwapVolumes fails in trunk Jenkins

[jira] [Commented] (HDFS-14054) TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125344#comment-17125344 ] Jim Brennan commented on HDFS-14054: [~inigoiri] Thanks for the fast response! > TestLeaseRecovery2:

[jira] [Commented] (HDFS-14054) TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125323#comment-17125323 ] Jim Brennan commented on HDFS-14054: [~zvenczel], [~inigoiri] we have seen this failure in our

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124991#comment-17124991 ] Jim Brennan commented on HDFS-14960: Thanks [~ayushtkn]! > TestBalancerWithNodeGroup should not

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124071#comment-17124071 ] Jim Brennan commented on HDFS-14960: Thanks [~ayushtkn]! I've put up patch 006 to fix the

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-14960: --- Attachment: HDFS-14960.006.patch > TestBalancerWithNodeGroup should not succeed with

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-29 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119630#comment-17119630 ] Jim Brennan commented on HDFS-14960: The unit test failures are unrelated to this change, which only

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119061#comment-17119061 ] Jim Brennan commented on HDFS-14960: Thanks for the review [~inigoiri]! I've addressed all of your

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-14960: --- Attachment: HDFS-14960.005.patch > TestBalancerWithNodeGroup should not succeed with

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118995#comment-17118995 ] Jim Brennan commented on HDFS-14960: The failed unit tests are unrelated to this change. >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118837#comment-17118837 ] Jim Brennan commented on HDFS-14960: Now that HDFS-13183 has been fixed, I uploaded patch 004 which

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated HDFS-14960: --- Attachment: HDFS-14960.004.patch > TestBalancerWithNodeGroup should not succeed with

  1   2   >