[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16420: Priority: Critical (was: Major) > ec + balancer may cause missing block >

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472404#comment-17472404 ] Takanobu Asanuma commented on HDFS-16420: - We recently fixed ec + balancer bugs by HDFS-16268 and

[jira] [Resolved] (HDFS-16371) Exclude slow disks when choosing volume

2022-01-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16371. - Fix Version/s: 3.4.0 Resolution: Fixed > Exclude slow disks when choosing volume

[jira] [Resolved] (HDFS-16348) Mark slownode as badnode to recover pipeline

2021-12-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16348. - Fix Version/s: 3.4.0 Resolution: Fixed > Mark slownode as badnode to recover

[jira] [Resolved] (HDFS-16385) Fix Datanode retrieve slownode information bug.

2021-12-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16385. - Resolution: Fixed Merged the PR. Thanks for your contribution, [~JacksonWang]. I added

[jira] [Assigned] (HDFS-16385) Fix Datanode retrieve slownode information bug.

2021-12-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-16385: --- Assignee: Jackson Wang > Fix Datanode retrieve slownode information bug. >

[jira] [Resolved] (HDFS-16377) Should CheckNotNull before access FsDatasetSpi

2021-12-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16377. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16375) The FBR lease ID should be exposed to the log

2021-12-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16375. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > The FBR lease

[jira] [Resolved] (HDFS-16373) Fix MiniDFSCluster restart in case of multiple namenodes

2021-12-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16373. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16327) Make dfs.namenode.max.slowpeer.collect.nodes reconfigurable

2021-12-13 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16327. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Make

[jira] [Commented] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456519#comment-17456519 ] Takanobu Asanuma commented on HDFS-16333: - Merged into branch-3.3 and branch-3.2 again. > fix

[jira] [Updated] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16333: Fix Version/s: 3.2.4 3.3.3 > fix balancer bug when transfer an EC block

[jira] [Commented] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456208#comment-17456208 ] Takanobu Asanuma commented on HDFS-16333: - I cherry-picked into branch-3.3 and branch-3.2. But

[jira] [Updated] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16333: Fix Version/s: (was: 3.2.4) (was: 3.3.3) > fix balancer bug

[jira] [Resolved] (HDFS-16333) fix balancer bug when transfer an EC block

2021-12-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16333. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Commented] (HDFS-16268) Balancer stuck when moving striped blocks due to NPE

2021-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453812#comment-17453812 ] Takanobu Asanuma commented on HDFS-16268: - I confirmed that the unit test with the bug fix

[jira] [Updated] (HDFS-16268) Balancer stuck when moving striped blocks due to NPE

2021-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16268: Fix Version/s: 3.2.4 3.3.3 > Balancer stuck when moving striped blocks

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453753#comment-17453753 ] Takanobu Asanuma commented on HDFS-16293: - Committed to trunk and branch-3.3 with fixing the

[jira] [Updated] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16293: Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed Status:

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-05 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453744#comment-17453744 ] Takanobu Asanuma commented on HDFS-16293: - +1 on [^HDFS-16293.07.patch]. Will commit it soon. >

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452908#comment-17452908 ] Takanobu Asanuma commented on HDFS-16293: - [~Yuanxin Zhu] Thanks for your explanation and for

[jira] [Resolved] (HDFS-16331) Make dfs.blockreport.intervalMsec reconfigurable

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16331. - Fix Version/s: 3.4.0 Resolution: Fixed > Make dfs.blockreport.intervalMsec

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452750#comment-17452750 ] Takanobu Asanuma commented on HDFS-16293: - [~Yuanxin Zhu] Thanks for updating the patch. But the

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452288#comment-17452288 ] Takanobu Asanuma commented on HDFS-16293: - [~Yuanxin Zhu] I added you to a contributor role and

[jira] [Assigned] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-16293: --- Assignee: Yuanxin Zhu > Client sleeps and holds 'dataQueue' when DataNodes are

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-12-02 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452285#comment-17452285 ] Takanobu Asanuma commented on HDFS-16293: - [~Yuanxin Zhu] Thanks for adding the unit test. But it

[jira] [Resolved] (HDFS-16344) Improve DirectoryScanner.Stats#toString

2021-11-29 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16344. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Improve

[jira] [Commented] (HDFS-16293) Client sleeps and holds 'dataQueue' when DataNodes are congested

2021-11-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449765#comment-17449765 ] Takanobu Asanuma commented on HDFS-16293: - [~Yuanxin Zhu] Thanks for reporting the issue and

[jira] [Resolved] (HDFS-16339) Show the threshold when mover threads quota is exceeded

2021-11-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16339. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Resolved] (HDFS-16335) Fix HDFSCommands.md

2021-11-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16335. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed > Fix

[jira] [Resolved] (HDFS-16326) Simplify the code for DiskBalancer

2021-11-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16326. - Fix Version/s: 3.4.0 3.2.4 3.3.3 Resolution:

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445710#comment-17445710 ] Takanobu Asanuma commented on HDFS-15963: - [~brahmareddy] Can I cherry-pick it to branch-3.2.3?

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15963: Priority: Critical (was: Major) > Unreleased volume references cause an infinite loop >

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15963: Fix Version/s: 3.2.4 > Unreleased volume references cause an infinite loop >

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445700#comment-17445700 ] Takanobu Asanuma commented on HDFS-15963: - I cherry-picked it to branch-3.2 via

[jira] [Resolved] (HDFS-16310) RBF: Add client port to CallerContext for Router

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16310. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Add client port to CallerContext

[jira] [Resolved] (HDFS-16323) DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16323. - Fix Version/s: 3.4.0 3.3.3 Resolution: Fixed >

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16315: Fix Version/s: 3.2.4 > Add metrics related to Transfer and NativeCopy for DataNode >

[jira] [Updated] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16315: Fix Version/s: 3.3.3 > Add metrics related to Transfer and NativeCopy for DataNode >

[jira] [Commented] (HDFS-15457) TestFsDatasetImpl fails intermittently

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444244#comment-17444244 ] Takanobu Asanuma commented on HDFS-15457: - Cherry-picked to branch-3.3. > TestFsDatasetImpl

[jira] [Updated] (HDFS-15457) TestFsDatasetImpl fails intermittently

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15457: Fix Version/s: 3.3.2 > TestFsDatasetImpl fails intermittently >

[jira] [Resolved] (HDFS-16315) Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16315. - Fix Version/s: 3.4.0 Resolution: Fixed > Add metrics related to Transfer and

[jira] [Resolved] (HDFS-16311) Metric metadataOperationRate calculation error in DataNodeVolumeMetrics

2021-11-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16311. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16312) Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2021-11-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16312. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16298) Improve error msg for BlockMissingException

2021-11-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16298. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16301) Improve BenchmarkThroughput#SIZE naming standardization

2021-11-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16301. - Fix Version/s: 3.4.0 2.10.2 3.3.2

[jira] [Resolved] (HDFS-16299) Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolumeMetrics

2021-11-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16299. - Fix Version/s: 3.4.0 3.3.2 3.2.4 Resolution:

[jira] [Commented] (HDFS-14901) RBF: Add Encryption Zone related ClientProtocol APIs

2021-11-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440176#comment-17440176 ] Takanobu Asanuma commented on HDFS-14901: - Hi [~hemanthboyina], any updates on this issue? >

[jira] [Resolved] (HDFS-16273) RBF: RouterRpcFairnessPolicyController add availableHandleOnPerNs metrics

2021-11-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16273. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: RouterRpcFairnessPolicyController

[jira] [Resolved] (HDFS-16294) Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED

2021-11-04 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16294. - Fix Version/s: 3.2.4 3.3.2 2.10.2

[jira] [Resolved] (HDFS-16266) Add remote port information to HDFS audit log

2021-11-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16266. - Fix Version/s: 3.4.0 Resolution: Fixed > Add remote port information to HDFS

[jira] [Resolved] (HDFS-16279) Print detail datanode info when process first storage report

2021-10-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16279. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Resolved] (HDFS-15018) DataNode doesn't shutdown although the number of failed disks reaches dfs.datanode.failed.volumes.tolerated

2021-10-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15018. - Resolution: Duplicate > DataNode doesn't shutdown although the number of failed disks

[jira] [Commented] (HDFS-15018) DataNode doesn't shutdown although the number of failed disks reaches dfs.datanode.failed.volumes.tolerated

2021-10-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425328#comment-17425328 ] Takanobu Asanuma commented on HDFS-15018: - We had the same problem. After investigating it, we

[jira] [Commented] (HDFS-15474) HttpFS: WebHdfsFileSystem cannot renew an expired delegation token from HttpFS response

2021-10-01 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423194#comment-17423194 ] Takanobu Asanuma commented on HDFS-15474: - [~weichiu] Thanks for sharing the JIRA. But it seems

[jira] [Resolved] (HDFS-16203) Discover datanodes with unbalanced block pool usage by the standard deviation

2021-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16203. - Fix Version/s: 3.4.0 Resolution: Fixed > Discover datanodes with unbalanced block

[jira] [Updated] (HDFS-16184) De-flake TestBlockScanner#testSkipRecentAccessFile

2021-08-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16184: Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Status:

[jira] [Resolved] (HDFS-16076) Avoid using slow DataNodes for reading by sorting locations

2021-06-23 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16076. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Avoid using

[jira] [Updated] (HDFS-16075) Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects

2021-06-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16075: Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Status:

[jira] [Updated] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16068: Fix Version/s: 3.3.2 3.2.3 2.10.2 >

[jira] [Updated] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-14 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-16068: Status: Patch Available (was: Open) > WebHdfsFileSystem has a possible connection leak in

[jira] [Created] (HDFS-16068) WebHdfsFileSystem has a possible connection leak in connection with HttpFS

2021-06-14 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HDFS-16068: --- Summary: WebHdfsFileSystem has a possible connection leak in connection with HttpFS Key: HDFS-16068 URL: https://issues.apache.org/jira/browse/HDFS-16068

[jira] [Resolved] (HDFS-16057) Make sure the order for location in ENTERING_MAINTENANCE state

2021-06-11 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16057. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Make sure the

[jira] [Resolved] (HDFS-16054) Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16054. - Fix Version/s: 3.4.0 Resolution: Fixed > Replace Guava Lists usage by Hadoop's

[jira] [Resolved] (HDFS-16048) RBF: Print network topology on the router web

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16048. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > RBF: Print

[jira] [Resolved] (HDFS-16050) Some dynamometer tests fail

2021-06-07 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16050. - Fix Version/s: 3.3.2 3.4.0 Target Version/s: 3.4.0, 3.3.2

[jira] [Resolved] (HDFS-16041) TestErasureCodingCLI fails

2021-05-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16041. - Fix Version/s: 3.4.0 Resolution: Fixed > TestErasureCodingCLI fails >

[jira] [Commented] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346532#comment-17346532 ] Takanobu Asanuma commented on HDFS-15975: - [~weichiu] Thank you. I added a release note. > Use

[jira] [Updated] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15975: Release Note: This JIRA changes public fields in DFSHedgedReadMetrics. If you are using

[jira] [Commented] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-05-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346135#comment-17346135 ] Takanobu Asanuma commented on HDFS-15975: - Thanks for pointing it, [~weichiu]. Should we revert

[jira] [Updated] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-05-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15945: Resolution: Not A Problem Status: Resolved (was: Patch Available) > DataNodes

[jira] [Commented] (HDFS-15945) DataNodes with zero capacity and zero blocks should be decommissioned immediately

2021-05-16 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345812#comment-17345812 ] Takanobu Asanuma commented on HDFS-15945: - We found the root cause of this problem. There is a

[jira] [Commented] (HDFS-15969) DFSClient prints token information a string format

2021-05-06 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340142#comment-17340142 ] Takanobu Asanuma commented on HDFS-15969: - The following is an example of the token information.

[jira] [Commented] (HDFS-15969) DFSClient prints token information a string format

2021-05-03 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17338761#comment-17338761 ] Takanobu Asanuma commented on HDFS-15969: - Bhavik Patel Thanks for working on this, and sorry for

[jira] [Updated] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15991: Fix Version/s: 3.3.1 > Add location into datanode info for NameNodeMXBean >

[jira] [Commented] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334625#comment-17334625 ] Takanobu Asanuma commented on HDFS-15991: - Cherry-picked to branch-3.3. > Add location into

[jira] [Updated] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15358: Fix Version/s: 3.3.1 > RBF: Unify router datanode UI with namenode datanode UI >

[jira] [Updated] (HDFS-15698) Fix the typo of dfshealth.html after HDFS-15358

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15698: Fix Version/s: 3.3.1 > Fix the typo of dfshealth.html after HDFS-15358 >

[jira] [Commented] (HDFS-15698) Fix the typo of dfshealth.html after HDFS-15358

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334623#comment-17334623 ] Takanobu Asanuma commented on HDFS-15698: - Cherry-picked to branch-3.3. > Fix the typo of

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334622#comment-17334622 ] Takanobu Asanuma commented on HDFS-15358: - Cherry-picked to branch-3.3. > RBF: Unify router

[jira] [Commented] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334621#comment-17334621 ] Takanobu Asanuma commented on HDFS-15247: - Cherry-picked to branch-3.3. > RBF: Provide Non DFS

[jira] [Updated] (HDFS-15247) RBF: Provide Non DFS Used per DataNode in DataNode UI

2021-04-28 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15247: Fix Version/s: 3.3.1 > RBF: Provide Non DFS Used per DataNode in DataNode UI >

[jira] [Updated] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2021-04-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15378: Fix Version/s: 3.2.3 3.1.5 3.3.1 >

[jira] [Commented] (HDFS-15378) TestReconstructStripedFile#testErasureCodingWorkerXmitsWeight is failing on trunk

2021-04-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17333289#comment-17333289 ] Takanobu Asanuma commented on HDFS-15378: - It also failed in the lower branches. Cherry-picked to

[jira] [Updated] (HDFS-15975) Use LongAdder instead of AtomicLong

2021-04-27 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15975: Fix Version/s: 3.3.1 > Use LongAdder instead of AtomicLong >

[jira] [Resolved] (HDFS-15991) Add location into datanode info for NameNodeMXBean

2021-04-26 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15991. - Fix Version/s: 3.4.0 Resolution: Fixed > Add location into datanode info for

[jira] [Updated] (HDFS-15967) Improve the log for Short Circuit Local Reads

2021-04-25 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15967: Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed Status:

[jira] [Updated] (HDFS-15989) Split TestBalancer into two classes

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15989: Fix Version/s: 3.2.3 3.1.5 3.3.1 > Split

[jira] [Updated] (HDFS-15974) RBF: Unable to display the datanode UI of the router

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15974: Fix Version/s: 3.3.1 > RBF: Unable to display the datanode UI of the router >

[jira] [Commented] (HDFS-15358) RBF: Unify router datanode UI with namenode datanode UI

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329918#comment-17329918 ] Takanobu Asanuma commented on HDFS-15358: - I'd like to backport this to branch-3.3 if there's no

[jira] [Assigned] (HDFS-15974) RBF: Unable to display the datanode UI of the router

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HDFS-15974: --- Assignee: zhu > RBF: Unable to display the datanode UI of the router >

[jira] [Resolved] (HDFS-15974) RBF: Unable to display the datanode UI of the router

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15974. - Fix Version/s: 3.4.0 Resolution: Fixed > RBF: Unable to display the datanode UI

[jira] [Commented] (HDFS-15967) Improve the log for Short Circuit Local Reads

2021-04-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329200#comment-17329200 ] Takanobu Asanuma commented on HDFS-15967: - [~bpatel] Thanks for updating the patch. +1 on

[jira] [Commented] (HDFS-15967) Improve the log for Short Circuit Local Reads

2021-04-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326715#comment-17326715 ] Takanobu Asanuma commented on HDFS-15967: - [~bpatel] Thanks for submitting the patch. Some

[jira] [Resolved] (HDFS-15989) Split TestBalancer into two classes

2021-04-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15989. - Resolution: Fixed > Split TestBalancer into two classes >

[jira] [Updated] (HDFS-15989) Split TestBalancer into two classes

2021-04-21 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15989: Fix Version/s: 3.4.0 > Split TestBalancer into two classes >

[jira] [Commented] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-04-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326194#comment-17326194 ] Takanobu Asanuma commented on HDFS-15879: - Merged to branch-3.3. Thanks for your PR, [~tomscut].

[jira] [Updated] (HDFS-15879) Exclude slow nodes when choose targets for blocks

2021-04-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15879: Fix Version/s: 3.3.1 > Exclude slow nodes when choose targets for blocks >

[jira] [Updated] (HDFS-15970) Print network topology on the web

2021-04-19 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15970: Fix Version/s: 3.3.1 > Print network topology on the web >

[jira] [Resolved] (HDFS-15970) Print network topology on the web

2021-04-19 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-15970. - Fix Version/s: 3.4.0 Resolution: Fixed > Print network topology on the web >

<    1   2   3   4   5   6   7   8   9   10   >