[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-06-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17132544#comment-17132544 ] Xiaoqiao He commented on HDFS-12733: Thanks [~ayushtkn] for your reviews. {quote}This

[jira] [Commented] (HDFS-12969) DfsAdmin listOpenFiles should report files by type

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130934#comment-17130934 ] hemanthboyina commented on HDFS-12969: -- any suggestions for this   [~liuml07]  [~elg

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130927#comment-17130927 ] hemanthboyina commented on HDFS-15351: -- yes  [~elgoiri]  , i think we can go ahead

[jira] [Commented] (HDFS-15372) Files in snapshots no longer see attribute provider permissions

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130923#comment-17130923 ] hemanthboyina commented on HDFS-15372: -- thanks for the patch [~sodonnell] , the chan

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-10 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130903#comment-17130903 ] Yiqun Lin commented on HDFS-15346: -- [~LiJinglun] , thanks for addressing the comments, a

[jira] [Commented] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130654#comment-17130654 ] ludun commented on HDFS-15406: -- we get the datanode jstack, with 11M block , found that getD

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130534#comment-17130534 ] Stephen O'Donnell commented on HDFS-15160: -- [~Jiang Xin] Have you been able to t

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130521#comment-17130521 ] hemanthboyina commented on HDFS-15160: -- though the scanner takes more time to scan a

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  the Datanode to

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  When Datanode sc

[jira] [Updated] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15406: - Description: In our customer cluster we have approx 10M blocks in one datanode  When Datanode sc

[jira] [Created] (HDFS-15406) Improve the speed of Datanode Block Scan

2020-06-10 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15406: Summary: Improve the speed of Datanode Block Scan Key: HDFS-15406 URL: https://issues.apache.org/jira/browse/HDFS-15406 Project: Hadoop HDFS Issue Type: Impr

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130497#comment-17130497 ] hemanthboyina edited comment on HDFS-15160 at 6/10/20, 10:48 AM: --

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130497#comment-17130497 ] hemanthboyina commented on HDFS-15160: -- thanks [~pilchard] for the report ,  HDFS-15

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130342#comment-17130342 ] ludun edited comment on HDFS-15160 at 6/10/20, 10:03 AM: - [~brahm

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130351#comment-17130351 ] Hadoop QA commented on HDFS-15346: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Comment Edited] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130342#comment-17130342 ] ludun edited comment on HDFS-15160 at 6/10/20, 7:35 AM: [~brahmar

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-06-10 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130342#comment-17130342 ] ludun commented on HDFS-15160: -- [~brahmareddy] pls check this issue also. in our custome en

[jira] [Issue Comment Deleted] (HDFS-15398) EC: hdfs client hangs due to exception during addBlock

2020-06-10 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongbing Wang updated HDFS-15398: - Comment: was deleted (was: These failures seem to be related to [HDFS-15396|https://issues.apach

[jira] [Commented] (HDFS-15398) EC: hdfs client hangs due to exception during addBlock

2020-06-10 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130301#comment-17130301 ] Hongbing Wang commented on HDFS-15398: -- These failures seem to be related to [HDFS-