[jira] [Commented] (HDFS-15292) Infinite loop in Lease Manager due to replica is missing in dn

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129676#comment-17129676 ] Ayush Saxena commented on HDFS-15292: - It is already mention in the code that such a situation can

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129657#comment-17129657 ] Ayush Saxena commented on HDFS-12733: - Thanx [~hexiaoqiao] can you check this : {code:java} else if

[jira] [Updated] (HDFS-15398) EC: hdfs client hangs when writing EC file occurs an addBlock exception

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15398: Summary: EC: hdfs client hangs when writing EC file occurs an addBlock exception (was: hdfs

[jira] [Commented] (HDFS-15398) hdfs client hangs when writing EC file occurs an addBlock exception

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129638#comment-17129638 ] Ayush Saxena commented on HDFS-15398: -

[jira] [Commented] (HDFS-15398) hdfs client hangs when writing EC file occurs an addBlock exception

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129273#comment-17129273 ] Ayush Saxena commented on HDFS-15398: - I have pushed the missed code from HDFS-15211, you can try to

[jira] [Commented] (HDFS-15398) hdfs client hangs when writing EC file occurs an addBlock exception

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129255#comment-17129255 ] Ayush Saxena commented on HDFS-15398: - The code LGTM Regarding the location of the test

[jira] [Updated] (HDFS-15398) hdfs client hangs when writing EC file occurs an addBlock exception

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15398: Status: Patch Available (was: Open) > hdfs client hangs when writing EC file occurs an addBlock

[jira] [Commented] (HDFS-15398) hdfs client may hang forever when writing EC file

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128931#comment-17128931 ] Ayush Saxena commented on HDFS-15398: - Technically all threads should be closed as part of close only

[jira] [Comment Edited] (HDFS-15398) hdfs client may hang forever when writing EC file

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128897#comment-17128897 ] Ayush Saxena edited comment on HDFS-15398 at 6/9/20, 6:11 AM: -- Check seems

[jira] [Commented] (HDFS-15398) hdfs client may hang forever when writing EC file

2020-06-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128897#comment-17128897 ] Ayush Saxena commented on HDFS-15398: - Check seems some thing like this reproduces for me :

[jira] [Commented] (HDFS-15398) hdfs client may hang forever when writing EC file

2020-06-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128890#comment-17128890 ] Ayush Saxena commented on HDFS-15398: - Thanx [~haiyang Hu] for the report, I too got something

[jira] [Commented] (HDFS-15396) Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir

2020-06-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127782#comment-17127782 ] Ayush Saxena commented on HDFS-15396: - Thanx [~umamaheswararao] for the review. I am ok with

[jira] [Commented] (HDFS-15396) Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir

2020-06-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127521#comment-17127521 ] Ayush Saxena commented on HDFS-15396: - Thanx [~umamaheswararao] have updated to resolve to "/" in

[jira] [Commented] (HDFS-15396) Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir

2020-06-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127347#comment-17127347 ] Ayush Saxena commented on HDFS-15396: - Raised PR : https://github.com/apache/hadoop/pull/2059 As of

[jira] [Updated] (HDFS-15396) Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir

2020-06-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15396: Status: Patch Available (was: Open) > Fix >

[jira] [Created] (HDFS-15396) Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir

2020-06-06 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15396: --- Summary: Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir Key: HDFS-15396 URL: https://issues.apache.org/jira/browse/HDFS-15396

[jira] [Commented] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127005#comment-17127005 ] Ayush Saxena commented on HDFS-15389: - Have fixed the checkstyle in PR

[jira] [Updated] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15389: Description: Two Issues Here : Firstly Prior to HDFS-15321, When DFSAdmin was closed the

[jira] [Commented] (HDFS-15390) client fails forever when namenode ipaddr changed

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126883#comment-17126883 ] Ayush Saxena commented on HDFS-15390: - Can you extend a UT for the issue? > client fails forever

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126777#comment-17126777 ] Ayush Saxena commented on HDFS-15359: - Committed to trunk. Thanx [~vinayakumarb] and [~weichiu] for

[jira] [Comment Edited] (HDFS-15391) Due to edit log corruption, Standby NameNode could not properly load the Ediltog log, result in abnormal exit of the service and failure to restart

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126730#comment-17126730 ] Ayush Saxena edited comment on HDFS-15391 at 6/5/20, 12:31 PM: --- Thanx,

[jira] [Commented] (HDFS-15391) Due to edit log corruption, Standby NameNode could not properly load the Ediltog log, result in abnormal exit of the service and failure to restart

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126730#comment-17126730 ] Ayush Saxena commented on HDFS-15391: - Thanx, These are two different traces, correct? You tried

[jira] [Commented] (HDFS-15391) Due to edit log corruption, Standby NameNode could not properly load the Ediltog log, result in abnormal exit of the service and failure to restart

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126723#comment-17126723 ] Ayush Saxena commented on HDFS-15391: - Do you have backported HDFS-7663 in that? If yes, HDFS-14581

[jira] [Commented] (HDFS-13179) TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126718#comment-17126718 ] Ayush Saxena commented on HDFS-13179: - branch-3.0 is EOL?

[jira] [Commented] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126436#comment-17126436 ] Ayush Saxena commented on HDFS-15389: - [~umamaheswararao] / [~rakeshr] / [~vinayakumarb] can you

[jira] [Commented] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126430#comment-17126430 ] Ayush Saxena commented on HDFS-15321: - There was one more problem here. {{DFSAdmin

[jira] [Updated] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15389: Attachment: HDFS-15389-01.patch > DFSAdmin should close filesystem and dfsadmin

[jira] [Updated] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15389: Status: Patch Available (was: Open) > DFSAdmin should close filesystem and dfsadmin

[jira] [Created] (HDFS-15389) DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme

2020-06-05 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15389: --- Summary: DFSAdmin should close filesystem and dfsadmin -setBalancerBandwidth should work with ViewFSOverloadScheme Key: HDFS-15389 URL:

[jira] [Comment Edited] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126178#comment-17126178 ] Ayush Saxena edited comment on HDFS-15321 at 6/4/20, 8:59 PM: -- A

[jira] [Commented] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126178#comment-17126178 ] Ayush Saxena commented on HDFS-15321: - A {{FileSystem.closeAll();}} in the {{tearDown()}} of the

[jira] [Commented] (HDFS-15198) RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

2020-06-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126095#comment-17126095 ] Ayush Saxena commented on HDFS-15198: - Thanx [~zhengchenyu] for the patch. Why you need to change

[jira] [Commented] (HDFS-15376) Update the error about command line POST in httpfs documentation

2020-06-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126094#comment-17126094 ] Ayush Saxena commented on HDFS-15376: - +1 > Update the error about command line POST in httpfs

[jira] [Commented] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125609#comment-17125609 ] Ayush Saxena commented on HDFS-15321: - Hi [~umamaheswararao] seems this change broke

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125293#comment-17125293 ] Ayush Saxena commented on HDFS-15359: - Thanx [~vinayakumarb] for the review. [~weichiu] will be

[jira] [Commented] (HDFS-14546) Document block placement policies

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124949#comment-17124949 ] Ayush Saxena commented on HDFS-14546: - Have updated the patch for you [~Amithsha] *Added

[jira] [Updated] (HDFS-14546) Document block placement policies

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14546: Attachment: HDFS-14546-09.patch > Document block placement policies >

[jira] [Commented] (HDFS-15384) Method getLocatedBlocks(String src, long start) of DFSClient only return partial blocks

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124898#comment-17124898 ] Ayush Saxena commented on HDFS-15384: - {{dfs.client.read.prefetch.size}} is a well documented

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-11041: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124688#comment-17124688 ] Ayush Saxena commented on HDFS-11041: - Committed to trunk. Thanx [~weichiu] for the contribution!!!

[jira] [Updated] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14960: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124678#comment-17124678 ] Ayush Saxena commented on HDFS-14960: - Committed to trunk. Thanx [~Jim_Brennan] for the contribution

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-06-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124145#comment-17124145 ] Ayush Saxena commented on HDFS-14960: - +1, if jenkins is happy too. :-) >

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120816#comment-17120816 ] Ayush Saxena commented on HDFS-15359: - Test Failures not related. the Xmits ones failed in other

[jira] [Commented] (HDFS-15381) Fix typos corrputBlocksFiles to corruptBlocksFiles

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120583#comment-17120583 ] Ayush Saxena commented on HDFS-15381: - +1 > Fix typos corrputBlocksFiles to corruptBlocksFiles >

[jira] [Updated] (HDFS-11041) Unable to unregister FsDatasetState MBean if DataNode is shutdown twice

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-11041: Summary: Unable to unregister FsDatasetState MBean if DataNode is shutdown twice (was: Unable to

[jira] [Commented] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120516#comment-17120516 ] Ayush Saxena commented on HDFS-10792: - Committed to trunk. Thanx [~weichiu] for the contribution!!!

[jira] [Updated] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-10792: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Resolved] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-15365. - Resolution: Not A Problem > [RBF] findMatching method return wrong result >

[jira] [Commented] (HDFS-10792) RedundantEditLogInputStream should log caught exceptions

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120513#comment-17120513 ] Ayush Saxena commented on HDFS-10792: - +1 > RedundantEditLogInputStream should log caught exceptions

[jira] [Commented] (HDFS-11041) Unable to unregister FsDatasetState MBean if if DataNode is shutdown twice

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-11041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120511#comment-17120511 ] Ayush Saxena commented on HDFS-11041: - I saw the same trace in my UT of HDFS-15359. The fix seems

[jira] [Updated] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15359: Attachment: HDFS-15359-05.patch > EC: Allow closing a file with committed blocks >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120154#comment-17120154 ] Ayush Saxena commented on HDFS-14960: - Thanx [~Jim_Brennan] for the patch. Minor nit : {code:java}

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15368: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118824#comment-17118824 ] Ayush Saxena commented on HDFS-15368: - Committed to trunk. Thanx [~hexiaoqiao] for the

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118594#comment-17118594 ] Ayush Saxena commented on HDFS-15368: - v002 LGTM +1 [~hexiaoqiao] can you confirm about the failed

[jira] [Commented] (HDFS-13274) RBF: Extend RouterRpcClient to use multiple sockets

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118420#comment-17118420 ] Ayush Saxena commented on HDFS-13274: - GetServerDefaults doesn't goes to all Namespaces as of now, it

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118411#comment-17118411 ] Ayush Saxena commented on HDFS-15368: - Thanx [~hexiaoqiao] for confirmation, Have pushed the addendum

[jira] [Updated] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-13183: Resolution: Fixed Status: Resolved (was: Patch Available) > Standby NameNode process

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118409#comment-17118409 ] Ayush Saxena commented on HDFS-13183: - Committed addendum to trunk and branch-3.3 Thanx [~hexiaoqiao]

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116627#comment-17116627 ] Ayush Saxena commented on HDFS-15373: - Committed to trunk. Thanx [~elgoiri] for the review!!! Have

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Description: The number of threads in IPCLoggerChannel#createParallelExecutor is elastic right

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-26 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Description: The number of threads in IPCLoggerChannel#createParallelExecutor is elastic right

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116168#comment-17116168 ] Ayush Saxena commented on HDFS-15373: - The {{numThreads}} was not getting used only, the queue limit

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Attachment: HDFS-15373-02.patch > Fix number of threads in IPCLoggerChannel#createParallelExecutor

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15355: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-25 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115785#comment-17115785 ] Ayush Saxena commented on HDFS-15368: - Tried this with Addendum patch of HDFS-13183, It works well.

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115424#comment-17115424 ] Ayush Saxena commented on HDFS-15368: - The error trace changed now, the append operation is failing

[jira] [Commented] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115375#comment-17115375 ] Ayush Saxena commented on HDFS-15373: - Test failures seems not related > Fix number of threads in

[jira] [Commented] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115348#comment-17115348 ] Ayush Saxena commented on HDFS-15188: - * Give a check to this. {code:java} - * DFSClient can connect

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115311#comment-17115311 ] Ayush Saxena commented on HDFS-15368: - [~hexiaoqiao] I had a quick check and suspect it may be

[jira] [Commented] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115305#comment-17115305 ] Ayush Saxena commented on HDFS-15368: - Was able to repro this on trunk, added the logs wrt trunk code

[jira] [Updated] (HDFS-15368) TestBalancerWithHANameNodes#testBalancerWithObserver failed occasionally

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15368: Attachment: TestBalancerWithHANameNodes.testBalancerObserver.log >

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115300#comment-17115300 ] Ayush Saxena commented on HDFS-15288: - The BPP can have local node optimization too, I added that in

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-Addendum-01.patch > Add Available Space Rack Fault Tolerant BPP >

[jira] [Updated] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15369: Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115288#comment-17115288 ] Ayush Saxena commented on HDFS-15369: - Committed to trunk and branch-3.3 Thanx [~hadoop_yangyun] for

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115283#comment-17115283 ] Ayush Saxena commented on HDFS-15355: - Committed to trunk. Thanx [~hadoop_yangyun] for the

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115282#comment-17115282 ] Ayush Saxena commented on HDFS-15355: - v013 LGTM +1 > Make the default block storage policy ID

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Status: Patch Available (was: Open) > Fix number of threads in

[jira] [Updated] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15373: Attachment: HDFS-15373-01.patch > Fix number of threads in IPCLoggerChannel#createParallelExecutor

[jira] [Created] (HDFS-15373) Fix number of threads in IPCLoggerChannel#createParallelExecutor

2020-05-24 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15373: --- Summary: Fix number of threads in IPCLoggerChannel#createParallelExecutor Key: HDFS-15373 URL: https://issues.apache.org/jira/browse/HDFS-15373 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115126#comment-17115126 ] Ayush Saxena commented on HDFS-15288: - Will check later today and reopen this to fix. > Add

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115072#comment-17115072 ] Ayush Saxena commented on HDFS-13183: - Thanx [~hexiaoqiao] and [~Jim_Brennan] for the quick fix. +1

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115068#comment-17115068 ] Ayush Saxena commented on HDFS-15355: - Thanx [~hadoop_yangyun] for the patch, Minor nit :

[jira] [Commented] (HDFS-15369) Refactor method VolumeScanner#runLoop()

2020-05-24 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115066#comment-17115066 ] Ayush Saxena commented on HDFS-15369: - Test failures seems not related. v001 LGTM +1 > Refactor

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114749#comment-17114749 ] Ayush Saxena commented on HDFS-15093: - Committed to trunk. Thanx [~elgoiri] for the review and

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114747#comment-17114747 ] Ayush Saxena commented on HDFS-15288: - Committed to trunk. Thanx [~elgoiri] for the review!! Will

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113418#comment-17113418 ] Ayush Saxena commented on HDFS-15288: - yes, Its HDFS-14546, where the BPP were getting documented,

[jira] [Commented] (HDFS-14546) Document block placement policies

2020-05-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113416#comment-17113416 ] Ayush Saxena commented on HDFS-14546: - [~Amithsha] any progress on this, Please include HDFS-15288

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112293#comment-17112293 ] Ayush Saxena commented on HDFS-15093: - Test failures seems not related, Have just tweaked the test in

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112288#comment-17112288 ] Ayush Saxena commented on HDFS-15288: - Test failures seems unrelated. Checkstyle are unavoidable, The

[jira] [Commented] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112036#comment-17112036 ] Ayush Saxena commented on HDFS-15365: - [~rain_lyy] This is in our internal code. I didn't contributed

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111420#comment-17111420 ] Ayush Saxena commented on HDFS-15288: - Have removed the NPE check, Added static imports, more

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-03.patch > Add Available Space Rack Fault Tolerant BPP >

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111363#comment-17111363 ] Ayush Saxena commented on HDFS-15359: - Yes, the test verifies two scenarios : *First Scenario :* In

<    6   7   8   9   10   11   12   13   14   15   >