[jira] [Updated] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Wu updated HDFS-15660: --- Affects Version/s: 3.0.0 3.0.1 > StorageTypeProto is not compatiable between 3.x and

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243799#comment-17243799 ] Ayush Saxena commented on HDFS-15442: - Thanx [~AMC-team] for the patch. The build results weren't

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243796#comment-17243796 ] Ayush Saxena commented on HDFS-15516: - [~jianghuazhu] can you update the patch as suggested above,

[jira] [Commented] (HDFS-14431) RBF: Rename with multiple subclusters should fail if no eligible locations

[ https://issues.apache.org/jira/browse/HDFS-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243793#comment-17243793 ] Ayush Saxena commented on HDFS-14431: - Thanx [~LiJinglun] for the response, Sorry, I missed the

[jira] [Commented] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243790#comment-17243790 ] Ayush Saxena commented on HDFS-15631: - Thanx [~shenyinjie] for the patch. Seems the introduced tests

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243788#comment-17243788 ] Ayush Saxena commented on HDFS-14090: - Looks this is concluded, [~elgoiri] do you want to hold it

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243784#comment-17243784 ] Ayush Saxena commented on HDFS-15655: - Thanx [~hadoop_yangyun] for the patch. Looks good overall.

[jira] [Work logged] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?focusedWorklogId=520034=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520034 ] ASF GitHub Bot logged work on HDFS-15708: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243767#comment-17243767 ] angerszhu commented on HDFS-14437: -- [~Sushma_28] I have updated this patch in our product env for 20

[jira] [Comment Edited] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243763#comment-17243763 ] Ravuri Sushma sree edited comment on HDFS-14437 at 12/4/20, 6:54 AM: -

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243763#comment-17243763 ] Ravuri Sushma sree commented on HDFS-14437: --- I used the HDFS-14437.reproduction.patch provided

[jira] [Comment Edited] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243755#comment-17243755 ] Yushi Hayasaka edited comment on HDFS-15709 at 12/4/20, 6:53 AM: - How to

[jira] [Work logged] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?focusedWorklogId=520023=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520023 ] ASF GitHub Bot logged work on HDFS-15709: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15709: -- Labels: pull-request-available (was: ) > Socket file descriptor leak in

[jira] [Commented] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243762#comment-17243762 ] Yushi Hayasaka commented on HDFS-15709: --- PR: [https://github.com/apache/hadoop/pull/2518] > Socket

[jira] [Comment Edited] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243755#comment-17243755 ] Yushi Hayasaka edited comment on HDFS-15709 at 12/4/20, 6:42 AM: - How to

[jira] [Commented] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243755#comment-17243755 ] Yushi Hayasaka commented on HDFS-15709: --- How to reproduce (tested on Hadoop 3.3.0): 1. Create a

[jira] [Created] (HDFS-15709) Socket file descriptor leak in StripedBlockChecksumReconstructor

Yushi Hayasaka created HDFS-15709: - Summary: Socket file descriptor leak in StripedBlockChecksumReconstructor Key: HDFS-15709 URL: https://issues.apache.org/jira/browse/HDFS-15709 Project: Hadoop

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243752#comment-17243752 ] Ayush Saxena commented on HDFS-15645: - bq. The DatanodeManager#getNumOfDataNodes() is used when

[jira] [Work logged] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?focusedWorklogId=520010=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520010 ] ASF GitHub Bot logged work on HDFS-15708: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?focusedWorklogId=520009=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520009 ] ASF GitHub Bot logged work on HDFS-15708: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?focusedWorklogId=520007=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-520007 ] ASF GitHub Bot logged work on HDFS-15708: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15708: -- Labels: pull-request-available (was: ) > TestURLConnectionFactory fails by

[jira] [Assigned] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned HDFS-15708: --- Assignee: Chao Sun > TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and >

[jira] [Commented] (HDFS-12852) pig script failed with 'java.nio.channels.ClosedByInterruptException'

[ https://issues.apache.org/jira/browse/HDFS-12852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243736#comment-17243736 ] Mithun Antony commented on HDFS-12852: -- Is there any update on this issue or is there any related

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243715#comment-17243715 ] Yiqun Lin commented on HDFS-15660: -- Thanks for providing the test result for this change,

[jira] [Work logged] (HDFS-15707) NNTop counts don't add up as expected

[ https://issues.apache.org/jira/browse/HDFS-15707?focusedWorklogId=519994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519994 ] ASF GitHub Bot logged work on HDFS-15707: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

Akira Ajisaka created HDFS-15708: Summary: TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2 Key: HDFS-15708 URL: https://issues.apache.org/jira/browse/HDFS-15708

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15240: Target Version/s: 3.3.1, 3.4.0, 3.1.5, 3.2.3 (was: 3.3.1, 3.4.0) > Erasure Coding: dirty

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243662#comment-17243662 ] Takanobu Asanuma commented on HDFS-15240: - Thanks for committing it, [~ferhui]! [~marvelrock] We

[jira] [Updated] (HDFS-13404) RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fails

[ https://issues.apache.org/jira/browse/HDFS-13404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-13404: - Fix Version/s: 3.1.5 3.2.2 Backported to branch-3.2, branch-3.2.2, and

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243631#comment-17243631 ] Hui Fei commented on HDFS-15240: Cherry-pick fails because of conflicts. [~marvelrock] Could you please

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243630#comment-17243630 ] Hui Fei commented on HDFS-15240: Push to trunk. Thanks again [~marvelrock] for report and fix,

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15240: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Erasure

[jira] [Commented] (HDFS-15450) Fix NN trash emptier to work if ViewFSOveroadScheme enabled

[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243615#comment-17243615 ] Akira Ajisaka commented on HDFS-15450: -- This commit has been backported to branch-3.3, branch-3.2,

[jira] [Updated] (HDFS-15450) Fix NN trash emptier to work if ViewFSOveroadScheme enabled

[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15450: - Fix Version/s: 3.1.5 3.3.1 3.2.2 > Fix NN trash emptier to

[jira] [Updated] (HDFS-15707) NNTop counts don't add up as expected

[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15707: -- Labels: pull-request-available (was: ) > NNTop counts don't add up as expected >

[jira] [Work logged] (HDFS-15707) NNTop counts don't add up as expected

[ https://issues.apache.org/jira/browse/HDFS-15707?focusedWorklogId=519927=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519927 ] ASF GitHub Bot logged work on HDFS-15707: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15660) StorageTypeProto is not compatiable between 3.x and 2.6

[ https://issues.apache.org/jira/browse/HDFS-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243586#comment-17243586 ] Mingliang Liu commented on HDFS-15660: -- It makes sense to me. I do not have time to validate it this

[jira] [Resolved] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-15706. Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519916=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519916 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519911=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519911 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519886=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519886 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519854=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519854 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15704?focusedWorklogId=519852=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519852 ] ASF GitHub Bot logged work on HDFS-15704: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15707) NNTop counts don't add up as expected

Ahmed Hussein created HDFS-15707: Summary: NNTop counts don't add up as expected Key: HDFS-15707 URL: https://issues.apache.org/jira/browse/HDFS-15707 Project: Hadoop HDFS Issue Type: Bug

[jira] [Work started] (HDFS-15707) NNTop counts don't add up as expected

[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15707 started by Ahmed Hussein. > NNTop counts don't add up as expected > -

[jira] [Updated] (HDFS-15689) allow/disallowSnapshot on EZ roots shouldn't fail due to trash provisioning/emptiness check

[ https://issues.apache.org/jira/browse/HDFS-15689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15689: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519831=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519831 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243451#comment-17243451 ] Ahmed Hussein commented on HDFS-15706: -- Thanks [~kihwal] for providing the code for this jira. >

[jira] [Updated] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15706: -- Labels: pull-request-available (was: ) > HttpFS: Log more information on request failures >

[jira] [Work logged] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?focusedWorklogId=519818=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-519818 ] ASF GitHub Bot logged work on HDFS-15706: - Author: ASF GitHub Bot

[jira] [Work started] (HDFS-15706) HttpFS: Log more information on request failures

[ https://issues.apache.org/jira/browse/HDFS-15706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15706 started by Ahmed Hussein. > HttpFS: Log more information on request failures >

[jira] [Created] (HDFS-15706) HttpFS: Log more information on request failures

Ahmed Hussein created HDFS-15706: Summary: HttpFS: Log more information on request failures Key: HDFS-15706 URL: https://issues.apache.org/jira/browse/HDFS-15706 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15703) Don't generate edits for set operations that are no-op

[ https://issues.apache.org/jira/browse/HDFS-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243361#comment-17243361 ] Ahmed Hussein commented on HDFS-15703: -- Thanks [~Jim_Brennan] > Don't generate edits for set

[jira] [Resolved] (HDFS-15703) Don't generate edits for set operations that are no-op

[ https://issues.apache.org/jira/browse/HDFS-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved HDFS-15703. Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15704) Mitigate lease monitor's rapid infinite loop

[ https://issues.apache.org/jira/browse/HDFS-15704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243232#comment-17243232 ] Wei-Chiu Chuang commented on HDFS-15704: Does HDFS-14498 look familiar to you? CC [~sodonnell] >

[jira] [Commented] (HDFS-13831) Make block increment deletion number configurable

[ https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243126#comment-17243126 ] GeoffreyStark commented on HDFS-13831: -- I will get your feedback after benchmarking the modification

[jira] [Commented] (HDFS-13831) Make block increment deletion number configurable

[ https://issues.apache.org/jira/browse/HDFS-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243125#comment-17243125 ] GeoffreyStark commented on HDFS-13831: -- [~jianliang.wu] Excuse me again:D Would reducing this