[jira] [Commented] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

2021-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369506#comment-17369506 ] Xiaoqiao He commented on HDFS-16044: This PR seems broken unit test but not reported

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

2021-06-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

2021-06-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Summary: Fix getListing call getLocatedBlocks even source is a directory (was: getListing call getLo

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368932#comment-17368932 ] Xiaoqiao He commented on HDFS-16067: Try to check failed unit tests at local, both of

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367419#comment-17367419 ] Xiaoqiao He commented on HDFS-16044: [^HDFS-16044.03.patch] LGTM. +1 from my side. cc

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366728#comment-17366728 ] Xiaoqiao He commented on HDFS-16044: Please check report by Yetus, include checkstyle

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366727#comment-17366727 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] for your update. {quote}A.

[jira] [Updated] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-06-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14575: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

2021-06-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366167#comment-17366167 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] involve me here. I agree t

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-06-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366103#comment-17366103 ] Xiaoqiao He commented on HDFS-14575: +1 on [^HDFS-14575.004.patch]. Will commit to tr

[jira] [Commented] (HDFS-14575) LeaseRenewer#daemon threads leak in DFSClient

2021-06-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365916#comment-17365916 ] Xiaoqiao He commented on HDFS-14575: Thanks [~prasad-acit] for your works here. Pleas

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365894#comment-17365894 ] Xiaoqiao He commented on HDFS-16044: [~pilchard] Thanks for your update. The core imp

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355605#comment-17355605 ] Xiaoqiao He commented on HDFS-16044: {quote}IMO, unless it's a regression only in 3.3

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355584#comment-17355584 ] Xiaoqiao He commented on HDFS-16044: It seems that both branch-3.1/3.2/3.3/trunk bran

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

2021-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355123#comment-17355123 ] Xiaoqiao He commented on HDFS-16044: [~pilchard] Thanks for your report. Would you mi

[jira] [Resolved] (HDFS-15998) Fix NullPointException In listOpenFiles

2021-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15998. Fix Version/s: 3.3.2 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-16043) HDFS : Delete performance optimization

2021-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355104#comment-17355104 ] Xiaoqiao He commented on HDFS-16043: Thanks [~zhuxiangyi] for your works. It is inter

[jira] [Commented] (HDFS-16045) FileSystem.CACHE memory leak

2021-05-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17352527#comment-17352527 ] Xiaoqiao He commented on HDFS-16045: Thanks [~zhuxiangyi] raise this issue here. I th

[jira] [Commented] (HDFS-16011) HDFS: Support viewfs nested mount

2021-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345017#comment-17345017 ] Xiaoqiao He commented on HDFS-16011: [~ayushtkn], I think it is common requirement fo

[jira] [Commented] (HDFS-16016) BPServiceActor add a new thread to handle IBR

2021-05-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345015#comment-17345015 ] Xiaoqiao He commented on HDFS-16016: Thanks involve me here. It is good idea. I just

[jira] [Commented] (HDFS-16015) RBF: Read and write data through router select dn according to real user ip

2021-05-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343683#comment-17343683 ] Xiaoqiao He commented on HDFS-16015: Thanks [~zhuxiangyi] involve me here. Is it same

[jira] [Commented] (HDFS-15998) Fix NullPointException In listOpenFiles

2021-05-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342566#comment-17342566 ] Xiaoqiao He commented on HDFS-15998: Thanks [~haiyang Hu] for your report. Do you cap

[jira] [Commented] (HDFS-16020) DatanodeReportType should add LIVE_NOT_DECOMMISSIONING type

2021-05-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342553#comment-17342553 ] Xiaoqiao He commented on HDFS-16020: [~lei w] Thanks for your report, it is interesti

[jira] [Commented] (HDFS-16022) matlab mapreduce v95 demos can't run hadoop-3.2.2 run time

2021-05-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342549#comment-17342549 ] Xiaoqiao He commented on HDFS-16022: Thanks [~cathonsh] for your report, It seems tha

[jira] [Commented] (HDFS-16004) BackupNode and QJournal lack Permission check.

2021-05-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342276#comment-17342276 ] Xiaoqiao He commented on HDFS-16004: Thanks [~shv] for digging the historical issue a

[jira] [Commented] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-05-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341694#comment-17341694 ] Xiaoqiao He commented on HDFS-16003: LGTM, +1 on [^HDFS-16003.001.path]. Pending Jenk

[jira] [Commented] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-05-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341511#comment-17341511 ] Xiaoqiao He commented on HDFS-16003: Thanks [~lei w] and [~ayushtkn]. Would you mind

[jira] [Resolved] (HDFS-16006) TestRouterFederationRename is flaky

2021-05-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16006. Resolution: Won't Fix Thanks [~elgoiri],[~LiJinglun] for your confirm. Close this issue and link to

[jira] [Commented] (HDFS-16011) HDFS: Support viewfs nested mount

2021-05-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341231#comment-17341231 ] Xiaoqiao He commented on HDFS-16011: [~zhuxiangyi] Thanks for involving me here. It i

[jira] [Commented] (HDFS-16004) startLogSegment and journal in BackupNode lack Permission check.

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341112#comment-17341112 ] Xiaoqiao He commented on HDFS-16004: Assign this issue to [~xiaoheipangzi]. Thanks [~

[jira] [Assigned] (HDFS-16004) startLogSegment and journal in BackupNode lack Permission check.

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16004: -- Assignee: lujie > startLogSegment and journal in BackupNode lack Permission check. > -

[jira] [Updated] (HDFS-16001) TestOfflineEditsViewer.testStored() fails reading negative value of FSEditLogOpCodes

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16001: --- Fix Version/s: 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15878) RBF: Flaky test TestRouterWebHDFSContractCreate>AbstractContractCreateTest#testSyncable in Trunk

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340822#comment-17340822 ] Xiaoqiao He commented on HDFS-15878: Hi [~fengnanli], Just found that this issue is m

[jira] [Commented] (HDFS-15968) Improve the log for The DecayRpcScheduler

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340820#comment-17340820 ] Xiaoqiao He commented on HDFS-15968: +1 for v001. The failed unit test seems not rela

[jira] [Resolved] (HDFS-16009) HDFS tiered storage support

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16009. Resolution: Duplicate Close this issue based on above comments. Please feel free to reopen it if ne

[jira] [Commented] (HDFS-15994) Deletion should sleep some time, when there are too many pending deletion blocks.

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340786#comment-17340786 ] Xiaoqiao He commented on HDFS-15994: Thanks [~zhuqi] for your report and contribution

[jira] [Commented] (HDFS-16006) TestRouterFederationRename is flaky

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340776#comment-17340776 ] Xiaoqiao He commented on HDFS-16006: [~LiJinglun] do you mind have another check? Tha

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-05-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340768#comment-17340768 ] Xiaoqiao He commented on HDFS-15757: Thanks [~fengnanli] for your pings and sorry for

[jira] [Resolved] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15561. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16000) HDFS : Rename performance optimization

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335450#comment-17335450 ] Xiaoqiao He commented on HDFS-16000: [~zhuxiangyi] Thanks for your report and contrib

[jira] [Updated] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16003: --- Assignee: lei w Status: Patch Available (was: Open) Add [~lei w] to contributor list and trigg

[jira] [Updated] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16003: --- Fix Version/s: (was: 3.3.0) > ProcessReport print invalidatedBlocks should judge debug level at f

[jira] [Commented] (HDFS-16003) ProcessReport print invalidatedBlocks should judge debug level at first

2021-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335201#comment-17335201 ] Xiaoqiao He commented on HDFS-16003: Thanks [~lei w] for your proposal. It makes sens

[jira] [Commented] (HDFS-15561) RBF: Fix NullPointException when start dfsrouter

2021-04-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331428#comment-17331428 ] Xiaoqiao He commented on HDFS-15561: Thanks [~fengnanli] involve me here. Will have a

[jira] [Updated] (HDFS-15978) Solve DatanodeManager#getBlockRecoveryCommand() printing IOException

2021-04-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15978: --- Component/s: namanode Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Issue Type: Improv

[jira] [Resolved] (HDFS-15978) Solve DatanodeManager#getBlockRecoveryCommand() printing IOException

2021-04-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15978. Resolution: Fixed > Solve DatanodeManager#getBlockRecoveryCommand() printing IOException >

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326431#comment-17326431 ] Xiaoqiao He commented on HDFS-15963: Committed to branch-3.3 via https://github.com/a

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Fix Version/s: 3.3.1 > Unreleased volume references cause an infinite loop >

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17325472#comment-17325472 ] Xiaoqiao He commented on HDFS-15963: [~zhangshuyan] would you like to offer another p

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

2021-04-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324670#comment-17324670 ] Xiaoqiao He commented on HDFS-15985: {quote}We use Hadoop-2.9. HDFS-14617 or HDFS-147

[jira] [Updated] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15869: --- Issue Type: Improvement (was: Bug) Priority: Major (was: Critical) Add [~functioner] to the c

[jira] [Assigned] (HDFS-15869) Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15869: -- Assignee: Haoze Wu > Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324224#comment-17324224 ] Xiaoqiao He edited comment on HDFS-15175 at 4/17/21, 10:17 AM:

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324224#comment-17324224 ] Xiaoqiao He commented on HDFS-15175: [~kihwal], [~daryn], [~ahussein] any ideas about

[jira] [Commented] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324222#comment-17324222 ] Xiaoqiao He commented on HDFS-15987: move this JIRA to sub-task of HDFS-14617. > Imp

[jira] [Updated] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15987: --- Parent: HDFS-14617 Issue Type: Sub-task (was: Improvement) > Improve oiv tool to parse fsima

[jira] [Commented] (HDFS-14698) Upgrade OfflineImageViewer to be compatible with new FSImage format

2021-04-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324219#comment-17324219 ] Xiaoqiao He commented on HDFS-14698: [~jianghuazhu] Please feel free to go ahead. BTW

[jira] [Commented] (HDFS-15985) Incorrect sorting will cause failure to load an FsImage file

2021-04-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17323944#comment-17323944 ] Xiaoqiao He commented on HDFS-15985: I am also concerned that how to catch the except

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2021-04-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322113#comment-17322113 ] Xiaoqiao He commented on HDFS-15756: [~zhangxiping] I am not familiar with Spark code

[jira] [Commented] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318645#comment-17318645 ] Xiaoqiao He commented on HDFS-15963: Add [~zhangshuyan] as contributor and trigger ci

[jira] [Updated] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15963: --- Status: Patch Available (was: Open) > Unreleased volume references cause an infinite loop >

[jira] [Assigned] (HDFS-15963) Unreleased volume references cause an infinite loop

2021-04-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15963: -- Assignee: Shuyan Zhang > Unreleased volume references cause an infinite loop > ---

[jira] [Resolved] (HDFS-15953) DUMMY_CLIENT_ID's verification may be invalid

2021-04-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15953. Resolution: Not A Bug > DUMMY_CLIENT_ID's verification may be invalid > ---

[jira] [Commented] (HDFS-15953) DUMMY_CLIENT_ID's verification may be invalid

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17315945#comment-17315945 ] Xiaoqiao He commented on HDFS-15953: Thanks [~daryn] for your kindly reminder. I try

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

2021-04-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15942: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

2021-04-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313597#comment-17313597 ] Xiaoqiao He commented on HDFS-15942: BTW, I just found that there are many failed uni

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

2021-04-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17313594#comment-17313594 ] Xiaoqiao He commented on HDFS-15942: +1 on [^HDFS-15942.001.patch] . Thanks [~sodonn

[jira] [Updated] (HDFS-15921) Improve the log for the Storage Policy Operations

2021-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15921: --- Fix Version/s: 3.3.1 [~bpatel] backport to branch-3.3. Thanks. > Improve the log for the Storage Pol

[jira] [Updated] (HDFS-15921) Improve the log for the Storage Policy Operations

2021-03-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15921: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Fix Version/s: 3.4.0 > RBF: Validation message to be corrected in FairnessPolicyController >

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available) Com

[jira] [Updated] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15863: --- Issue Type: Improvement (was: Bug) > RBF: Validation message to be corrected in FairnessPolicyContro

[jira] [Updated] (HDFS-15932) Improve the balancer error message when process exits abnormally.

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15932: --- Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1 H

[jira] [Updated] (HDFS-15932) Improve the balancer error message when process exits abnormally.

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15932: --- Issue Type: Improvement (was: Bug) > Improve the balancer error message when process exits abnormall

[jira] [Commented] (HDFS-15921) Improve the log for the Storage Policy Operations

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312011#comment-17312011 ] Xiaoqiao He commented on HDFS-15921: +1 on [^HDFS-15921.001.patch]. Thanks [~bpatel]

[jira] [Commented] (HDFS-15932) Improve the balancer error message when process exits abnormally.

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312004#comment-17312004 ] Xiaoqiao He commented on HDFS-15932: Trigger Jenkins manually: https://ci-hadoop.apa

[jira] [Commented] (HDFS-15863) RBF: Validation message to be corrected in FairnessPolicyController

2021-03-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311999#comment-17311999 ] Xiaoqiao He commented on HDFS-15863: +1 on [^HDFS-15863.005.patch]. Thanks [~prasad-a

[jira] [Commented] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

2021-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17308352#comment-17308352 ] Xiaoqiao He commented on HDFS-15919: + cherry-pick to branch-3.1 > BlockPoolManager

[jira] [Updated] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

2021-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15919: --- Fix Version/s: 3.1.5 > BlockPoolManager should log stack trace if unable to get Namenode addresses >

[jira] [Updated] (HDFS-15919) BlockPoolManager should log stack trace if unable to get Namenode addresses

2021-03-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15919: --- Fix Version/s: 3.2.3 3.4.0 3.3.1 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306102#comment-17306102 ] Xiaoqiao He commented on HDFS-15907: [~ayushtkn] would you mind give another checks?

[jira] [Comment Edited] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306096#comment-17306096 ] Xiaoqiao He edited comment on HDFS-15787 at 3/22/21, 10:42 AM:

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15787: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15787: --- Issue Type: Improvement (was: Bug) > Remove unnecessary Lease Renew in FSNamesystem#internalRelease

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306082#comment-17306082 ] Xiaoqiao He commented on HDFS-15907: [^HDFS-15907.001.patch] LGTM. +1 from my side.

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17306081#comment-17306081 ] Xiaoqiao He commented on HDFS-15787: Thanks [~leosun08], I think it is safe to push i

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305857#comment-17305857 ] Xiaoqiao He commented on HDFS-15792: Thanks [~shv] for your comments and sorry for la

[jira] [Commented] (HDFS-15907) Reduce Memory Overhead of AclFeature by avoiding AtomicInteger

2021-03-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17305856#comment-17305856 ] Xiaoqiao He commented on HDFS-15907: Thanks [~sodonnell] for your proposal and dig de

[jira] [Commented] (HDFS-15894) Trace Time-consuming RPC response of certain threshold.

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304740#comment-17304740 ] Xiaoqiao He commented on HDFS-15894: Thanks [~prasad-acit] for your proposal. It is u

[jira] [Resolved] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15868. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk! Thank

[jira] [Commented] (HDFS-15901) Solve the problem of DN repeated block reports occupying too many RPCs during Safemode

2021-03-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17304722#comment-17304722 ] Xiaoqiao He commented on HDFS-15901: Thanks for involving me here. IIRC, we have disc

[jira] [Commented] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301445#comment-17301445 ] Xiaoqiao He commented on HDFS-15868: Assign this issue to [~NargesShadab]. > Possibl

[jira] [Assigned] (HDFS-15868) Possible Resource Leak in EditLogFileOutputStream

2021-03-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15868: -- Assignee: Narges Shadab > Possible Resource Leak in EditLogFileOutputStream >

[jira] [Updated] (HDFS-15816) Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster.

2021-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15816: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-15816) Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster.

2021-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15816: --- Summary: Fix shouldAvoidStaleDataNodesForWrite returns when no stale node in cluster. (was: If NO st

[jira] [Commented] (HDFS-15885) RBF: Data loss when Router setup connection timeout

2021-03-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301080#comment-17301080 ] Xiaoqiao He commented on HDFS-15885: {quote}This issue surfaced because the call from

[jira] [Commented] (HDFS-15816) If NO stale node in cluster, the function shouldAvoidStaleDataNodesForWrite should return false.

2021-03-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300749#comment-17300749 ] Xiaoqiao He commented on HDFS-15816: Thanks [~hadoop_yangyun] for your works. Please

[jira] [Resolved] (HDFS-15882) Fix incorrectly initializing RandomAccessFile based on configuration options

2021-03-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15882. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-03-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17299258#comment-17299258 ] Xiaoqiao He commented on HDFS-15764: {quote}Does having an upper-bound on the number

<    1   2   3   4   5   6   7   8   9   10   >