[jira] [Updated] (HDFS-16785) Avoid to hold write lock to improve performance when add volume.

2022-11-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16785: --- Parent: HDFS-15382 Issue Type: Sub-task (was: Improvement) > Avoid to hold write lock to imp

[jira] [Resolved] (HDFS-16785) Avoid to hold write lock to improve performance when add volume.

2022-11-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16785. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16836) StandbyCheckpointer can still trigger rollback fs image after RU is finalized

2022-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634144#comment-17634144 ] Xiaoqiao He commented on HDFS-16836: {quote}I mean doCheckpoint can fail and throw ex

[jira] [Comment Edited] (HDFS-16836) StandbyCheckpointer can still trigger rollback fs image after RU is finalized

2022-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634144#comment-17634144 ] Xiaoqiao He edited comment on HDFS-16836 at 11/15/22 4:10 AM: -

[jira] [Commented] (HDFS-16836) StandbyCheckpointer can still trigger rollback fs image after RU is finalized

2022-11-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634619#comment-17634619 ] Xiaoqiao He commented on HDFS-16836: {quote}What we have seen is #1 succeeded but #2

[jira] [Assigned] (HDFS-17408) Reduce the number of quota calculations in FSDirRenameOp

2024-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17408: -- Assignee: lei w > Reduce the number of quota calculations in FSDirRenameOp > -

[jira] [Assigned] (HDFS-17391) Adjust the checkpoint io buffer size to the chunk size

2024-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17391: -- Assignee: lei w > Adjust the checkpoint io buffer size to the chunk size > ---

[jira] [Assigned] (HDFS-17368) HA: Standy should exit safemode when resources are from low available

2024-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17368: -- Assignee: Zilong Zhu > HA: Standy should exit safemode when resources are from low available >

[jira] [Commented] (HDFS-17368) HA: Standy should exit safemode when resources are from low available

2024-03-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17824403#comment-17824403 ] Xiaoqiao He commented on HDFS-17368: Add [~zilong zhu] to contributor list and assign

[jira] [Assigned] (HDFS-17422) Enhance the stability of the unit test TestDFSAdmin

2024-03-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17422: -- Assignee: lei w > Enhance the stability of the unit test TestDFSAdmin > -

[jira] [Resolved] (HDFS-17422) Enhance the stability of the unit test TestDFSAdmin

2024-03-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17422. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Enhance the stability

[jira] [Commented] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-03-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17825518#comment-17825518 ] Xiaoqiao He commented on HDFS-17146: Check this issue is not checked in branch-3.4, a

[jira] [Updated] (HDFS-17146) Use the dfsadmin -reconfig command to initiate reconfiguration on all decommissioning datanodes.

2024-03-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17146: --- Fix Version/s: (was: 3.4.1) > Use the dfsadmin -reconfig command to initiate reconfiguration on a

[jira] [Resolved] (HDFS-17391) Adjust the checkpoint io buffer size to the chunk size

2024-03-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17391. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Adjust the checkpoint i

[jira] [Resolved] (HDFS-17380) FsImageValidation: remove inaccessible nodes

2024-03-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17380. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > FsImageValidation: remo

[jira] [Resolved] (HDFS-17368) HA: Standy should exit safemode when resources are from low available

2024-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17368. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > HA: Standy should exit

[jira] [Updated] (HDFS-17368) HA: Standy should exit safemode when resources are from low available

2024-03-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17368: --- Component/s: ha namenode > HA: Standy should exit safemode when resources are from l

[jira] [Resolved] (HDFS-17455) Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt

2024-04-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17455. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix Client throw IndexO

[jira] [Updated] (HDFS-17455) Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt

2024-04-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17455: --- Component/s: dfsclient > Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt >

[jira] [Resolved] (HDFS-17461) Fix spotbugs in PeerCache#getInternal

2024-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17461. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix spotbugs in PeerCac

[jira] [Commented] (HDFS-17483) volume in full disk will be regarded as failure volume when dn restart

2024-04-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838661#comment-17838661 ] Xiaoqiao He commented on HDFS-17483: [~Xuze Yang] Thanks for your report. Would you m

[jira] [Updated] (HDFS-17462) RBF: NPE in Router concat when trg is an empty file.

2024-04-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17462: --- Summary: RBF: NPE in Router concat when trg is an empty file. (was: NPE in Router concat when trg is

[jira] [Assigned] (HDFS-17462) RBF: NPE in Router concat when trg is an empty file.

2024-04-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17462: -- Assignee: NaihaoFan > RBF: NPE in Router concat when trg is an empty file. > -

[jira] [Updated] (HDFS-17456) Fix the incorrect dfsused statistics of datanode when appending a file.

2024-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17456: --- Summary: Fix the incorrect dfsused statistics of datanode when appending a file. (was: Fix the dfsus

[jira] [Assigned] (HDFS-17456) Fix the incorrect dfsused statistics of datanode when appending a file.

2024-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17456: -- Assignee: fuchaohong > Fix the incorrect dfsused statistics of datanode when appending a file.

[jira] [Updated] (HDFS-17456) Fix the incorrect dfsused statistics of datanode when appending a file.

2024-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17456: --- Issue Type: Improvement (was: Bug) > Fix the incorrect dfsused statistics of datanode when appending

[jira] [Resolved] (HDFS-17456) Fix the incorrect dfsused statistics of datanode when appending a file.

2024-04-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17456. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix the incorrect dfsus

[jira] [Updated] (HDFS-17500) Add missing operation name while authorizing some operations

2024-05-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17500: --- Summary: Add missing operation name while authorizing some operations (was: Add missing operation na

[jira] [Updated] (HDFS-17521) EC: Fix calculation errors caused by special index order

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17521: --- Summary: EC: Fix calculation errors caused by special index order (was: Erasure Coding: Fix calculat

[jira] [Commented] (HDFS-17521) EC: Fix calculation errors caused by special index order

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845806#comment-17845806 ] Xiaoqiao He commented on HDFS-17521: cc [~zhangshuyan] Would you mind to take a revie

[jira] [Assigned] (HDFS-17518) In the lease monitor, if a file is closed, we should sync the editslog

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17518: -- Assignee: lei w > In the lease monitor, if a file is closed, we should sync the editslog > ---

[jira] [Assigned] (HDFS-17522) JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17522: -- Assignee: wangzhihui > JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection

[jira] [Resolved] (HDFS-17522) JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17522. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > JournalNode web interfa

[jira] [Updated] (HDFS-17522) JournalNode web interfaces lack configs for X-FRAME-OPTIONS protection

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17522: --- Issue Type: Improvement (was: Bug) > JournalNode web interfaces lack configs for X-FRAME-OPTIONS pro

[jira] [Updated] (HDFS-17099) Fix Null Pointer Exception when stop namesystem in HDFS

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17099: --- Summary: Fix Null Pointer Exception when stop namesystem in HDFS (was: Null Pointer Exception when s

[jira] [Updated] (HDFS-17099) Fix Null Pointer Exception when stop namesystem in HDFS

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17099: --- Priority: Major (was: Critical) > Fix Null Pointer Exception when stop namesystem in HDFS >

[jira] [Resolved] (HDFS-17099) Fix Null Pointer Exception when stop namesystem in HDFS

2024-05-13 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17099. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Fix Null Pointer Except

[jira] [Commented] (HDFS-17523) Add fine-grained locks metrics in DataSetLockManager

2024-05-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846482#comment-17846482 ] Xiaoqiao He commented on HDFS-17523: Good point. Would you mind to submit PR for this

[jira] [Updated] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17555: --- Summary: Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize. (was: fix

[jira] [Assigned] (HDFS-17555) Fix NumberFormatException of NNThroughputBenchmark when configured dfs.blocksize.

2024-06-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17555: -- Assignee: wangzhongwei > Fix NumberFormatException of NNThroughputBenchmark when configured >

[jira] [Updated] (HDFS-17564) EC: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-07-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17564: --- Summary: EC: Fix the issue of inaccurate metrics when decommission mark busy DN (was: Erasure Coding

[jira] [Resolved] (HDFS-17564) EC: Fix the issue of inaccurate metrics when decommission mark busy DN

2024-07-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17564. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > EC: Fix the issue of in

[jira] [Resolved] (HDFS-17566) Got wrong sorted block order when StorageType is considered.

2024-07-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17566. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Got wrong sorted block

[jira] [Commented] (HDFS-17573) Add test code for FSImage parallelization and compression

2024-07-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865103#comment-17865103 ] Xiaoqiao He commented on HDFS-17573: Thanks [~last-remote] involve me here. I am a li

[jira] [Updated] (HDFS-17574) Make NNThroughputBenchmark support human-friendly units about blocksize.

2024-07-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17574: --- Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-17574) Make NNThroughputBenchmark support human-friendly units about blocksize.

2024-07-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-17574: --- Summary: Make NNThroughputBenchmark support human-friendly units about blocksize. (was: Make NNThrou

[jira] [Commented] (HDFS-17576) Support user defined auth Callback

2024-07-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867489#comment-17867489 ] Xiaoqiao He commented on HDFS-17576: Hi [~szetszwo], the fix version tag should be ma

[jira] [Commented] (HDFS-17573) Allow turn on both FSImage parallelization and compression

2024-07-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867503#comment-17867503 ] Xiaoqiao He commented on HDFS-17573: Thanks [~last-remote] for your works. Not think

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2024-07-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867515#comment-17867515 ] Xiaoqiao He commented on HDFS-2139: --- Hi All, Sorry to so late comment here. It seems tha

[jira] [Assigned] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-07-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16690: -- Assignee: Aswin M Prabhu (was: Steve Vaughan) > Automatically format new unformatted JournalN

[jira] [Resolved] (HDFS-16690) Automatically format new unformatted JournalNodes using JournalNodeSyncer

2024-07-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16690. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > Automatically format ne

[jira] [Resolved] (HDFS-17544) [ARR] The router client rpc protocol PB supports asynchrony.

2024-08-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17544. Fix Version/s: HDFS-17531 Hadoop Flags: Reviewed Resolution: Fixed > [ARR] The router c

[jira] [Resolved] (HDFS-16084) getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed

2024-08-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16084. Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed > getJNIEnv() returns inv

[jira] [Resolved] (HDFS-17573) Allow turn on both FSImage parallelization and compression

2024-08-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-17573. Fix Version/s: (was: 3.4.1) Hadoop Flags: Reviewed Target Version/s: (was: 3.4.

[jira] [Assigned] (HDFS-17573) Allow turn on both FSImage parallelization and compression

2024-08-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-17573: -- Assignee: Sungdong Kim > Allow turn on both FSImage parallelization and compression >

[jira] [Assigned] (HDFS-16084) getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed

2024-09-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16084: -- Assignee: kevin cai > getJNIEnv() returns invalid pointer when called twice after getGlobalJNI

[jira] [Updated] (HDFS-16084) getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv() failed

2024-09-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16084: --- Fix Version/s: 3.4.2 > getJNIEnv() returns invalid pointer when called twice after getGlobalJNIEnv()

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.002.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955423#comment-16955423 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.002.patch] fix checkstyle and try t

[jira] [Commented] (HDFS-14283) DFSInputStream to prefer cached replica

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955426#comment-16955426 ] Xiaoqiao He commented on HDFS-14283: Thanks [~leosun08] for your works. {quote}But i

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.003.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955487#comment-16955487 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn] for your reviews. I have addr

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.004.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955804#comment-16955804 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn] for your comments. {quote}Tho

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955815#comment-16955815 ] Xiaoqiao He commented on HDFS-14915: [~ayushtkn] Thanks for your works. it seems that

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955887#comment-16955887 ] Xiaoqiao He commented on HDFS-14915: Thanks [~ayushtkn] for your quick update. We nee

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955911#comment-16955911 ] Xiaoqiao He commented on HDFS-13736: Thanks [~xiaodong.hu] for interesting catching.

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.005.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955918#comment-16955918 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.005.patch] fix checkstyle and try t

[jira] [Commented] (HDFS-14915) Move Superuser Check Before Taking Lock For Encryption API

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16955919#comment-16955919 ] Xiaoqiao He commented on HDFS-14915: +1 for [^HDFS-14915-02.patch] from my side. > M

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956027#comment-16956027 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.004.patch] looks much better otherw

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.006.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956085#comment-16956085 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn], you are right. [^HDFS-14882.

[jira] [Comment Edited] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956085#comment-16956085 ] Xiaoqiao He edited comment on HDFS-14882 at 10/21/19 1:31 PM: -

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.007.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956667#comment-16956667 ] Xiaoqiao He commented on HDFS-14882: [~elgoiri],[~ayushtkn] Thanks for your nice revi

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-21 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956673#comment-16956673 ] Xiaoqiao He commented on HDFS-13736: Thanks [~xiaodong.hu] for your works and contrib

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956922#comment-16956922 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your catch and works, II

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.008.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957592#comment-16957592 ] Xiaoqiao He commented on HDFS-14882: Thanks [~ayushtkn],[~elgoiri] for your suggestio

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957619#comment-16957619 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your feedback. What I me

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-25 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959520#comment-16959520 ] Xiaoqiao He commented on HDFS-14908: Thanks [~LiJinglun] for your works and strict be

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961096#comment-16961096 ] Xiaoqiao He commented on HDFS-13736: [^HDFS-13736.006.patch] LGTM, check the failed u

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961123#comment-16961123 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, [^HDFS-148

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.009.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961746#comment-16961746 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.009.patch] originate from [~pifta]'

[jira] [Commented] (HDFS-13736) BlockPlacementPolicyDefault can not choose favored nodes when 'dfs.namenode.block-placement-policy.default.prefer-local-node' set to false

2019-10-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961747#comment-16961747 ] Xiaoqiao He commented on HDFS-13736: +1 for [^HDFS-13736.007.patch]. > BlockPlacemen

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962758#comment-16962758 ] Xiaoqiao He commented on HDFS-14882: Thanks [~pifta] for your suggestions, {quote}I w

[jira] [Comment Edited] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962758#comment-16962758 ] Xiaoqiao He edited comment on HDFS-14882 at 10/30/19 7:08 AM: -

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.010.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: HDFS-14882.010.patch > Consider DataNode load when #getBlockLocation > --

[jira] [Updated] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14882: --- Attachment: (was: HDFS-14882.010.patch) > Consider DataNode load when #getBlockLocation > ---

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965313#comment-16965313 ] Xiaoqiao He commented on HDFS-14882: [^HDFS-14882.010.patch] try to fix bug about Ne

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16965347#comment-16965347 ] Xiaoqiao He commented on HDFS-14720: [~surendrasingh] Thanks for your report. Would y

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966479#comment-16966479 ] Xiaoqiao He commented on HDFS-14720: Thank [~surendrasingh] for your detailed informa

[jira] [Commented] (HDFS-14882) Consider DataNode load when #getBlockLocation

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966481#comment-16966481 ] Xiaoqiao He commented on HDFS-14882: Ping [~pifta],[~elgoiri],[~ayushtkn], any more s

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966501#comment-16966501 ] Xiaoqiao He commented on HDFS-14720: about [^HDFS-14720.001.patch], the following con

[jira] [Commented] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966781#comment-16966781 ] Xiaoqiao He commented on HDFS-14952: Thanks [~rajesh.balamohan] for your report. It s

[jira] [Updated] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14952: --- Attachment: HDFS-14952.001.patch > Skip safemode if blockSafe is 0 in new NN > --

[jira] [Commented] (HDFS-14952) Skip safemode if blockSafe is 0 in new NN

2019-11-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966788#comment-16966788 ] Xiaoqiao He commented on HDFS-14952: [^HDFS-14952.001.patch] try to correct the exten

<    4   5   6   7   8   9   10   11   >