[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

2021-02-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Fix Version/s: 2.10.2 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280404#comment-17280404 ] Xiaoqiao He commented on HDFS-15757: {quote}proxy time, this is directly impacted since the change

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-06 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280399#comment-17280399 ] Xiaoqiao He commented on HDFS-15792: Thanks [~prasad-acit] and [~sodonnell] for your continued works

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

2021-02-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Attachment: HDFS-15792-branch-2.10.003.patch > ClasscastException while loading FSImage >

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279626#comment-17279626 ] Xiaoqiao He commented on HDFS-15792: Hi [~prasad-acit], I upload 003 following your initial patch and

[jira] [Commented] (HDFS-15757) RBF: Improving Router Connection Management

2021-02-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278649#comment-17278649 ] Xiaoqiao He commented on HDFS-15757: Thanks [~fengnanli] for your works and update. The new patch

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278633#comment-17278633 ] Xiaoqiao He commented on HDFS-15792: [~prasad-acit] checkstyle issue reported by Yetus, would you

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278556#comment-17278556 ] Xiaoqiao He commented on HDFS-15792: [~prasad-acit], maybe it is related with YARN-10036, Aajisaka

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278506#comment-17278506 ] Xiaoqiao He commented on HDFS-15792: LGTM. +1 on [^HDFS-15792-branch-2.10.002.patch]. [~sodonnell]

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277780#comment-17277780 ] Xiaoqiao He commented on HDFS-15792: [~prasad-acit] the following lambda expression need to change to

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

2021-02-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Status: Patch Available (was: Reopened) > ClasscastException while loading FSImage >

[jira] [Reopened] (HDFS-15792) ClasscastException while loading FSImage

2021-02-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-15792: > ClasscastException while loading FSImage > > >

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

2021-02-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276815#comment-17276815 ] Xiaoqiao He commented on HDFS-15792: Failed unit test and mvninstall seems not related to this

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276428#comment-17276428 ] Xiaoqiao He commented on HDFS-15792: Emm... have not noticed this checkstyle report. I have committed

[jira] [Updated] (HDFS-15792) ClasscastException while loading FSImage

2021-02-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15792: --- Attachment: HDFS-15792.addendum.001.patch > ClasscastException while loading FSImage >

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-02-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276402#comment-17276402 ] Xiaoqiao He commented on HDFS-15792: Failed unit test is not related with this changes. LGTM, +1 on

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-01-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276046#comment-17276046 ] Xiaoqiao He commented on HDFS-15792: Thanks [~prasad-acit] for your updates. [^HDFS-15792.004.patch]

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-01-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275921#comment-17275921 ] Xiaoqiao He commented on HDFS-15792: [~sodonnell], Thanks for your quick response. I try to dig this

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-01-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275870#comment-17275870 ] Xiaoqiao He commented on HDFS-15792: Thanks [~prasad-acit] for your report. It makes sense to me.

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-31 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275852#comment-17275852 ] Xiaoqiao He commented on HDFS-15787: Thanks [~leosun08] for your updates. it makes sense to me

[jira] [Commented] (HDFS-15792) ClasscastException while loading FSImage

2021-01-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274382#comment-17274382 ] Xiaoqiao He commented on HDFS-15792: Thanks [~prasad-acit] for your report, Would you mind to offer

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-01-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274316#comment-17274316 ] Xiaoqiao He commented on HDFS-15764: It is actually a good choice to rely on pendingIBR, if that we

[jira] [Commented] (HDFS-15764) Notify Namenode missing or new block on disk as soon as possible

2021-01-29 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274273#comment-17274273 ] Xiaoqiao He commented on HDFS-15764: Thanks [~hadoop_yangyun], [~ayushtkn] and [~elgoiri] discuss

[jira] [Commented] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-28 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274212#comment-17274212 ] Xiaoqiao He commented on HDFS-15787: Hi [~leosun08], it seems to execute different logic when the

[jira] [Updated] (HDFS-15780) RBF: Delete unnecessary var in stateStoreService

2021-01-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15780: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) Emmm... Thanks [~elgoiri] for

[jira] [Updated] (HDFS-15780) RBF: Delete unnecessary var in stateStoreService

2021-01-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15780: --- Priority: Trivial (was: Major) > RBF: Delete unnecessary var in stateStoreService >

[jira] [Updated] (HDFS-15780) RBF: Delete unnecessary var in stateStoreService

2021-01-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15780: --- Status: Patch Available (was: Open) LGTM, +1 for [^HDFS-15780.patch]. Pending for what Yetus says.

[jira] [Assigned] (HDFS-15780) RBF: Delete unnecessary var in stateStoreService

2021-01-18 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15780: -- Assignee: wangzhaohui > RBF: Delete unnecessary var in stateStoreService >

[jira] [Commented] (HDFS-15769) Metric metadataOperationRate maybe incorrect

2021-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262625#comment-17262625 ] Xiaoqiao He commented on HDFS-15769: Thanks [~xuzq_zander] for your quick response. It makes sense to

[jira] [Commented] (HDFS-15769) Metric metadataOperationRate maybe incorrect

2021-01-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262610#comment-17262610 ] Xiaoqiao He commented on HDFS-15769: Thanks [~xuzq_zander] for your report. cc [~Aiphag0] Please take

[jira] [Updated] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15751: --- Fix Version/s: 3.2.3 2.10.2 3.1.5 3.4.0

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257650#comment-17257650 ] Xiaoqiao He commented on HDFS-15751: Thanks [~csun], will commit to active branches shortly if no

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257350#comment-17257350 ] Xiaoqiao He commented on HDFS-15751: Thanks [~csun] for your comments. v03 has updated it, Please

[jira] [Updated] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15751: --- Attachment: HDFS-15751-03.patch > Add documentation for msync() API to filesystem.md >

[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2021-01-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257324#comment-17257324 ] Xiaoqiao He commented on HDFS-15756: Thanks [~hbprotoss] for your report, I believe it is possible

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257290#comment-17257290 ] Xiaoqiao He commented on HDFS-15751: Thanks [~csun] for your reviews. I try to update the doc

[jira] [Updated] (HDFS-15751) Add documentation for msync() API to filesystem.md

2021-01-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15751: --- Attachment: HDFS-15751-02.patch > Add documentation for msync() API to filesystem.md >

[jira] [Commented] (HDFS-15751) Add documentation for msync() API to filesystem.md

2020-12-24 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254728#comment-17254728 ] Xiaoqiao He commented on HDFS-15751: Thanks [~shv] for your update. just wonder if we need note

[jira] [Commented] (HDFS-15746) Standby NameNode crash when replay editlog

2020-12-23 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254400#comment-17254400 ] Xiaoqiao He commented on HDFS-15746: Thanks [~elgoiri] and [~shv] for your suggestions, Sound good to

[jira] [Updated] (HDFS-15746) Standby NameNode crash when replay editlog

2020-12-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15746: --- Status: Patch Available (was: Open) > Standby NameNode crash when replay editlog >

[jira] [Updated] (HDFS-15746) Standby NameNode crash when replay editlog

2020-12-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15746: --- Attachment: HDFS-15746.001.patch > Standby NameNode crash when replay editlog >

[jira] [Created] (HDFS-15746) Standby NameNode crash when replay editlog

2020-12-22 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15746: -- Summary: Standby NameNode crash when replay editlog Key: HDFS-15746 URL: https://issues.apache.org/jira/browse/HDFS-15746 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-15732) EC client will not retry get block token when block token expired in kerberized cluster

2020-12-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251084#comment-17251084 ] Xiaoqiao He commented on HDFS-15732: Hi [~lalapala], Thanks for your report. IMO, I think it is about

[jira] [Updated] (HDFS-15628) HttpFS server throws NPE if a file is a symlink

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15628: --- Fix Version/s: 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix version tag in time when

[jira] [Updated] (HDFS-15583) Backport DirectoryScanner improvements HDFS-14476, HDFS-14751 and HDFS-15048 to branch 3.2 and 3.1

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15583: --- Fix Version/s: 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix version tag in time when

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15574: --- Fix Version/s: 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix version tag in time when

[jira] [Updated] (HDFS-15567) [SBN Read] HDFS should expose msync() API to allow downstream applications call it explicitly.

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15567: --- Fix Version/s: 3.2.2 > [SBN Read] HDFS should expose msync() API to allow downstream applications >

[jira] [Updated] (HDFS-15478) When Empty mount points, we are assigning fallback link to self. But it should not use full URI for target fs.

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15478: --- Fix Version/s: 3.2.3 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix

[jira] [Updated] (HDFS-15464) ViewFsOverloadScheme should work when -fs option pointing to remote cluster without mount links

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15464: --- Fix Version/s: 3.2.3 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix

[jira] [Updated] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

2020-12-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15723: --- Description: My colleague report that the following code segment has wrong parameter passed when

[jira] [Updated] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

2020-12-10 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15723: --- Attachment: HDFS-15723.001.patch Assignee: Xiaoqiao He Status: Patch Available (was:

[jira] [Created] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

2020-12-10 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HDFS-15723: -- Summary: RBF: invokeConcurrent may run unexpected when enable standby read Key: HDFS-15723 URL: https://issues.apache.org/jira/browse/HDFS-15723 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246530#comment-17246530 ] Xiaoqiao He commented on HDFS-15170: Sorry, I do not read above comment carefully, it makes sense to

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246483#comment-17246483 ] Xiaoqiao He commented on HDFS-15170: OK, Thanks for your information, get it. Let's backport to the

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246450#comment-17246450 ] Xiaoqiao He commented on HDFS-15170: [~ayushtkn] Thanks for your works here. IMO, this issue could

[jira] [Updated] (HDFS-15707) NNTop counts don't add up as expected

2020-12-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15707: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2. > NNTop counts don't add up as expected >

[jira] [Updated] (HDFS-15709) EC: Socket file descriptor leak in StripedBlockChecksumReconstructor

2020-12-07 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15709: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 > EC: Socket file descriptor leak in

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15240: --- Fix Version/s: 3.2.2 > Erasure Coding: dirty buffer causes reconstruction block error >

[jira] [Updated] (HDFS-15708) TestURLConnectionFactory fails by NoClassDefFoundError in branch-3.3 and branch-3.2

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15708: --- Fix Version/s: 3.2.3 cherry-pick to branch-3.2.2. > TestURLConnectionFactory fails by

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244406#comment-17244406 ] Xiaoqiao He commented on HDFS-15240: cherry-pick to branch-3.2.2. > Erasure Coding: dirty buffer

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15240: --- Fix Version/s: 3.2.3 > Erasure Coding: dirty buffer causes reconstruction block error >

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244039#comment-17244039 ] Xiaoqiao He commented on HDFS-15240: It seems failed unit test is not related with this issue. check

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15240: --- Status: Patch Available (was: Reopened) > Erasure Coding: dirty buffer causes reconstruction block

[jira] [Commented] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243887#comment-17243887 ] Xiaoqiao He commented on HDFS-15240: reopen and add 3.2.2 as another target version. upload

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15240: --- Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.1.5, 3.2.3 (was: 3.3.1, 3.4.0, 3.1.5, 3.2.3) > Erasure

[jira] [Updated] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15240: --- Attachment: HDFS-15240-branch-3.2.001.patch > Erasure Coding: dirty buffer causes reconstruction

[jira] [Reopened] (HDFS-15240) Erasure Coding: dirty buffer causes reconstruction block error

2020-12-04 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-15240: > Erasure Coding: dirty buffer causes reconstruction block error >

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240838#comment-17240838 ] Xiaoqiao He commented on HDFS-15680: Thanks [~ayushtkn] for your informations. I backport

[jira] [Commented] (HDFS-14437) Exception happened when rollEditLog expects empty EditsDoubleBuffer.bufCurrent but not

2020-11-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240663#comment-17240663 ] Xiaoqiao He commented on HDFS-14437: [~Sushma_28] Actually, I also meet the similar case (NameNode

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-27 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239599#comment-17239599 ] Xiaoqiao He commented on HDFS-15680: Thanks [~ste...@apache.org], IIUC, if we backport HADOOP-17325

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-26 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239149#comment-17239149 ] Xiaoqiao He commented on HDFS-15680: [~ste...@apache.org], Just found that HADOOP-17325 has resolved

[jira] [Commented] (HDFS-15691) Fix flaky test TestServerWebApp.getHomeDir

2020-11-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237118#comment-17237118 ] Xiaoqiao He commented on HDFS-15691: [~lzx404243], Try to check how to set system property in

[jira] [Commented] (HDFS-15691) Fix flaky test TestServerWebApp.getHomeDir

2020-11-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237106#comment-17237106 ] Xiaoqiao He commented on HDFS-15691: Add [~lzx404243] to HDFS contributor list and assign this issue

[jira] [Assigned] (HDFS-15691) Fix flaky test TestServerWebApp.getHomeDir

2020-11-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-15691: -- Assignee: Zhengxi Li > Fix flaky test TestServerWebApp.getHomeDir >

[jira] [Updated] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2020-11-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15684: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2020-11-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236917#comment-17236917 ] Xiaoqiao He commented on HDFS-15684: +1 for [^HDFS-15684.003.patch]. Will commit shortly once

[jira] [Commented] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2020-11-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236597#comment-17236597 ] Xiaoqiao He commented on HDFS-15684: trigger Jenkins manually and let see what it says. > EC: Call

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-11-20 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235974#comment-17235974 ] Xiaoqiao He commented on HDFS-15655: Thanks [~hadoop_yangyun], it is a good idea that move cold block

[jira] [Commented] (HDFS-15684) EC: Call recoverLease on DFSStripedOutputStream close exception

2020-11-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235967#comment-17235967 ] Xiaoqiao He commented on HDFS-15684: Thanks [~wanghongbing] and [~ferhui] for your works. +1 from my

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-11-16 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17232686#comment-17232686 ] Xiaoqiao He commented on HDFS-15645: [~LiJinglun], Thanks involve me here. Sorry I don't get why we

[jira] [Updated] (HDFS-15680) Disable Broken Azure Junits

2020-11-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15680: --- Target Version/s: 3.2.2, 3.3.1, 3.4.0, 3.2.3 update: mark 3.2.2/3.2.3/3.3.1/3.4.0 as target version.

[jira] [Updated] (HDFS-14395) Remove WARN Logging From Interrupts in DataStreamer

2020-11-14 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14395: --- Fix Version/s: 3.2.2 backport to branch-3.2.2 for the next RC. > Remove WARN Logging From

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-11 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229900#comment-17229900 ] Xiaoqiao He commented on HDFS-15680: Thanks [~ayushtkn] for involve me here. [~aajisaka] and

[jira] [Updated] (HDFS-14395) Remove WARN Logging From Interrupts

2020-11-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14395: --- Fix Version/s: 3.2.3 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-14395) Remove WARN Logging From Interrupts

2020-11-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-14395: --- Attachment: HDFS-14395-branch-3.2.001.patch Target Version/s: 3.2.3 Status:

[jira] [Reopened] (HDFS-14395) Remove WARN Logging From Interrupts

2020-11-09 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-14395: > Remove WARN Logging From Interrupts > --- > > Key:

[jira] [Commented] (HDFS-14395) Remove WARN Logging From Interrupts

2020-11-08 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228340#comment-17228340 ] Xiaoqiao He commented on HDFS-14395: [~elgoiri],[~giovanni.fumarola],[~belugabehr]. Just check that

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-11-05 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15643: --- Fix Version/s: 3.2.2 Thanks [~ayushtkn] and [~ahussein] for your works. Backport to branch-3.2.2. >

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-11-03 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15651: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

2020-11-02 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225151#comment-17225151 ] Xiaoqiao He commented on HDFS-15651: Thanks [~Aiphag0] for your update, v002 LGTM. [~linyiqun] do you

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15641: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~wanghongbing] and

[jira] [Updated] (HDFS-9776) TestHAAppend#testMultipleAppendsDuringCatchupTailing is flaky

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-9776: -- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Updated] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15461: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Updated] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15459: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. >

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15644: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. > Failed

[jira] [Updated] (HDFS-15622) Deleted blocks linger in the replications queue

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15622: --- Fix Version/s: 3.2.2 cherry-pick to branch-3.2.2 and verify at local, Thanks [~ahussein]. > Deleted

[jira] [Commented] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223512#comment-17223512 ] Xiaoqiao He commented on HDFS-15639: cherry-pick to branch-3.2.2 and verify at local, Thanks

[jira] [Updated] (HDFS-15639) [JDK 11] Fix Javadoc errors in hadoop-hdfs-client

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15639: --- Fix Version/s: 3.2.2 > [JDK 11] Fix Javadoc errors in hadoop-hdfs-client >

[jira] [Updated] (HDFS-15618) Improve datanode shutdown latency

2020-10-30 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15618: --- Fix Version/s: 3.2.2 > Improve datanode shutdown latency > - > >

<    1   2   3   4   5   6   7   8   9   10   >