[jira] [Commented] (HDFS-15255) Consider StorageType when DatanodeManager#sortLocatedBlock()

2020-04-12 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081677#comment-17081677 ] Lisheng Sun commented on HDFS-15255: I confirmed again the failed UTs are related to

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081714#comment-17081714 ] Hadoop QA commented on HDFS-15272: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Resolved] (HDFS-14788) Use dynamic regex filter to ignore copy of source files in Distcp

2020-04-12 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HDFS-14788. -- Resolution: Done > Use dynamic regex filter to ignore copy of source files in Distcp >

[jira] [Commented] (HDFS-15202) HDFS-client: boost ShortCircuit Cache

2020-04-12 Thread Danil Lipovoy (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081718#comment-17081718 ] Danil Lipovoy commented on HDFS-15202: -- [~leosun08] Could you take a look, please?

[jira] [Updated] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

2020-04-12 Thread Mikhail Pryakhin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Pryakhin updated HDFS-1820: --- Status: Open (was: Patch Available) Instead of manually uploading patch I'll provide a link t

[jira] [Commented] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

2020-04-12 Thread Mikhail Pryakhin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081729#comment-17081729 ] Mikhail Pryakhin commented on HDFS-1820: a patch is available here [https://githu

[jira] [Comment Edited] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

2020-04-12 Thread Mikhail Pryakhin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081729#comment-17081729 ] Mikhail Pryakhin edited comment on HDFS-1820 at 4/12/20, 10:14 AM: -

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081738#comment-17081738 ] Xiaoqiao He commented on HDFS-15272: TestDiskBalancer keeps failing whether apply thi

[jira] [Commented] (HDFS-14599) HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081742#comment-17081742 ] Xiaoqiao He commented on HDFS-14599: Hi [~weichiu],[~elgoiri]. TestDiskBalancer is st

[jira] [Commented] (HDFS-15272) Backport HDFS-12862 to branch-3.1

2020-04-12 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081745#comment-17081745 ] Xiaoqiao He commented on HDFS-15272: HDFS-14599 fixed this fail unit test, but not ba

[jira] [Updated] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

2020-04-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-15271: Summary: Remove obsolete SPNEGO configuration of NN, SNN and JN. (was: Update DFSUtil.getS

[jira] [Updated] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

2020-04-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-15271: Description: After HADOOP-16354, {{hadoop.http.authentication.kerberos.(principal|keytab)}}

[jira] [Commented] (HDFS-15271) Remove obsolete SPNEGO configuration of NN, SNN and JN.

2020-04-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081806#comment-17081806 ] Masatake Iwasaki commented on HDFS-15271: - {{dfs.web.authentication.kerberos.prin

[jira] [Commented] (HDFS-15243) Child directory should not be deleted or renamed if parent directory is a protected directory

2020-04-12 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17081955#comment-17081955 ] liuyanyu commented on HDFS-15243: - [~ayushtkn]  Thanks for reviewing, will upload the pat

[jira] [Created] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2020-04-12 Thread HuangTao (Jira)
HuangTao created HDFS-15274: --- Summary: NN doesn't remove the blocks from the failed DatanodeStorageInfo Key: HDFS-15274 URL: https://issues.apache.org/jira/browse/HDFS-15274 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2020-04-12 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuangTao updated HDFS-15274: Fix Version/s: (was: 3.4.0) > NN doesn't remove the blocks from the failed DatanodeStorageInfo > --

[jira] [Updated] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2020-04-12 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuangTao updated HDFS-15274: Affects Version/s: 3.4.0 > NN doesn't remove the blocks from the failed DatanodeStorageInfo > -

[jira] [Updated] (HDFS-15048) Fix findbug in DirectoryScanner

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-15048: - Attachment: HDFS-15048-branch-2.10.002.patch > Fix findbug in DirectoryScanner >

[jira] [Updated] (HDFS-15048) Fix findbug in DirectoryScanner

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-15048: - Fix Version/s: 2.10.1 > Fix findbug in DirectoryScanner > --- > >

[jira] [Comment Edited] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082042#comment-17082042 ] Sean Chow edited comment on HDFS-14476 at 4/13/20, 4:25 AM: S

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082042#comment-17082042 ] Sean Chow commented on HDFS-14476: -- I think this patch is safe for 3.3.0 as  https://iss

[jira] [Updated] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Chow updated HDFS-14476: - Fix Version/s: 2.10.1 > lock too long when fix inconsistent blocks between disk and in-memory > -

[jira] [Commented] (HDFS-15048) Fix findbug in DirectoryScanner

2020-04-12 Thread Sean Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082046#comment-17082046 ] Sean Chow commented on HDFS-15048: -- Hi [~iwasakims] , thanks for this patch for resolvin

[jira] [Updated] (HDFS-15274) NN doesn't remove the blocks from the failed DatanodeStorageInfo

2020-04-12 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuangTao updated HDFS-15274: Attachment: HDFS-15274.001.patch Status: Patch Available (was: Open) > NN doesn't remove the block

[jira] [Commented] (HDFS-15048) Fix findbug in DirectoryScanner

2020-04-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082085#comment-17082085 ] Masatake Iwasaki commented on HDFS-15048: - [~seanlook] I'm going to commit both H

[jira] [Commented] (HDFS-14476) lock too long when fix inconsistent blocks between disk and in-memory

2020-04-12 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082107#comment-17082107 ] Masatake Iwasaki commented on HDFS-14476: - +1 on the HDFS-14476-branch-2.10.02.pa