[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142713#comment-17142713 ] Akira Ajisaka commented on HDFS-15421: -- Thank you [~kihwal] for the detailed report.

[jira] [Created] (HDFS-15429) mkdirs should work when parent dir is internalDir and fallback configured.

2020-06-23 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15429: -- Summary: mkdirs should work when parent dir is internalDir and fallback configured. Key: HDFS-15429 URL: https://issues.apache.org/jira/browse/HDFS-15429

[jira] [Created] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2020-06-23 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15430: -- Summary: create should work when parent dir is internalDir and fallback configured. Key: HDFS-15430 URL: https://issues.apache.org/jira/browse/HDFS-15430

[jira] [Updated] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2020-06-23 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15430: --- Description: create will not work if the parent dir is Internal mount dir (non leaf i

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Target Version/s: 3.3.0, 3.1.4, 3.2.2, 2.10.1 (was: 2.10.1) Labels: release-blocker

[jira] [Resolved] (HDFS-15427) Merged ListStatus with Fallback target filesystem and InternalDirViewFS.

2020-06-23 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-15427. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Thanks a

[jira] [Commented] (HDFS-15427) Merged ListStatus with Fallback target filesystem and InternalDirViewFS.

2020-06-23 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142757#comment-17142757 ] Hudson commented on HDFS-15427: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Created] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occuered

2020-06-23 Thread ludun (Jira)
ludun created HDFS-15431: Summary: Can not read a opening file after NameNode failover if pipeline recover occuered Key: HDFS-15431 URL: https://issues.apache.org/jira/browse/HDFS-15431 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occuered

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15431: - Description: a file with two replications and keep it opening. first it writes to DN1 and DN2. {code} 2020-06-23

[jira] [Commented] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occuered

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142764#comment-17142764 ] ludun commented on HDFS-15431: -- In BlockReceiver we should notifyNamenodeReceivingBlock also

[jira] [Commented] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occuered

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142772#comment-17142772 ] ludun commented on HDFS-15431: -- [~surendrasingh] [~hemanthboyina] please check the issue. >

[jira] [Comment Edited] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occuered

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142772#comment-17142772 ] ludun edited comment on HDFS-15431 at 6/23/20, 9:09 AM: [~surendr

[jira] [Comment Edited] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occured

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142772#comment-17142772 ] ludun edited comment on HDFS-15431 at 6/23/20, 9:11 AM: [~surendr

[jira] [Updated] (HDFS-15431) Can not read a opening file after NameNode failover if pipeline recover occured

2020-06-23 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15431: - Summary: Can not read a opening file after NameNode failover if pipeline recover occured (was: Can not read a op

[jira] [Commented] (HDFS-15425) Review Logging of DFSClient

2020-06-23 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142792#comment-17142792 ] Hongbing Wang commented on HDFS-15425: -- I provide a optional version 002.patch. [~el

[jira] [Updated] (HDFS-15425) Review Logging of DFSClient

2020-06-23 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongbing Wang updated HDFS-15425: - Attachment: HDFS-15425.002.patch > Review Logging of DFSClient > --- > >

[jira] [Commented] (HDFS-15425) Review Logging of DFSClient

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142850#comment-17142850 ] Hadoop QA commented on HDFS-15425: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Attachment: HDFS-15421-000.patch > IBR leak causes standby NN to be stuck in safe mode >

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142884#comment-17142884 ] Akira Ajisaka commented on HDFS-15421: -- {quote}I think we need to update genstamp wh

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142892#comment-17142892 ] Akira Ajisaka commented on HDFS-15421: -- I think HDFS-14941 can be reverted because i

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Attachment: HDFS-15421-001.patch > IBR leak causes standby NN to be stuck in safe mode >

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142925#comment-17142925 ] Akira Ajisaka commented on HDFS-15421: -- Attached a 001 patch to update the global ge

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Assignee: Akira Ajisaka Status: Patch Available (was: Open) > IBR leak causes standby NN t

[jira] [Comment Edited] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142884#comment-17142884 ] Akira Ajisaka edited comment on HDFS-15421 at 6/23/20, 1:33 PM: ---

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Attachment: HDFS-15421.002.patch > IBR leak causes standby NN to be stuck in safe mode >

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142930#comment-17142930 ] Akira Ajisaka commented on HDFS-15421: -- 002 patch * fixed comments in test > IBR le

[jira] [Resolved] (HDFS-13510) Ozone: Fix precommit hook for Ozone/Hdds on trunk

2020-06-23 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDFS-13510. Resolution: Won't Fix > Ozone: Fix precommit hook for Ozone/Hdds on trunk > ---

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143102#comment-17143102 ] Hadoop QA commented on HDFS-15421: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15425) Review Logging of DFSClient

2020-06-23 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143165#comment-17143165 ] Íñigo Goiri commented on HDFS-15425: [^HDFS-15425.002.patch] looks safer. We probably

[jira] [Resolved] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-06-23 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-15383. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > RBF: Disable watch in Z

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-06-23 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143268#comment-17143268 ] Íñigo Goiri commented on HDFS-15383: Thanks [~fengnanli] for the patch and [~hexiaoqi

[jira] [Commented] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

2020-06-23 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143276#comment-17143276 ] Íñigo Goiri commented on HDFS-15416: Thanks [~jianghuazhu] for the update. Please for

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-06-23 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143278#comment-17143278 ] Hudson commented on HDFS-15383: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143296#comment-17143296 ] Konstantin Shvachko commented on HDFS-15421: Good catch [~kihwal], thanks for

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143331#comment-17143331 ] Kihwal Lee commented on HDFS-15421: --- Thanks, [~aajisaka] for the patch. I will also hav

[jira] [Updated] (HDFS-15429) mkdirs should work when parent dir is internalDir and fallback configured.

2020-06-23 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15429: --- Status: Patch Available (was: Open) Updated a PR for review! > mkdirs should work w

[jira] [Commented] (HDFS-15383) RBF: Disable watch in ZKDelegationSecretManager for performance

2020-06-23 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143430#comment-17143430 ] Fengnan Li commented on HDFS-15383: --- Thanks! [~elgoiri] [~hexiaoqiao] > RBF: Disable w

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

2020-06-23 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143435#comment-17143435 ] liusheng commented on HDFS-15098: - Hi [~weichiu], I am so sorry that we have a delay for

[jira] [Comment Edited] (HDFS-15098) Add SM4 encryption method for HDFS

2020-06-23 Thread liusheng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143435#comment-17143435 ] liusheng edited comment on HDFS-15098 at 6/24/20, 1:30 AM: --- Hi

[jira] [Commented] (HDFS-15425) Review Logging of DFSClient

2020-06-23 Thread Hongbing Wang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143456#comment-17143456 ] Hongbing Wang commented on HDFS-15425: -- [~elgoiri] Thanks for your review! > Review

[jira] [Updated] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

2020-06-23 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15416: Attachment: HDFS-15416.001.patch Status: Patch Available (was: In Progress) > DataStorage#

[jira] [Commented] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

2020-06-23 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143483#comment-17143483 ] jianghua zhu commented on HDFS-15416: - [~elgoiri] , thank you very much for your sugg

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2020-06-23 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-13248: Description: NegativeArraySizeException when PROVIDED replication >1 (was: When execute a put oper

[jira] [Updated] (HDFS-13248) RBF: Namenode need to choose block location for the client

2020-06-23 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-13248: Description: When execute a put operation via router, the NameNode will choose block location for

[jira] [Updated] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15421: - Attachment: HDFS-15421.003.patch > IBR leak causes standby NN to be stuck in safe mode >

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143502#comment-17143502 ] Akira Ajisaka commented on HDFS-15421: -- Thanks [~shv] for your review and suggestion

[jira] [Commented] (HDFS-15421) IBR leak causes standby NN to be stuck in safe mode

2020-06-23 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143504#comment-17143504 ] Chen Liang commented on HDFS-15421: --- Thanks for reporting [~kihwal] and thanks [~aajisa

[jira] [Commented] (HDFS-15416) DataStorage#addStorageLocations() should add more reasonable information verification.

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143559#comment-17143559 ] Hadoop QA commented on HDFS-15416: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-15432) RBF: Move cache datanode reports from NamenodeBeanMetrics to RouterRpcServer

2020-06-23 Thread Ye Ni (Jira)
Ye Ni created HDFS-15432: Summary: RBF: Move cache datanode reports from NamenodeBeanMetrics to RouterRpcServer Key: HDFS-15432 URL: https://issues.apache.org/jira/browse/HDFS-15432 Project: Hadoop HDFS