[jira] [Commented] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040602#comment-17040602 ] Hadoop QA commented on HDFS-15185: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040576#comment-17040576 ] Konstantin Shvachko commented on HDFS-15185: New segments are added via {{Sta

[jira] [Updated] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15185: --- Release Note: New segments are added via {{StartupProgress.setTotal()}}, which adds s

[jira] [Updated] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15185: --- Release Note: (was: New segments are added via {{StartupProgress.setTotal()}}, whic

[jira] [Updated] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15185: --- Attachment: HDFS-15185.001.patch > StartupProgress reports edits segments until the e

[jira] [Comment Edited] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040562#comment-17040562 ] Konstantin Shvachko edited comment on HDFS-15185 at 2/20/20 1:56 AM: --

[jira] [Commented] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040562#comment-17040562 ] Konstantin Shvachko commented on HDFS-15185: HDFS-14500 tried to fix it, but

[jira] [Created] (HDFS-15185) StartupProgress reports edits segments until the entire startup completes

2020-02-19 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-15185: -- Summary: StartupProgress reports edits segments until the entire startup completes Key: HDFS-15185 URL: https://issues.apache.org/jira/browse/HDFS-15185 P

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-02-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040507#comment-17040507 ] Kihwal Lee commented on HDFS-15115: --- In your test, {code} repl.chooseRandom(1, "/", ex

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-02-19 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040398#comment-17040398 ] Yuval Degani commented on HDFS-15115: - Thanks, [~ayushtkn]! > Namenode crash caused

[jira] [Commented] (HDFS-15165) In Du missed calling getAttributesProvider

2020-02-19 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040380#comment-17040380 ] Hudson commented on HDFS-15165: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040377#comment-17040377 ] Hadoop QA commented on HDFS-15159: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15165) In Du missed calling getAttributesProvider

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040372#comment-17040372 ] Íñigo Goiri commented on HDFS-15165: Thanks [~bharat] for the patch and [~sodonnell]

[jira] [Updated] (HDFS-15165) In Du missed calling getAttributesProvider

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15165: --- Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15165) In Du missed calling getAttributesProvider

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040361#comment-17040361 ] Íñigo Goiri commented on HDFS-15165: +1 on [^HDFS-15165.01.patch]. Committing. > In

[jira] [Commented] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040354#comment-17040354 ] Íñigo Goiri commented on HDFS-15176: +1 on [^HDFS-15176.004.patch]. > Enable GcTime

[jira] [Commented] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040351#comment-17040351 ] Íñigo Goiri commented on HDFS-15159: We definitely need a test here. > Prevent addin

[jira] [Commented] (HDFS-14731) [FGL] Remove redundant locking on NameNode.

2020-02-19 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040325#comment-17040325 ] Yuval Degani commented on HDFS-14731: - [~shv], the patch LGTM. This a great step in u

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040323#comment-17040323 ] Siddharth Wagle commented on HDFS-15154: I realized that the deprecated key is no

[jira] [Comment Edited] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040323#comment-17040323 ] Siddharth Wagle edited comment on HDFS-15154 at 2/19/20 6:38 PM: --

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040280#comment-17040280 ] Ahmed Hussein commented on HDFS-15149: -- Hi [~leosun08], {{TestDeadNodeDetection}} i

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040277#comment-17040277 ] Íñigo Goiri commented on HDFS-15149: I was referring to syncing through interruptions

[jira] [Created] (HDFS-15184) Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-hdfs-native-client: An Ant BuildException has occured: exec returned:

2020-02-19 Thread Jira
任建亭 created HDFS-15184: -- Summary: Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (make) on project hadoop-hdfs-native-client: An Ant BuildException has occured: exec returned: 1 Key: HDFS-15184

[jira] [Updated] (HDFS-14816) TestFileCorruption#testCorruptionWithDiskFailure logic is not correct

2020-02-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-14816: - Resolution: Not A Problem Status: Resolved (was: Patch Available) > TestFileCorruption#t

[jira] [Updated] (HDFS-15159) Prevent adding same DN multiple times in PendingReconstructionBlocks

2020-02-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15159: - Attachment: HDFS-15159.001.patch Status: Patch Available (was: Open) > Prevent adding sa

[jira] [Created] (HDFS-15183) For AzureNativeFS, when BlockCompaction is enabled, FileSystem.create(path).close() would throw exception.

2020-02-19 Thread Xiaolei Liu (Jira)
Xiaolei Liu created HDFS-15183: -- Summary: For AzureNativeFS, when BlockCompaction is enabled, FileSystem.create(path).close() would throw exception. Key: HDFS-15183 URL: https://issues.apache.org/jira/browse/HDFS-151

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040235#comment-17040235 ] Hadoop QA commented on HDFS-15149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-15182) TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040199#comment-17040199 ] Hadoop QA commented on HDFS-15182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-02-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040179#comment-17040179 ] Ayush Saxena commented on HDFS-15115: - Cherry-picked to branch-2.10 > Namenode crash

[jira] [Updated] (HDFS-15115) Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug

2020-02-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15115: Fix Version/s: 2.10.1 > Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamicall

[jira] [Commented] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040167#comment-17040167 ] Hadoop QA commented on HDFS-15176: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15181) Webhdfs getTrashRoot() causes internal AccessControlException

2020-02-19 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15181: -- Resolution: Duplicate Status: Resolved (was: Patch Available) Duping this to HDFS-15052. > We

[jira] [Updated] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15149: --- Attachment: HDFS-15149-002.patch > TestDeadNodeDetection test cases time-out > --

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040027#comment-17040027 ] Lisheng Sun commented on HDFS-15149: hi [~elgoiri] {quote} I like the rest of the sol

[jira] [Commented] (HDFS-15149) TestDeadNodeDetection test cases time-out

2020-02-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040025#comment-17040025 ] Lisheng Sun commented on HDFS-15149: Thank [~ahussein] for your suggestion. {quote} T

[jira] [Commented] (HDFS-15177) Split datanode invalide block deletion, to avoid the FsDatasetImpl lock too much time.

2020-02-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17040016#comment-17040016 ] Stephen O'Donnell commented on HDFS-15177: -- The FoldedTreeSet structure is used

[jira] [Commented] (HDFS-15182) TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk

2020-02-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039993#comment-17039993 ] Lisheng Sun commented on HDFS-15182: the v002 fixed it in @Before. > TestBlockManage

[jira] [Updated] (HDFS-15182) TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk

2020-02-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-15182: --- Attachment: HDFS-15182-002.patch > TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk >

[jira] [Commented] (HDFS-15167) Block Report Interval shouldn't be reset apart from first Block Report

2020-02-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039928#comment-17039928 ] Ayush Saxena commented on HDFS-15167: - Thanx [~elgoiri] for the review!!! [~surendras

[jira] [Commented] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-19 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039927#comment-17039927 ] Jinglun commented on HDFS-15176: Hi [~elgoiri], thanks your nice and detailed comments !

[jira] [Updated] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-19 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15176: --- Attachment: HDFS-15176.004.patch Status: Patch Available (was: Open) > Enable GcTimePercentage Metri

[jira] [Updated] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-19 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15176: --- Status: Open (was: Patch Available) > Enable GcTimePercentage Metric in NameNode's JvmMetrics. > ---

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039912#comment-17039912 ] Hadoop QA commented on HDFS-15154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15165) In Du missed calling getAttributesProvider

2020-02-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039902#comment-17039902 ] Stephen O'Donnell commented on HDFS-15165: -- The 01 patch LGTM. Non-binding +1.

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039897#comment-17039897 ] Hadoop QA commented on HDFS-15120: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2020-02-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10659: - Fix Version/s: 2.10.1 2.9.3 Cherry-picked to branch-2.10 and branch-2.9. The l

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2020-02-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039839#comment-17039839 ] Akira Ajisaka commented on HDFS-10659: -- Our production cluster faced this issue toda

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039821#comment-17039821 ] Hadoop QA commented on HDFS-15154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17039720#comment-17039720 ] Siddharth Wagle edited comment on HDFS-15154 at 2/19/20 8:29 AM: --

[jira] [Updated] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

2020-02-19 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDFS-15154: --- Attachment: HDFS-15154.04.patch > Allow only hdfs superusers the ability to assign HDFS stora