[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.004.patch > In some cases, erasure blocks are corruption when they are reconstruct. > ---

[jira] [Comment Edited] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953450#comment-16953450 ] Ayush Saxena edited comment on HDFS-14847 at 10/17/19 6:59 AM:

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953456#comment-16953456 ] guojh commented on HDFS-14768: -- [~surendrasingh] I put a new patch. Please review it. > In

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953460#comment-16953460 ] Fei Hui commented on HDFS-14802: [~ste...@apache.org][~ayushtkn] Thanks {quote} For rena

[jira] [Commented] (HDFS-14880) Balancer sequence of statistics & exit message is not correct

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953474#comment-16953474 ] Hadoop QA commented on HDFS-14880: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Work logged] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?focusedWorklogId=329714&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329714 ] ASF GitHub Bot logged work on HDDS-2275: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953544#comment-16953544 ] Tsz-wo Sze commented on HDDS-2275: -- Thanks [~hanishakoneru] for reviewing the patch. I h

[jira] [Updated] (HDDS-2275) In BatchOperation.SingleOperation, do not clone byte[]

2019-10-17 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2275: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) > In Bat

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953545#comment-16953545 ] Hadoop QA commented on HDFS-14768: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953568#comment-16953568 ] Li Cheng commented on HDDS-2186: Try to resolve this in [https://github.com/apache/hadoop-

[jira] [Issue Comment Deleted] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Comment: was deleted (was: [https://github.com/apache/hadoop/pull/1431]) > Fix tests using MiniOzoneCluster f

[jira] [Issue Comment Deleted] (HDDS-2186) Fix tests using MiniOzoneCluster for its memory related exceptions

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2186: --- Comment: was deleted (was: [https://github.com/apache/hadoop/pull/1431]) > Fix tests using MiniOzoneCluster f

[jira] [Commented] (HDDS-1569) Add ability to SCM for creating multiple pipelines with same datanode

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953570#comment-16953570 ] Li Cheng commented on HDDS-1569: PR [https://github.com/apache/hadoop-ozone/pull/28] is un

[jira] [Commented] (HDFS-14847) Erasure Coding: Blocks are over-replicated while EC decommissioning

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953571#comment-16953571 ] Hadoop QA commented on HDFS-14847: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14802) The feature of protect directories should be used in RenameOp

2019-10-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953622#comment-16953622 ] Steve Loughran commented on HDFS-14802: --- see "Recursive delete of non-empty root di

[jira] [Assigned] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-17 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Teoh reassigned HDDS-1847: Assignee: Chris Teoh > Datanode Kerberos principal and keytab config key looks inconsistent > -

[jira] [Commented] (HDDS-1570) Refactor heartbeat reports to report all the pipelines that are open

2019-10-17 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953672#comment-16953672 ] Li Cheng commented on HDDS-1570: As I look into this JIRA, I would like discuss some bout

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.004.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues > --

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: (was: HDFS-14852.004.patch) > Remove of LowRedundancyBlocks do NOT remove the block from all

[jira] [Updated] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14852: --- Attachment: HDFS-14852.003.patch > Remove of LowRedundancyBlocks do NOT remove the block from all queues > --

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953703#comment-16953703 ] Fei Hui commented on HDFS-14852: [~kihwal] Thanks Upload v003 patch. Unconditionally try

[jira] [Created] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2318: -- Summary: Avoid proto::tostring in preconditions to save CPU cycles Key: HDDS-2318 URL: https://issues.apache.org/jira/browse/HDDS-2318 Project: Hadoop Distributed

[jira] [Updated] (HDDS-2309) Optimise OzoneManagerDoubleBuffer::flushTransactions to flush in batches

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2309: --- Labels: performance (was: ) > Optimise OzoneManagerDoubleBuffer::flushTransactions to flush i

[jira] [Updated] (HDDS-2301) Write path: Reduce read contention in rocksDB

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2301: --- Labels: performance (was: ) > Write path: Reduce read contention in rocksDB > ---

[jira] [Updated] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2318: --- Labels: performance (was: ) > Avoid proto::tostring in preconditions to save CPU cycles > ---

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-17 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953724#comment-16953724 ] Chris Teoh commented on HDDS-1847: -- I'm unclear on this issue. The bottom 2 keys are HDFS

[jira] [Assigned] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2318: --- Assignee: Bharat Viswanadham > Avoid proto::tostring in preconditions to save CPU cyc

[jira] [Commented] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953743#comment-16953743 ] Mukul Kumar Singh commented on HDDS-2318: - cc [~arp], [~nanda], [~bharat], [~hanis

[jira] [Updated] (HDDS-1985) Fix listVolumes API

2019-10-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-1985: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Fix

[jira] [Work logged] (HDDS-1985) Fix listVolumes API

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1985?focusedWorklogId=329887&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329887 ] ASF GitHub Bot logged work on HDDS-1985: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-2221) Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2221?focusedWorklogId=329888&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-329888 ] ASF GitHub Bot logged work on HDDS-2221: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2221) Monitor datanodes in ozoneperf compose cluster

2019-10-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2221. --- Fix Version/s: 0.5.0 Resolution: Fixed > Monitor datanodes in ozoneperf compose cluster > -

[jira] [Updated] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-14854: - Attachment: HDFS-14854.011.patch > Create improved decommission monitor implementation >

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953828#comment-16953828 ] Stephen O'Donnell commented on HDFS-14854: -- [~elgoiri] I have addressed all the

[jira] [Commented] (HDFS-14852) Remove of LowRedundancyBlocks do NOT remove the block from all queues

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953862#comment-16953862 ] Hadoop QA commented on HDFS-14852: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14810: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953891#comment-16953891 ] Ayush Saxena commented on HDFS-14810: - Committed to trunk. Thanx [~hexiaoqiao] for th

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953892#comment-16953892 ] Íñigo Goiri commented on HDFS-14854: Thanks for the changes, [^HDFS-14854.011.patch]

[jira] [Commented] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953898#comment-16953898 ] Íñigo Goiri commented on HDFS-14909: +1 on [^HDFS-14909.003.patch]. Does anybody kn

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953903#comment-16953903 ] Stephen O'Donnell commented on HDFS-14854: -- Let me have a look at that Configura

[jira] [Commented] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953902#comment-16953902 ] Íñigo Goiri commented on HDFS-14909: I see [~ayushtkn] narrowed it down to HDFS-14492

[jira] [Created] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Jira
Íñigo Goiri created HDFS-14910: -- Summary: TestRenameWithSnapshots#testRename2PreDescendant failing consistently Key: HDFS-14910 URL: https://issues.apache.org/jira/browse/HDFS-14910 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-14887: Attachment: 14887.008.png > RBF: In Router Web UI, Observer Namenode Information displaying

[jira] [Commented] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953904#comment-16953904 ] Íñigo Goiri commented on HDFS-14910: [~ayushsaxena] narrowed it down to HDFS-14492. [

[jira] [Commented] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953907#comment-16953907 ] Hadoop QA commented on HDFS-14887: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-14887) RBF: In Router Web UI, Observer Namenode Information displaying as Unavailable

2019-10-17 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953909#comment-16953909 ] Takanobu Asanuma commented on HDFS-14887: - Thanks for the discussion and updating

[jira] [Commented] (HDFS-14810) Review FSNameSystem editlog sync

2019-10-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953914#comment-16953914 ] Hudson commented on HDFS-14810: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953916#comment-16953916 ] Ayush Saxena commented on HDFS-14910: - The this.removeFeature(..) is getting called t

[jira] [Created] (HDDS-2319) CLI command to perform on-demand data scan of a specific container

2019-10-17 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2319: -- Summary: CLI command to perform on-demand data scan of a specific container Key: HDDS-2319 URL: https://issues.apache.org/jira/browse/HDDS-2319 Project: Hadoop Di

[jira] [Updated] (HDDS-2319) CLI command to perform on-demand data scan of a specific container

2019-10-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2319: --- Description: On-demand data scan for a specific container might be a useful debug tool. Thank

[jira] [Work logged] (HDDS-2240) Command line tool for OM Admin

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2240?focusedWorklogId=330005&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330005 ] ASF GitHub Bot logged work on HDDS-2240: Author: ASF GitHub Bot

[jira] [Commented] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953929#comment-16953929 ] Attila Doroszlai commented on HDDS-2318: Using a supplier with the right {{toStrin

[jira] [Assigned] (HDFS-14910) TestRenameWithSnapshots#testRename2PreDescendant failing consistently

2019-10-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-14910: -- Assignee: Wei-Chiu Chuang > TestRenameWithSnapshots#testRename2PreDescendant failing c

[jira] [Commented] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953943#comment-16953943 ] Hudson commented on HDFS-14909: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Updated] (HDFS-14909) DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-14909: -- Fix Version/s: 3.2.2 3.1.4 3.3.0 Re

[jira] [Work logged] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?focusedWorklogId=330026&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330026 ] ASF GitHub Bot logged work on HDDS-2318: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2318) Avoid proto::tostring in preconditions to save CPU cycles

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2318: - Labels: performance pull-request-available (was: performance) > Avoid proto::tostring in precondi

[jira] [Commented] (HDFS-14384) When lastLocatedBlock token expire, it will take 1~3s second to refetch it.

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953971#comment-16953971 ] Surendra Singh Lilhore commented on HDFS-14384: --- Thanks [~vinayakumarb]  fo

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

2019-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953972#comment-16953972 ] Hadoop QA commented on HDFS-14854: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDDS-2145) Optimize client read path by reading multiple chunks along with block info in a single rpc call.

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2145: --- Assignee: Hanisha Koneru (was: Shashikant Banerjee) > Optimize client read path by r

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16953990#comment-16953990 ] Surendra Singh Lilhore commented on HDFS-14768: --- Thanks [~gjhkael] for path

[jira] [Created] (HDFS-14911) hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError

2019-10-17 Thread bb (Jira)
bb created HDFS-14911: - Summary: hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError Key: HDFS-14911 URL: https://issues.apache.org/jira/browse/HDFS-14911 Project: Hadoop HDFS Iss

[jira] [Created] (HDDS-2320) Negative value seen for OM NumKeys Metric in JMX.

2019-10-17 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-2320: --- Summary: Negative value seen for OM NumKeys Metric in JMX. Key: HDDS-2320 URL: https://issues.apache.org/jira/browse/HDDS-2320 Project: Hadoop Distributed Data S

[jira] [Work logged] (HDDS-2181) Ozone Manager should send correct ACL type in ACL requests to Authorizer

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2181?focusedWorklogId=330077&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330077 ] ASF GitHub Bot logged work on HDDS-2181: Author: ASF GitHub Bot

[jira] [Created] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-17 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-2321: Summary: Ozone Block Token verify should not apply to all datanode cmd Key: HDDS-2321 URL: https://issues.apache.org/jira/browse/HDDS-2321 Project: Hadoop Distributed Data St

[jira] [Updated] (HDFS-14911) hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError

2019-10-17 Thread bb (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bb updated HDFS-14911: -- Description: The hdfs oiv "Delimited" processer is failing as follows: {code:java} root@hostname [/dirname] $ hdfs oiv

[jira] [Updated] (HDFS-14911) hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError

2019-10-17 Thread bb (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bb updated HDFS-14911: -- Issue Type: Bug (was: Wish) > hdfs oiv "Delimited" processer failing with java.lang.UnsatisfiedLinkError > ---

[jira] [Commented] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-17 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954062#comment-16954062 ] Anu Engineer commented on HDDS-2321: Since SCM has the root cert, it might be intresti

[jira] [Commented] (HDDS-2320) Negative value seen for OM NumKeys Metric in JMX.

2019-10-17 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954076#comment-16954076 ] Aravindan Vijayan commented on HDDS-2320: - cc [~hanishakoneru] / [~bharat] > Nega

[jira] [Updated] (HDDS-2181) Ozone Manager should send correct ACL type in ACL requests to Authorizer

2019-10-17 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-2181: - Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone

[jira] [Updated] (HDDS-2310) Add support to add ozone ranger plugin to Ozone Manager classpath

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2310: - Labels: pull-request-available (was: ) > Add support to add ozone ranger plugin to Ozone Manager

[jira] [Work logged] (HDDS-2310) Add support to add ozone ranger plugin to Ozone Manager classpath

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2310?focusedWorklogId=330126&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330126 ] ASF GitHub Bot logged work on HDDS-2310: Author: ASF GitHub Bot

[jira] [Created] (HDFS-14912) Default dfs.image.string-tables.expanded to false in branch-2.7

2019-10-17 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-14912: - Summary: Default dfs.image.string-tables.expanded to false in branch-2.7 Key: HDFS-14912 URL: https://issues.apache.org/jira/browse/HDFS-14912 Project: Hadoop HDFS

[jira] [Updated] (HDFS-14912) Default dfs.image.string-tables.expanded to false in branch-2.7

2019-10-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14912: -- Attachment: HDFS-14912.001.branch-2.7.patch Status: Patch Available (was: Open) > Default dfs.

[jira] [Updated] (HDFS-14912) Set dfs.image.string-tables.expanded default config value to false in branch-2.7

2019-10-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14912: -- Summary: Set dfs.image.string-tables.expanded default config value to false in branch-2.7 (was: Defaul

[jira] [Updated] (HDFS-14912) Set dfs.image.string-tables.expanded default to false in branch-2.7

2019-10-17 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-14912: -- Summary: Set dfs.image.string-tables.expanded default to false in branch-2.7 (was: Set dfs.image.strin

[jira] [Work logged] (HDDS-2254) Fix flaky unit testTestContainerStateMachine#testRatisSnapshotRetention

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2254?focusedWorklogId=330168&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330168 ] ASF GitHub Bot logged work on HDDS-2254: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2254) Fix flaky unit testTestContainerStateMachine#testRatisSnapshotRetention

2019-10-17 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-2254. Fix Version/s: 0.5.0 Resolution: Fixed Committed to the master branch. > Fix flaky unit test

[jira] [Assigned] (HDDS-2320) Negative value seen for OM NumKeys Metric in JMX.

2019-10-17 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-2320: --- Assignee: Aravindan Vijayan > Negative value seen for OM NumKeys Metric in JMX. > ---

[jira] [Updated] (HDDS-2131) Optimize replication type and creation time calculation in S3 MPU list call

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2131: - Labels: pull-request-available (was: ) > Optimize replication type and creation time calculation

[jira] [Work logged] (HDDS-2131) Optimize replication type and creation time calculation in S3 MPU list call

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2131?focusedWorklogId=330179&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330179 ] ASF GitHub Bot logged work on HDDS-2131: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2322) DoubleBuffer flush termination and OM shutdown's after that.

2019-10-17 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2322: - Summary: DoubleBuffer flush termination and OM shutdown's after that. (was: DoubleBuffer

[jira] [Assigned] (HDDS-2322) DoubleBuffer flush termination and OM is shutdown

2019-10-17 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2322: Assignee: Bharat Viswanadham > DoubleBuffer flush termination and OM is shutdown >

[jira] [Created] (HDDS-2322) DoubleBuffer flush termination and OM is shutdown

2019-10-17 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2322: Summary: DoubleBuffer flush termination and OM is shutdown Key: HDDS-2322 URL: https://issues.apache.org/jira/browse/HDDS-2322 Project: Hadoop Distributed Data

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954183#comment-16954183 ] guojh commented on HDFS-14768: -- [~surendrasingh] Thanks for your review. I don't understand

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.004.patch > In some cases, erasure blocks are corruption when they are reconstruct. > ---

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.004.patch) > In some cases, erasure blocks are corruption when they are reconst

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.005.patch > In some cases, erasure blocks are corruption when they are reconstruct. > ---

[jira] [Commented] (HDFS-14699) Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954193#comment-16954193 ] guojh commented on HDFS-14699: -- [~zhaoyim] [~surendrasingh] In you test case, why you set th

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.006.patch > In some cases, erasure blocks are corruption when they are reconstruct. > ---

[jira] [Commented] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954202#comment-16954202 ] guojh commented on HDFS-14768: -- [~surendrasingh] I put a new path06, please review it. > In

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: (was: HDFS-14768.006.patch) > In some cases, erasure blocks are corruption when they are reconst

[jira] [Updated] (HDFS-14768) In some cases, erasure blocks are corruption when they are reconstruct.

2019-10-17 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Attachment: HDFS-14768.006.patch > In some cases, erasure blocks are corruption when they are reconstruct. > ---

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-17 Thread Supratim Deka (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Supratim Deka updated HDDS-2208: Status: Patch Available (was: Open) > Propagate System Exceptions from OM transaction apply phase >

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2323: --- Component/s: Ozone Manager > Mem allocation: Optimise AuditMessage::build() >

[jira] [Created] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HDDS-2323: -- Summary: Mem allocation: Optimise AuditMessage::build() Key: HDDS-2323 URL: https://issues.apache.org/jira/browse/HDDS-2323 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Rajesh Balamohan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HDDS-2323: --- Labels: performance (was: ) > Mem allocation: Optimise AuditMessage::build() > --

[jira] [Commented] (HDDS-2323) Mem allocation: Optimise AuditMessage::build()

2019-10-17 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954221#comment-16954221 ] Mukul Kumar Singh commented on HDDS-2323: - cc: [~dchitlangia] > Mem allocation: O

[jira] [Updated] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2311: - Labels: pull-request-available (was: ) > Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

[jira] [Work logged] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?focusedWorklogId=330261&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-330261 ] ASF GitHub Bot logged work on HDDS-2311: Author: ASF GitHub Bot

  1   2   >