[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: (was: HDFS-13078-HDFS-7240.005.patch) > Ozone: Update Ratis on Ozone to 0.

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.005.patch > Ozone: Update Ratis on Ozone to 0.1.1-alpha-8

[jira] [Commented] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368807#comment-16368807 ] genericqa commented on HDFS-13078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Resolved] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Sakhuja resolved HDFS-13139. - Resolution: Workaround HDP default configuration had calculated non-HDFS reserved storage

[jira] [Issue Comment Deleted] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Sakhuja updated HDFS-13139: Comment: was deleted (was: HDP default configuration had calculated non-HDFS reserved storag

[jira] [Comment Edited] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368797#comment-16368797 ] Abhishek Sakhuja edited comment on HDFS-13139 at 2/19/18 5:32 AM: --

[jira] [Commented] (HDFS-13139) Default HDFS as Azure WASB tries rebalancing datanode data to HDFS (0% capacity) and fails

2018-02-18 Thread Abhishek Sakhuja (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368797#comment-16368797 ] Abhishek Sakhuja commented on HDFS-13139: - HDP default configuration had calculate

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368778#comment-16368778 ] Hudson commented on HDFS-12998: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13078: --- Hadoop Flags: Reviewed +1 the 005 patch looks good. Thanks, Mukul. > Ozone: Update R

[jira] [Updated] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12998: --- Resolution: Fixed Fix Version/s: 3.2.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368762#comment-16368762 ] Tsz Wo Nicholas Sze commented on HDFS-12998: +1 the 003 patch looks good. > S

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.005.patch > Ozone: Update Ratis on Ozone to 0.1.1-alpha-8

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-02-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368689#comment-16368689 ] Konstantin Shvachko commented on HDFS-12977: I agree try/finally look excessiv

[jira] [Commented] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368688#comment-16368688 ] genericqa commented on HDFS-13167: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368687#comment-16368687 ] genericqa commented on HDFS-13078: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368685#comment-16368685 ] Íñigo Goiri edited comment on HDFS-13168 at 2/18/18 10:02 PM: --

[jira] [Commented] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368685#comment-16368685 ] Íñigo Goiri commented on HDFS-13168: [~belugabehr], do you have any approximate perfor

[jira] [Commented] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368684#comment-16368684 ] genericqa commented on HDFS-13168: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13168: --- Description: {{ArrayDeque}} {quote}This class is likely to be faster than Stack when used as a stack,

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13168: --- Environment: (was: {{ArrayDeque}} {quote}This class is likely to be faster than Stack when used as

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368648#comment-16368648 ] Rakesh R edited comment on HDFS-10285 at 2/18/18 7:37 PM: -- We hav

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368648#comment-16368648 ] Rakesh R commented on HDFS-10285: - We have worked on the comments and following is quick u

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13168: --- Status: Patch Available (was: Open) > XmlImageVisitor - Prefer Array over LinkedList > --

[jira] [Updated] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13168: --- Attachment: HDFS-13168.1.patch > XmlImageVisitor - Prefer Array over LinkedList >

[jira] [Created] (HDFS-13168) XmlImageVisitor - Prefer Array over LinkedList

2018-02-18 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-13168: -- Summary: XmlImageVisitor - Prefer Array over LinkedList Key: HDFS-13168 URL: https://issues.apache.org/jira/browse/HDFS-13168 Project: Hadoop HDFS Issue Type: Im

[jira] [Commented] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368627#comment-16368627 ] Íñigo Goiri commented on HDFS-13167: Pending Yetus for [^HDFS-13167.1.patch], this loo

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Description: Presently {{#getLiveDatanodeStorageReport()}} is fetched for every file and does the computati

[jira] [Commented] (HDFS-12998) SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368622#comment-16368622 ] genericqa commented on HDFS-12998: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Description: Presently {{#getLiveDatanodeStorageReport()}} is fetched for every file and does the computati

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: (was: MAPREDUCE-7031.2.patch) > DatanodeAdminManager Improvements > --

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: MAPREDUCE-7031.2.patch > DatanodeAdminManager Improvements > -

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Attachment: HDFS-13167.1.patch > DatanodeAdminManager Improvements > -

[jira] [Updated] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13167: --- Status: Patch Available (was: Open) > DatanodeAdminManager Improvements > ---

[jira] [Created] (HDFS-13167) DatanodeAdminManager Improvements

2018-02-18 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created HDFS-13167: -- Summary: DatanodeAdminManager Improvements Key: HDFS-13167 URL: https://issues.apache.org/jira/browse/HDFS-13167 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-02-18 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13166: --- Summary: [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls Key: HDFS-13166 URL: https://issues.apache.org/jira/browse/HDFS-13

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads (>4M) from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Summary: Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk

[jira] [Updated] (HDFS-13078) Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk reads from Datanodes

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Summary: Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT, to fix large chunk

[jira] [Updated] (HDFS-13078) Ozone: Ratis read fail because stream is closed before the reply is received

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-13078: - Attachment: HDFS-13078-HDFS-7240.004.patch > Ozone: Ratis read fail because stream is clos

[jira] [Commented] (HDFS-13078) Ozone: Ratis read fail because stream is closed before the reply is received

2018-02-18 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368606#comment-16368606 ] Mukul Kumar Singh commented on HDFS-13078: -- I have uploaded the v4 patch which fi

[jira] [Updated] (HDFS-13157) Do Not Remove Blocks Sequentially During Decommission

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13157: --- Summary: Do Not Remove Blocks Sequentially During Decommission (was: Do Not Remove Blocks Sequential

[jira] [Updated] (HDFS-13157) Do Not Remove Blocks Sequentially During Dec omission

2018-02-18 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-13157: --- Description: >From what I understand of [DataNode >decommissioning|https://github.com/apache/hadoop/b

[jira] [Commented] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368526#comment-16368526 ] genericqa commented on HDFS-13165: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-02-18 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16368474#comment-16368474 ] genericqa commented on HDFS-6092: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Status: Patch Available (was: Open) Attached initial patch to get early feedback. Appreciate review help. T

[jira] [Updated] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13165: Attachment: HDFS-13165-HDFS-10285-00.patch > [SPS]: Collects successfully moved block details via IBR >

[jira] [Assigned] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-13165: --- Assignee: Rakesh R > [SPS]: Collects successfully moved block details via IBR > -

[jira] [Created] (HDFS-13165) [SPS]: Collects successfully moved block details via IBR

2018-02-18 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13165: --- Summary: [SPS]: Collects successfully moved block details via IBR Key: HDFS-13165 URL: https://issues.apache.org/jira/browse/HDFS-13165 Project: Hadoop HDFS Issue Type