[jira] [Assigned] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-09-11 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-12310: - Assignee: Surendra Singh Lilhore > [SPS]: Provide an option to track the

[jira] [Comment Edited] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2017-09-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16155977#comment-16155977 ] Ravi Prakash edited comment on HDFS-6489 at 9/12/17 5:50 AM: - Thanks for your

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Patch Available (was: Open) > Ensure to use CLI command to enable/disable erasure coding policy

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Status: Open (was: Patch Available) > Ensure to use CLI command to enable/disable erasure coding policy

[jira] [Commented] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162497#comment-16162497 ] Hadoop QA commented on HDFS-12414: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162443#comment-16162443 ] Weiwei Yang commented on HDFS-12423: Thanks for filing this [~linyiqun], this is a good improvement to

[jira] [Updated] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12423: - Description: TopN container choosing policy should ignore unnecessary containers. Currently TopN policy

[jira] [Created] (HDFS-12423) Ozone: TopN container choosing policy should ignore unnecessary containers

2017-09-11 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12423: Summary: Ozone: TopN container choosing policy should ignore unnecessary containers Key: HDFS-12423 URL: https://issues.apache.org/jira/browse/HDFS-12423 Project: Hadoop

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11676: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162435#comment-16162435 ] Weiwei Yang commented on HDFS-12389: Thanks [~anu] for the quick review, I have committed this to the

[jira] [Updated] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12389: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162432#comment-16162432 ] Weiwei Yang commented on HDFS-12389: Thanks for the +1 [~anu], I am going to commit this shortly.

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exists

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Description: Disable NameNode format to avoid accidental formatting of Namenode in production cluster.

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exists

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Summary: Disable Namenode format when data already exists (was: Disallow Namenode format when data

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch > Ensure to use CLI command to enable/disable erasure coding policy >

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162422#comment-16162422 ] Anu Engineer commented on HDFS-12389: - +1, Thanks for fixing this. That was a dumb mistake. Really

[jira] [Commented] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162393#comment-16162393 ] Weiwei Yang commented on HDFS-12328: Hi [~yuanbo] Thanks for updating the description, I noticed that

[jira] [Updated] (HDFS-12017) Ozone: Container: Move IPC port to 98xx range

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-12017: Priority: Major (was: Trivial) > Ozone: Container: Move IPC port to 98xx range >

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: (was: HDFS-12414.002.patch) > Ensure to use CLI command to enable/disable erasure coding

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162413#comment-16162413 ] Weiwei Yang commented on HDFS-12389: Hi [~anu], [~linyiqun], [~vagarychen] Excuse me for

[jira] [Updated] (HDFS-12414) Ensure to use CLI command to enable/disable erasure coding policy

2017-09-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12414: - Attachment: HDFS-12414.002.patch 1. fix style issues 2. fix failed unit tests > Ensure to use CLI

[jira] [Resolved] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11772. - Resolution: Duplicate > Ozone: KSM: set creationTime for volume/bucket/key >

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162405#comment-16162405 ] Anu Engineer commented on HDFS-11772: - [~linyiqun] Thank you. I will resolve this issue now. > Ozone:

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162399#comment-16162399 ] Yiqun Lin commented on HDFS-11772: -- I have add creation time for volume/bucket/key, more details can see

[jira] [Comment Edited] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162399#comment-16162399 ] Yiqun Lin edited comment on HDFS-11772 at 9/12/17 2:32 AM: --- I have added

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162386#comment-16162386 ] Yiqun Lin commented on HDFS-11676: -- Also +1 from me. > Ozone: SCM CLI: Implement close container command

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12328: --- Priority: Major (was: Critical) > Ozone: Purge metadata of deleted blocks after max retry times >

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

2017-09-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162384#comment-16162384 ] Konstantin Shvachko commented on HDFS-12323: The change looks good you are increasing timeout

[jira] [Commented] (HDFS-12420) Disallow Namenode format when data already exists

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162364#comment-16162364 ] Hadoop QA commented on HDFS-12420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162365#comment-16162365 ] Weiwei Yang commented on HDFS-11676: +1 on the v3 patch, thanks [~vagarychen] for the patch and

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162331#comment-16162331 ] Hadoop QA commented on HDFS-12409: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162330#comment-16162330 ] Weiwei Yang commented on HDFS-12098: Hi [~anu], [~vagarychen] Thanks for revisiting this, I could not

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > Ozone: Datanode is

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Affects Version/s: HDFS-7240 > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-09-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12098: --- Fix Version/s: HDFS-7240 > Ozone: Datanode is unable to register with scm if scm starts later >

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162329#comment-16162329 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for working on this, I took a look at the 005

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162324#comment-16162324 ] Hadoop QA commented on HDFS-12407: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162313#comment-16162313 ] Hadoop QA commented on HDFS-11676: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11612) Ozone: Cleanup Checkstyle issues

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-11612: --- Assignee: Shashikant Banerjee > Ozone: Cleanup Checkstyle issues >

[jira] [Assigned] (HDFS-11613) Ozone: Cleanup findbugs issues

2017-09-11 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-11613: --- Assignee: Lokesh Jain > Ozone: Cleanup findbugs issues >

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162298#comment-16162298 ] Hadoop QA commented on HDFS-12409: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162278#comment-16162278 ] Hadoop QA commented on HDFS-12417: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162260#comment-16162260 ] Ruslan Dautkhanov commented on HDFS-11851: -- [~jzhuge], I have following exception that matches

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162252#comment-16162252 ] John Zhuge commented on HDFS-11851: --- This fixes a deadlock introduced by HDFS-11529 which is only in

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162251#comment-16162251 ] Ruslan Dautkhanov commented on HDFS-11851: -- Would it be possible to backport this patch to HDFS

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162248#comment-16162248 ] Hadoop QA commented on HDFS-12349: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12420) Disallow Namenode format when data already exists

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12420: - Description: Disallow NameNode format to avoid accidental formatting of Namenode in production

[jira] [Commented] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162244#comment-16162244 ] Hadoop QA commented on HDFS-12422: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12420) Disallow Namenode format when data already exists

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12420: - Summary: Disallow Namenode format when data already exists (was: Disable Namenode format when

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Status: Patch Available (was: Open) > Disable Namenode format when data already exist >

[jira] [Work started] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12420 started by Ajay Kumar. - > Disable Namenode format when data already exist >

[jira] [Work stopped] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12420 stopped by Ajay Kumar. - > Disable Namenode format when data already exist >

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Attachment: HDFS-12420.01.patch > Disable Namenode format when data already exist >

[jira] [Commented] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162208#comment-16162208 ] Andrew Wang commented on HDFS-12412: While I was looking at this a little more, I noticed that

[jira] [Commented] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162204#comment-16162204 ] Andrew Wang commented on HDFS-12412: Thanks for working on this Eddy. I did a grep for the removed

[jira] [Updated] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12409: - Attachment: HDFS-12409.01.patch Fix checkstyle warnings. The findbug warnings are not relevant

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162192#comment-16162192 ] Chris Douglas commented on HDFS-11600: -- bq. I posted an alternative disable patch on HDFS-12417 Sure.

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: HDFS-11676-HDFS-7240.003.patch v003 patch to rebase. > Ozone: SCM CLI: Implement close

[jira] [Commented] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162167#comment-16162167 ] Hadoop QA commented on HDFS-11676: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12412) Remove ErasureCodingWorker.stripedReadPool

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12412: - Attachment: HDFS-12412.00.patch Change {{stripedReadPool}} to an unbound {{cacheThreadPool}}.

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: HDFS-11676-HDFS-7240.002.patch > Ozone: SCM CLI: Implement close container command >

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: (was: HDFS-11676-HDFS-7240.002.patch) > Ozone: SCM CLI: Implement close container

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11676: -- Attachment: HDFS-11676-HDFS-7240.002.patch Thanks [~linyiqun] for the review and the comments, very

[jira] [Issue Comment Deleted] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12417: -- Comment: was deleted (was: Hi Andrew, There is a problem with this patch, it is causing

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162142#comment-16162142 ] Bharat Viswanadham commented on HDFS-12417: --- Hi Andrew, There is a problem with this patch, it

[jira] [Assigned] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-12417: -- Assignee: Andrew Wang > Disable flaky TestDFSStripedOutputStreamWithFailure >

[jira] [Updated] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-11600: - Status: Open (was: Patch Available) > Refactor TestDFSStripedOutputStreamWithFailure test

[jira] [Commented] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162130#comment-16162130 ] Chris Douglas commented on HDFS-12417: -- If the other tests are still relevant and stable, then sure,

[jira] [Updated] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12406: -- Release Note: (was: Thanks [~nandakumar131] for the contribution and [~hkoneru] for the review! +1 on

[jira] [Updated] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12406: - Fix Version/s: 3.1.0 > dfsadmin command prints "Exception encountered" even if there is no >

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162123#comment-16162123 ] Arpit Agarwal commented on HDFS-12407: -- Thanks [~ajayydv]! +1 pending Jenkins. > Journal nodes

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162122#comment-16162122 ] Andrew Wang commented on HDFS-11600: I posted an alternative disable patch on HDFS-12417. I don't

[jira] [Updated] (HDFS-12417) Disable flaky TestDFSStripedOutputStreamWithFailure

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12417: --- Attachment: HDFS-12417.002.patch Here's a patch which uses {{assume}} to skip the tests that I've

[jira] [Commented] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162109#comment-16162109 ] Hudson commented on HDFS-12406: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12837 (See

[jira] [Assigned] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12420: - Assignee: Ajay Kumar > Disable Namenode format when data already exist >

[jira] [Updated] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12407: -- Attachment: HDFS-12407.03.patch > Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162105#comment-16162105 ] Ajay Kumar commented on HDFS-12407: --- [~arpitagarwal], Thanks for review. Uploaded new patch with

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162101#comment-16162101 ] Rushabh S Shah commented on HDFS-12386: --- None of the test failures are related to the patch. There

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12258: --- Release Note: `hdfs ec -listPolicies` now lists enabled, disabled, and removed policies, rather

[jira] [Commented] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162087#comment-16162087 ] Chen Liang commented on HDFS-12406: --- Thanks [~nandakumar131] for the contribution and [~hkoneru] for the

[jira] [Updated] (HDFS-12406) dfsadmin command prints "Exception encountered" even if there is no exception, when debug is enabled

2017-09-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12406: -- Resolution: Fixed Release Note: Thanks [~nandakumar131] for the contribution and [~hkoneru] for

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162074#comment-16162074 ] Chris Douglas commented on HDFS-11600: -- Evidently there's a whole suite of tests using this pattern.

[jira] [Commented] (HDFS-12407) Journal nodes fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162048#comment-16162048 ] Arpit Agarwal commented on HDFS-12407: -- The patch lgtm. Can you please add a comment in the test case

[jira] [Commented] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162045#comment-16162045 ] Hadoop QA commented on HDFS-11600: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Description: Disable NameNode format to avoid accidental formatting of Namenode in production cluster.

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline when waiting for Last Packet fails

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Summary: Replace DataNode in Pipeline when waiting for Last Packet fails (was: Replace

[jira] [Assigned] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11468: --- Assignee: Yiqun Lin (was: Xiaoyu Yao) > Ozone: SCM: Add Node Metrics for SCM >

[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11468: Labels: OzonePostMerge (was: ozoneMerge) > Ozone: SCM: Add Node Metrics for SCM >

[jira] [Assigned] (HDFS-11613) Ozone: Cleanup findbugs issues

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11613: --- Assignee: (was: Anu Engineer) > Ozone: Cleanup findbugs issues >

[jira] [Assigned] (HDFS-11612) Ozone: Cleanup Checkstyle issues

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11612: --- Assignee: (was: Anu Engineer) > Ozone: Cleanup Checkstyle issues >

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11676: Labels: OzonePostMerge tocheck (was: ozoneMerge tocheck) > Ozone: SCM CLI: Implement close

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Status: Patch Available (was: Reopened) > Improve log message when it could not alloc enough

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-11 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Attachment: HDFS-12349.03.patch Rework to fix test failures and checkstyle warnings. > Improve

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Description: # Create a file with replicationFactor = 4, minReplicas = 2 # Fail waiting for the

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Description: # Create a file with replicationFactor = 4, minReplicas = 2 # Fail waiting for the

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Labels: hdfs (was: ) Status: Patch Available (was: In Progress) > Replace DataNode in

[jira] [Commented] (HDFS-11772) Ozone: KSM: set creationTime for volume/bucket/key

2017-09-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162018#comment-16162018 ] Anu Engineer commented on HDFS-11772: - [~msingh]/ [~linyiqun] Can any of you please comment on this

[jira] [Work started] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12422 started by Lukas Majercak. - > Replace DataNode in Pipeline for Last Packet >

[jira] [Updated] (HDFS-12422) Replace DataNode in Pipeline for Last Packet

2017-09-11 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-12422: -- Attachment: HDFS-12422.001.patch > Replace DataNode in Pipeline for Last Packet >

[jira] [Assigned] (HDFS-12420) Disable Namenode format when data already exist

2017-09-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-12420: Assignee: (was: Ajay Kumar) Hadoop Flags: Incompatible change > Disable

  1   2   3   >