[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343701#comment-15343701 ] Hadoop QA commented on HDFS-10342: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work started] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10557 started by Arpit Agarwal. > Fix handling of the -fs Generic option >

[jira] [Created] (HDFS-10557) Fix handling of the -fs Generic option

2016-06-21 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-10557: Summary: Fix handling of the -fs Generic option Key: HDFS-10557 URL: https://issues.apache.org/jira/browse/HDFS-10557 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343691#comment-15343691 ] Hadoop QA commented on HDFS-10555: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343680#comment-15343680 ] Hadoop QA commented on HDFS-10473: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343673#comment-15343673 ] Hadoop QA commented on HDFS-10460: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343655#comment-15343655 ] Hadoop QA commented on HDFS-10551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.002.patch Updated patch for checkstyle issues. Test failures except

[jira] [Updated] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10555: --- Status: Patch Available (was: Open) > Unable to loadFSEdits due to a failure in

[jira] [Updated] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10555: --- Attachment: HDFS-10555-00.patch I have just attached a simple patch to fix this. >

[jira] [Updated] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10473: --- Attachment: HDFS-10473-05.patch Thanks a lot, [~jingzhao] for the quick review. Yup,

[jira] [Updated] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10460: Attachment: HDFS-10460-03.patch Attached new patch fixing checkstyle warning. > Erasure Coding: Recompute

[jira] [Commented] (HDFS-7597) DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping

2016-06-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343202#comment-15343202 ] Hudson commented on HDFS-7597: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9998 (See

[jira] [Updated] (HDFS-7597) DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping

2016-06-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7597: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10551: Attachment: HDFS-10551-HDFS-1312.002.patch Along with HDFS-10550, this patch fixes all Unit test

[jira] [Updated] (HDFS-7597) DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping

2016-06-21 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7597: Labels: (was: BB2015-05-TBR) Summary: DelegationTokenIdentifier should cache the

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-21 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343193#comment-15343193 ] Kai Sasaki commented on HDFS-10534: --- [~zhz] Since several configurations in FSNamesystem are {{final}}

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343186#comment-15343186 ] Jing Zhao commented on HDFS-10473: -- Thanks for updating the patch, Uma. The latest patch looks pretty

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-21 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343157#comment-15343157 ] Kai Sasaki commented on HDFS-10534: --- Though checkstyle seems to be broken before attaching this patch,

[jira] [Updated] (HDFS-9343) Empty caller context considered invalid

2016-06-21 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9343: Issue Type: Sub-task (was: Task) Parent: HDFS-9184 > Empty caller context considered

[jira] [Created] (HDFS-10556) DistCpOptions should be validated automatically

2016-06-21 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10556: Summary: DistCpOptions should be validated automatically Key: HDFS-10556 URL: https://issues.apache.org/jira/browse/HDFS-10556 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343118#comment-15343118 ] Uma Maheswara Rao G edited comment on HDFS-10473 at 6/22/16 12:46 AM: --

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343118#comment-15343118 ] Uma Maheswara Rao G commented on HDFS-10473: I have just filed a JIRA for failures: HDFS-10555

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343114#comment-15343114 ] Uma Maheswara Rao G commented on HDFS-10555: {noformat}

[jira] [Comment Edited] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343114#comment-15343114 ] Uma Maheswara Rao G edited comment on HDFS-10555 at 6/22/16 12:44 AM: --

[jira] [Created] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-10555: -- Summary: Unable to loadFSEdits due to a failure in readCachePoolInfo Key: HDFS-10555 URL: https://issues.apache.org/jira/browse/HDFS-10555 Project:

[jira] [Updated] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10550: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343109#comment-15343109 ] Hadoop QA commented on HDFS-10544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343108#comment-15343108 ] Anu Engineer commented on HDFS-10550: - +1, for the v2 patch. I will commit this shortly. >

[jira] [Comment Edited] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342936#comment-15342936 ] Lei (Eddy) Xu edited comment on HDFS-10551 at 6/21/16 11:22 PM: Ok, please

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343006#comment-15343006 ] Hadoop QA commented on HDFS-10552: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342988#comment-15342988 ] Xiaoyu Yao commented on HDFS-10469: --- Thanks [~hanishakoneru] for updating the patch. The V4 patch looks

[jira] [Comment Edited] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342988#comment-15342988 ] Xiaoyu Yao edited comment on HDFS-10469 at 6/21/16 11:02 PM: - Thanks

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342936#comment-15342936 ] Lei (Eddy) Xu commented on HDFS-10551: -- Ok, please do so. > o.a.h.h.s.diskbalancer.command.Command

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342922#comment-15342922 ] Anu Engineer commented on HDFS-10551: - [~eddyxu] If you don't have any issues with code, I will commit

[jira] [Updated] (HDFS-10544) Balancer doesn't work with IPFailoverProxyProvider

2016-06-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10544: - Attachment: HDFS-10544.03.patch Thought more about the two options. I think we should use the simpler

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342897#comment-15342897 ] Hadoop QA commented on HDFS-10550: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342889#comment-15342889 ] Anu Engineer commented on HDFS-10551: - that is correct the fix for that failure is part of HDFS-10550,

[jira] [Comment Edited] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342880#comment-15342880 ] Lei (Eddy) Xu edited comment on HDFS-10551 at 6/21/16 10:20 PM: Hi, [~anu]

[jira] [Commented] (HDFS-10551) o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected.

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342880#comment-15342880 ] Lei (Eddy) Xu commented on HDFS-10551: -- Hi, [~anu] It seems that TestDiskBalancerCommand fails on

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342873#comment-15342873 ] Anu Engineer commented on HDFS-10552: - I just applied HDFS-10552 followed by HDFS-10551 on a branch

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342863#comment-15342863 ] Anu Engineer commented on HDFS-10552: - https://issues.apache.org/jira/browse/HDFS-10551 it seems to

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342853#comment-15342853 ] Lei (Eddy) Xu commented on HDFS-10552: -- Looks good. Thanks. However, HDFS-10551 has failed on trunk

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342843#comment-15342843 ] Anu Engineer commented on HDFS-10552: - Results of testing on Physical cluster with patch 4.

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342822#comment-15342822 ] Hadoop QA commented on HDFS-10342: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10554) libhdfs++: signed to unsigned conversions are breaking things and compiler isn't issuing expected warnings

2016-06-21 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10554: -- Summary: libhdfs++: signed to unsigned conversions are breaking things and compiler isn't issuing expected warnings Key: HDFS-10554 URL:

[jira] [Updated] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10552: Attachment: HDFS-10552-HDFS-1312.004.patch Patch 4 removes the re-ordering of imports >

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342691#comment-15342691 ] Anu Engineer commented on HDFS-10552: - [~eddyxu] Since this is a completely new file, this change

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342686#comment-15342686 ] Hadoop QA commented on HDFS-10441: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342658#comment-15342658 ] Lei (Eddy) Xu commented on HDFS-10552: -- bq. Did you mean do not ? Yes. I mean do not. Sorry for the

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2016-06-21 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342650#comment-15342650 ] Sangjin Lee commented on HDFS-7959: --- Thanks for updating the patch [~kihwal]! Just one more nit: can we

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342649#comment-15342649 ] Hadoop QA commented on HDFS-10543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342646#comment-15342646 ] Hadoop QA commented on HDFS-10473: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342632#comment-15342632 ] Anu Engineer commented on HDFS-10552: - bq. Please do move these lines around. Lets keep the patch

[jira] [Updated] (HDFS-10511) libhdfs++: make error returning mechanism consistent across all hdfs operations

2016-06-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10511: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: make error returning

[jira] [Updated] (HDFS-10515) libhdfs++: Implement mkdirs, rmdir, rename, and remove

2016-06-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10515: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Implement mkdirs,

[jira] [Updated] (HDFS-10524) libhdfs++: Implement chmod and chown

2016-06-21 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10524: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Implement chmod and

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342628#comment-15342628 ] Xiaobing Zhou commented on HDFS-10550: -- [~eddyxu] thank you for comments, I posted v002 patch. It

[jira] [Updated] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10550: - Attachment: HDFS-10550-HDFS-1312.002.patch > DiskBalancer: fix issue of order dependency in

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342625#comment-15342625 ] Hadoop QA commented on HDFS-10460: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342604#comment-15342604 ] Lei (Eddy) Xu edited comment on HDFS-10552 at 6/21/16 8:32 PM: --- Ok, thanks a

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342610#comment-15342610 ] Hadoop QA commented on HDFS-10552: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342604#comment-15342604 ] Lei (Eddy) Xu commented on HDFS-10552: -- Ok, thanks a lot, [~anu] Just one small issue here: {code}

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342598#comment-15342598 ] Lei (Eddy) Xu commented on HDFS-10550: -- One small issue {code} containsString("DISK"),

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Status: Patch Available (was: Open) > BlockManager#createLocatedBlocks should not check corrupt

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-06-21 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.001.patch The patch adds a check to ensure that {{isReplicaCorrupt}} is

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342581#comment-15342581 ] Hadoop QA commented on HDFS-10550: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-06-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342578#comment-15342578 ] Zhe Zhang commented on HDFS-7859: - Thanks! > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Updated] (HDFS-10441) libhdfs++: HA namenode support

2016-06-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10441: --- Attachment: HDFS-10441.HDFS-8707.005.patch New patch: -can take a nameservice in

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.003.patch Fix whitespace issue. > hdfsRead read stops at block

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342502#comment-15342502 ] Hadoop QA commented on HDFS-10543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10553) DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342490#comment-15342490 ] Anu Engineer commented on HDFS-10553: - >From the mail that points out this issue from [~szetszwo] -

[jira] [Updated] (HDFS-10473) Allow only suitable storage policies to be set on striped files

2016-06-21 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10473: --- Attachment: HDFS-10473-04.patch [~jingzhao], I have updated the patch as per the

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-21 Thread Anonymous (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anonymous updated HDFS-9890: Status: Patch Available (was: Reopened) > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10552: Attachment: HDFS-10552-HDFS-1312.003.patch I haved added new test case that tests this code from

[jira] [Commented] (HDFS-10550) DiskBalancer: fix issue of order dependency in iteration in ReportCommand test

2016-06-21 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342440#comment-15342440 ] Anu Engineer commented on HDFS-10550: - I have requested for a manual build on this.

[jira] [Updated] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10460: Attachment: HDFS-10460-02.patch > Erasure Coding: Recompute block checksum for a particular range less than

[jira] [Created] (HDFS-10553) DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI

2016-06-21 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10553: --- Summary: DiskBalancer: Rename Tools/DiskBalancer class to Tools/DiskBalancerCLI Key: HDFS-10553 URL: https://issues.apache.org/jira/browse/HDFS-10553 Project: Hadoop

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342418#comment-15342418 ] Rakesh R commented on HDFS-10460: - Makes sense to me. I've tried addressing the comments and uploaded new

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.002.patch HDFS-10543.HDFS-8707.002.patch fixed the issue that after

[jira] [Updated] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-06-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7597: Assignee: Daryn Sharp > DNs should not open new NN connections when webhdfs clients seek >

[jira] [Commented] (HDFS-7959) WebHdfs logging is missing on Datanode

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342211#comment-15342211 ] Hadoop QA commented on HDFS-7959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-06-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342195#comment-15342195 ] Kai Zheng commented on HDFS-8668: - I got it. Yeah, to use the native coder at full performance provided by

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342179#comment-15342179 ] Lei (Eddy) Xu commented on HDFS-10552: -- [~anu] Can we add a test to enforce the behavior ? Thanks.

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342175#comment-15342175 ] Kai Zheng commented on HDFS-10460: -- bq. can continue setting block.setNumBytes(getRemaining()); logic in

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-06-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Status: Patch Available (was: Open) > Use ByteBuffer in striping positional read >

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-06-21 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Status: Open (was: Patch Available) > Use ByteBuffer in striping positional read >

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342084#comment-15342084 ] Hadoop QA commented on HDFS-10534: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10552) DiskBalancer "-query" results in NPE if no plan for the node

2016-06-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342066#comment-15342066 ] Arpit Agarwal commented on HDFS-10552: -- +1 for the v2 patch pending Jenkins. > DiskBalancer "-query"

[jira] [Comment Edited] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341960#comment-15341960 ] Rakesh R edited comment on HDFS-10460 at 6/21/16 3:24 PM: -- Thanks [~drankye] for

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341965#comment-15341965 ] Rakesh R commented on HDFS-10460: - bq. In the following change, requestedNumBytes should be

[jira] [Issue Comment Deleted] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10460: Comment: was deleted (was: oops, you are right. Will take care in next patch.) > Erasure Coding: Recompute

[jira] [Updated] (HDFS-7959) WebHdfs logging is missing on Datanode

2016-06-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7959: - Attachment: HDFS-7959.2.trunk.patch HDFS-7959.2.branch-2.patch The new patches address the

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341962#comment-15341962 ] Rakesh R commented on HDFS-10460: - oops, you are right. Will take care in next patch. > Erasure Coding:

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341960#comment-15341960 ] Rakesh R commented on HDFS-10460: - Thanks [~drankye] for the detailed explanation. I have analysed this

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.009.patch HDFS-9890.HDFS-8707.009.patch uses a new flag

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-21 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-10534: -- Attachment: HDFS-10534.04.patch > NameNode WebUI should display DataNode usage rate with a certain

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2016-06-21 Thread Xinwei Qin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341759#comment-15341759 ] Xinwei Qin commented on HDFS-7859: --- [~zhz], it's better to have this in 3.0, rebasing and perfect this

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-06-21 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341751#comment-15341751 ] Daryn Sharp commented on HDFS-7597: --- +1 Thanks for fixing the tests! > DNs should not open new NN

[jira] [Commented] (HDFS-9513) DataNodeManager#getDataNodeStorageInfos not backward compatibility

2016-06-21 Thread DENG FEI (JIRA)
DENG FEI >Assignee: DENG FEI >Priority: Blocker > Attachments: HDFS-9513-20160621.patch, patch.HDFS-9513.20151207, > patch.HDFS-9513.20151216-2.7.2 > > > We is upgraded our new HDFS cluster to 2.7.1,but we YARN cluster is > 2.2.0(8000+,it's t

  1   2   >