[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-06-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345214#comment-15345214 ] John Zhuge edited comment on HDFS-6962 at 6/24/16 5:20 AM: --- [~cnauroth] Are there

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347621#comment-15347621 ] Hadoop QA commented on HDFS-1312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347554#comment-15347554 ] Hadoop QA commented on HDFS-10559: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-1312: Attachment: HDFS-1312.007.patch v7 - patch for Jenkins run after rebasing the feature branch on top

[jira] [Commented] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347530#comment-15347530 ] Anu Engineer commented on HDFS-10559: - I have a minor comment. In line {{ExecuteCommand@execute:Line

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347525#comment-15347525 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work started] (HDFS-10566) Submit plan request should throw exception if Datanode is undergoing an upgrade.

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10566 started by Xiaobing Zhou. > Submit plan request should throw exception if Datanode is undergoing an >

[jira] [Updated] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10559: - Attachment: HDFS-10559-HDFS-1312.000.patch v000 patch is posted for review. > DiskBalancer: Use

[jira] [Updated] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10559: - Status: Patch Available (was: In Progress) > DiskBalancer: Use SHA1 for Plan ID >

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347478#comment-15347478 ] Hadoop QA commented on HDFS-10558: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-10573) DiskBalancer: Add missing package-info

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10573. - Resolution: Later This should not be fixed via disk balancer, the checkstyle warning is about an

[jira] [Created] (HDFS-10573) DiskBalancer: Add missing package-info

2016-06-23 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10573: --- Summary: DiskBalancer: Add missing package-info Key: HDFS-10573 URL: https://issues.apache.org/jira/browse/HDFS-10573 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-10573) DiskBalancer: Add missing package-info

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-10573: --- Assignee: Anu Engineer > DiskBalancer: Add missing package-info >

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347459#comment-15347459 ] Anu Engineer commented on HDFS-10558: - I was refering to just running this on a machine and posting

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347458#comment-15347458 ] Hadoop QA commented on HDFS-10534: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347444#comment-15347444 ] Hadoop QA commented on HDFS-1312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347445#comment-15347445 ] Xiaobing Zhou commented on HDFS-10558: -- [~anu] I was thinking of how to add unit test for this. UT

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-06-23 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.007.patch > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-06-23 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347427#comment-15347427 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for the review Colin. I have addressed

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10569: --- Status: In Progress (was: Patch Available) > A bug causes OutOfIndex error in BlockListAsLongs >

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347374#comment-15347374 ] Anu Engineer commented on HDFS-10558: - Can you please post the output of running this command ?.

[jira] [Work started] (HDFS-10559) DiskBalancer: Use SHA1 for Plan ID

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10559 started by Xiaobing Zhou. > DiskBalancer: Use SHA1 for Plan ID > -- > >

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Status: Patch Available (was: In Progress) > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: HDFS-10558-HDFS-1312.000.patch I posted initial patch v000 for review. >

[jira] [Commented] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347334#comment-15347334 ] Hadoop QA commented on HDFS-10571: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9411) HDFS NodeLabel support

2016-06-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347292#comment-15347292 ] Kai Zheng commented on HDFS-9411: - Thanks [~vinayrpet] so much for addressing my questions! A few more

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10571: Resolution: Fixed Status: Resolved (was: Patch Available) [~xiaobingo] Thank you for the

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-1312: --- Attachment: HDFS-1312.006.patch Updating the patch against trunk. Hopefully the last patch before

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.000.patch Re-upload the same patch for triggering the Jenkins pre-commit

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347260#comment-15347260 ] Hudson commented on HDFS-10469: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10012 (See

[jira] [Commented] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347256#comment-15347256 ] Arpit Agarwal commented on HDFS-10571: -- +1 for the v1 patch. > TestDiskBalancerCommand#testPlanNode

[jira] [Assigned] (HDFS-10572) Fix TestOfflineEditsViewer#testGenerated

2016-06-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-10572: - Assignee: Hanisha Koneru > Fix TestOfflineEditsViewer#testGenerated >

[jira] [Comment Edited] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347237#comment-15347237 ] Hanisha Koneru edited comment on HDFS-10469 at 6/23/16 9:31 PM: Thank you

[jira] [Comment Edited] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347237#comment-15347237 ] Hanisha Koneru edited comment on HDFS-10469 at 6/23/16 9:31 PM: Thank you

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347237#comment-15347237 ] Hanisha Koneru commented on HDFS-10469: --- Thank you [~xiaoyuyao] for reviewing and committing the

[jira] [Updated] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10469: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10469: -- Labels: datanode metrics (was: ) > Add number of active xceivers to datanode metrics >

[jira] [Commented] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347216#comment-15347216 ] Xiaobing Zhou commented on HDFS-10571: -- [~anu] your patch is better, working for both cases. Thank

[jira] [Commented] (HDFS-9700) DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol

2016-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347186#comment-15347186 ] Arpit Agarwal commented on HDFS-9700: - This is a nice improvement. In the interests of reducing our

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

2016-06-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347197#comment-15347197 ] Xiaoyu Yao commented on HDFS-10469: --- I finished testing this patch against the failed tests. Only

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10571: Assignee: Xiaobing Zhou (was: Anu Engineer) > TestDiskBalancerCommand#testPlanNode failed with

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347194#comment-15347194 ] Anu Engineer commented on HDFS-10560: - [~linyiqun] Thank you for updating the patch. +1, LGTM.

[jira] [Created] (HDFS-10572) Fix TestOfflineEditsViewer#testGenerated

2016-06-23 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10572: - Summary: Fix TestOfflineEditsViewer#testGenerated Key: HDFS-10572 URL: https://issues.apache.org/jira/browse/HDFS-10572 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-10571: --- Assignee: Anu Engineer (was: Xiaobing Zhou) > TestDiskBalancerCommand#testPlanNode failed

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10571: Attachment: HDFS-10571-HDFS-1312.001.patch Thanks for the contribution. I have borrowed your patch

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-06-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347176#comment-15347176 ] Kai Zheng commented on HDFS-8901: - [~umamaheswararao], could you help trigger the Jenkins building? This

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Attachment: HDFS-10571-HDFS-1312.000.patch Re-uploaded patch after changing the patch's name. >

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Attachment: (was: HDFS-HDFS-10571-HDFS-1312.000.patch) > TestDiskBalancerCommand#testPlanNode

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347158#comment-15347158 ] Xiaowei Zhu commented on HDFS-10543: Latest patch fixes the compile warning and clean up the code

[jira] [Comment Edited] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347155#comment-15347155 ] Xiaobing Zhou edited comment on HDFS-10571 at 6/23/16 8:50 PM: --- I posted a

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Status: Patch Available (was: Open) > TestDiskBalancerCommand#testPlanNode failed with

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Attachment: HDFS-HDFS-10571-HDFS-1312.000.patch I posted a quick patch v000 to fix the issue.

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347143#comment-15347143 ] Hadoop QA commented on HDFS-10543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347140#comment-15347140 ] Hadoop QA commented on HDFS-1312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.004.patch > hdfsRead read stops at block boundary >

[jira] [Commented] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-23 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347028#comment-15347028 ] Zhe Zhang commented on HDFS-10534: -- Thanks [~kaisasak] for the update! +1 on v5 patch after Jenkins. >

[jira] [Assigned] (HDFS-10567) Improve plan command help message

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-10567: Assignee: Xiaobing Zhou > Improve plan command help message >

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Description: TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException:

[jira] [Updated] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10571: - Description: TestDiskBalancerCommand#testPlanNode failed with >

[jira] [Created] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException

2016-06-23 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10571: Summary: TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException Key: HDFS-10571 URL: https://issues.apache.org/jira/browse/HDFS-10571 Project:

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2016-06-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-1312: Attachment: HDFS-1312.005.patch > Re-balance disks within a Datanode >

[jira] [Work started] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-06-23 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10558 started by Xiaobing Zhou. > DiskBalancer: Print the full path to plan file >

[jira] [Created] (HDFS-10570) Netty-all jar should be first in class path while running tests in eclipse

2016-06-23 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-10570: Summary: Netty-all jar should be first in class path while running tests in eclipse Key: HDFS-10570 URL: https://issues.apache.org/jira/browse/HDFS-10570 Project:

[jira] [Updated] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10555: --- Affects Version/s: 2.9.0 > Unable to loadFSEdits due to a failure in

[jira] [Updated] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-10555: --- Component/s: caching > Unable to loadFSEdits due to a failure in readCachePoolInfo >

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-23 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346700#comment-15346700 ] Uma Maheswara Rao G commented on HDFS-10555: Thanks a lot, Kihwal for merging to branch-2. I

[jira] [Comment Edited] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346679#comment-15346679 ] Vinayakumar B edited comment on HDFS-10440 at 6/23/16 4:08 PM: --- bq. I was

[jira] [Commented] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346679#comment-15346679 ] Vinayakumar B commented on HDFS-10440: -- bq. I was having some problem to connect to DataNode's HTTP

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2016-06-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346671#comment-15346671 ] ASF GitHub Bot commented on HDFS-9459: -- Github user cnauroth closed the pull request at:

[jira] [Updated] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10440: --- Status: In Progress (was: Patch Available) Thanks a lot for the comments, will upload a new patch to

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346586#comment-15346586 ] Weiwei Yang commented on HDFS-10569: Well this did happen to us, when we tried to back port HDFS-10312

[jira] [Commented] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346544#comment-15346544 ] Vinayakumar B commented on HDFS-10440: -- I was having some problem to connect to DataNode's HTTP port

[jira] [Resolved] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-23 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg resolved HDFS-10563. Resolution: Invalid > Block reports could be silently dropped by NN >

[jira] [Commented] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-23 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346510#comment-15346510 ] Staffan Friberg commented on HDFS-10563: Now I see it. Completely missed the !. > Block reports

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346506#comment-15346506 ] Daryn Sharp commented on HDFS-10569: It's a dead/uncalled code path. The NN uses the iterator

[jira] [Commented] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-23 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346498#comment-15346498 ] Staffan Friberg commented on HDFS-10563: Unless I'm counting {} wrong it looks like the put is

[jira] [Updated] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10555: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-10555) Unable to loadFSEdits due to a failure in readCachePoolInfo

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346495#comment-15346495 ] Kihwal Lee commented on HDFS-10555: --- picked to branch-2. > Unable to loadFSEdits due to a failure in

[jira] [Updated] (HDFS-10328) Add per-cache-pool default replication num configuration

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10328: -- Fix Version/s: (was: 2.3.0) 2.9.0 > Add per-cache-pool default replication num

[jira] [Commented] (HDFS-10563) Block reports could be silently dropped by NN

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346489#comment-15346489 ] Kihwal Lee commented on HDFS-10563: --- bq. does not handle the case when the queue is full and offer

[jira] [Commented] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346443#comment-15346443 ] Kihwal Lee commented on HDFS-10569: --- It looks like {{index2BlockId()}} was used to get the right index

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-23 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-10534: -- Attachment: HDFS-10534.05.patch > NameNode WebUI should display DataNode usage rate with a certain

[jira] [Updated] (HDFS-10534) NameNode WebUI should display DataNode usage rate with a certain percentile

2016-06-23 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-10534: -- Attachment: Screen Shot 2016-06-23 at 6.25.50 AM.png > NameNode WebUI should display DataNode usage

[jira] [Commented] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346429#comment-15346429 ] Kihwal Lee commented on HDFS-10440: --- It looks good to me. +1 pending Vinay's review since he asked for

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-23 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346207#comment-15346207 ] Rakesh R commented on HDFS-10460: - Thanks a lot [~drankye] for the detailed reviews and continuous support

[jira] [Commented] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346192#comment-15346192 ] Hudson commented on HDFS-10460: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10009 (See

[jira] [Updated] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-06-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10460: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1 Status:

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-06-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.000.patch The v0 patch briefly explains our idea. Specially, the immutable

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15346047#comment-15346047 ] Hadoop QA commented on HDFS-10560: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10569: --- Status: Patch Available (was: Open) > A bug causes OutOfIndex error in BlockListAsLongs >

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10569: --- Attachment: HDFS-10569.001.patch > A bug causes OutOfIndex error in BlockListAsLongs >

[jira] [Updated] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-10569: --- Description: An obvious bug in LongsDecoder.getBlockListAsLongs(), the size of var *longs* is +2 to

[jira] [Created] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs

2016-06-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-10569: -- Summary: A bug causes OutOfIndex error in BlockListAsLongs Key: HDFS-10569 URL: https://issues.apache.org/jira/browse/HDFS-10569 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10440) Improve DataNode web UI

2016-06-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345978#comment-15345978 ] Weiwei Yang commented on HDFS-10440: Hello [~kihwal] [~vinayrpet] Appreciate if you guys can help to

[jira] [Commented] (HDFS-10560) DiskBalancer: Reuse ObjectMapper instance to improve the performance

2016-06-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345941#comment-15345941 ] Yiqun Lin commented on HDFS-10560: -- I have filed a new JIRA HDFS-10568 for

[jira] [Updated] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter

2016-06-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10568: - Description: The {{ObjectMapper}} instance is not reused in class {{CombinedHostsFileReader}} and

[jira] [Updated] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter

2016-06-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10568: - Attachment: HDFS-10568.001.patch > Reuse ObjectMapper instance in CombinedHostsFileReader and >

[jira] [Updated] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter

2016-06-23 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10568: - Status: Patch Available (was: Open) Attach a simple patch. > Reuse ObjectMapper instance in

[jira] [Created] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter

2016-06-23 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10568: Summary: Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter Key: HDFS-10568 URL: https://issues.apache.org/jira/browse/HDFS-10568 Project:

[jira] [Commented] (HDFS-10561) test_native_mini_dfs fails by NoClassDefFoundError

2016-06-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345918#comment-15345918 ] Hudson commented on HDFS-10561: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10008 (See

  1   2   >