[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109853#comment-15109853 ] Hadoop QA commented on HDFS-9643: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110073#comment-15110073 ] Hadoop QA commented on HDFS-9674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

2016-01-20 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109899#comment-15109899 ] XingFeng Shen commented on HDFS-6830: - Hi Vinayakumar, do you know how to reproduce or verify this

[jira] [Updated] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9673: Description: In method {{FSNamesystem#checkFileProgress}}, the annotation of this method is not complete.

[jira] [Updated] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9673: Attachment: HDFS-9673.001.patch > Incomplete annotation in FSNamesystem#checkFileProgress >

[jira] [Commented] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110039#comment-15110039 ] Vinayakumar B commented on HDFS-6830: - Hi [~xingfengshen], According to case 2, block is not present

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109866#comment-15109866 ] Anu Engineer commented on HDFS-9647: [~eddyxu] Thanks for your comments. bq. Why do we need to set

[jira] [Updated] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-9608: --- Attachment: HDFS-9608.07.patch Thanks for review! Synchronize removed in this patch. Thanks! > Disk IO

[jira] [Commented] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

2016-01-20 Thread XingFeng Shen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109898#comment-15109898 ] XingFeng Shen commented on HDFS-6830: - Hi Vinayakumar, do you know how to reproduce or verify this

[jira] [Updated] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9674: --- Attachment: HTRACE-9674.001.patch > The HTrace span for OpWriteBlock should record the

[jira] [Updated] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9674: --- Status: Patch Available (was: Open) > The HTrace span for OpWriteBlock should record

[jira] [Created] (HDFS-9674) The HTrace span for OpWriteBlock should record the maxWriteToDisk time

2016-01-20 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9674: -- Summary: The HTrace span for OpWriteBlock should record the maxWriteToDisk time Key: HDFS-9674 URL: https://issues.apache.org/jira/browse/HDFS-9674

[jira] [Commented] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110065#comment-15110065 ] Hadoop QA commented on HDFS-9673: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9673: Status: Patch Available (was: Open) Attach a initial patch, kindly reviewing! > Incomplete annotation in

[jira] [Updated] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9673: Description: In method {{FSNamesystem#checkFileProgress}}, the annotation of this method is not complete.

[jira] [Commented] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109921#comment-15109921 ] Weiwei Yang commented on HDFS-9653: --- Hello [~rushabh.shah] I think that's gonna fail. This patch

[jira] [Commented] (HDFS-9618) Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks

2016-01-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110033#comment-15110033 ] Akira AJISAKA commented on HDFS-9618: - Mostly looks good to me. Would you join the following two if

[jira] [Created] (HDFS-9673) Incomplete annotation in FSNamesystem#checkFileProgress

2016-01-20 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-9673: --- Summary: Incomplete annotation in FSNamesystem#checkFileProgress Key: HDFS-9673 URL: https://issues.apache.org/jira/browse/HDFS-9673 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9662) Wrong checking penultimate block replicated in FSNamesystem

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109926#comment-15109926 ] Lin Yiqun commented on HDFS-9662: - I create a new issue about this problem, can see this issue HDFS-9673,

[jira] [Updated] (HDFS-9662) Wrong checking penultimate block replicated in FSNamesystem

2016-01-20 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9662: Resolution: Invalid Status: Resolved (was: Patch Available) Thanks for comments. I mark this issue

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110023#comment-15110023 ] Hadoop QA commented on HDFS-9608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110189#comment-15110189 ] Haohui Mai commented on HDFS-9629: -- The clean way to do this is through generating templates through

[jira] [Updated] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-9653: -- Component/s: hdfs-client > Expose the number of blocks pending deletion through dfsadmin report command

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110202#comment-15110202 ] Vinayakumar B commented on HDFS-9668: - Yes, Idea seems really nice. Do you have same kind of test

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2016-01-20 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110188#comment-15110188 ] Yu Li commented on HDFS-9666: - bq. However it looked like the benefits of reading from remote RAM were

[jira] [Updated] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-9653: -- Affects Version/s: (was: 2.7.1) > Expose the number of blocks pending deletion through dfsadmin

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110206#comment-15110206 ] Kai Zheng commented on HDFS-9629: - bq. The clean way to do this is through generating templates through

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110221#comment-15110221 ] Kai Zheng commented on HDFS-9629: - Sorry I take back what I said. Generating a json data file for simply

[jira] [Commented] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109091#comment-15109091 ] Arpit Agarwal commented on HDFS-9645: - Hi [~anu], how is the result field in {{WorkStatus}}

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108756#comment-15108756 ] Allen Wittenauer commented on HDFS-9525: Let's not try to limit ourselves to just solving WebHDFS

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9661: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109068#comment-15109068 ] Vinayakumar B commented on HDFS-9608: - bq. Inconsistent synchronization of

[jira] [Commented] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109094#comment-15109094 ] Anu Engineer commented on HDFS-9645: You will see them as part of the implementation for QueryStatus

[jira] [Comment Edited] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109091#comment-15109091 ] Arpit Agarwal edited comment on HDFS-9645 at 1/20/16 6:36 PM: -- Hi [~anu], how

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108683#comment-15108683 ] Vinayakumar B commented on HDFS-9608: - +1 for the latest update. thanks [~zhouwei] [~andrew.wang], do

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109067#comment-15109067 ] Kihwal Lee commented on HDFS-9634: -- When I tried it on 2.7, the new test case fails. It is passing in

[jira] [Updated] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9645: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109138#comment-15109138 ] Gary Helmling commented on HDFS-9669: - Patch looks good to me (non-binding). Seems like it closes the

[jira] [Commented] (HDFS-9667) StorageType: SSD precede over DISK

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109073#comment-15109073 ] Arpit Agarwal commented on HDFS-9667: - Hi [~aderen], do you have an explanation for why the enum order

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108791#comment-15108791 ] Hadoop QA commented on HDFS-9608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HDFS-9669: Attachment: HDFS-9669.1.patch > TcpPeerServer should respect ipc.server.listen.queue.size >

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

2016-01-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108919#comment-15108919 ] Xiao Chen commented on HDFS-9629: - Thanks [~vinayrpet] for the comment! As Akira mentioned: bq. I thought

[jira] [Commented] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108695#comment-15108695 ] Vinayakumar B commented on HDFS-9661: - +1 for the latest patch. Will commit shortly > Deadlock in

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2016-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108868#comment-15108868 ] Yongjun Zhang commented on HDFS-6054: - Thanks [~aw]. > MiniQJMHACluster should not use static port to

[jira] [Commented] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

2016-01-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108774#comment-15108774 ] Hudson commented on HDFS-9661: -- FAILURE: Integrated in Hadoop-trunk-Commit #9140 (See

[jira] [Commented] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108785#comment-15108785 ] James Clampffer commented on HDFS-9643: --- Your observation is right; if network IO hangs or is just

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HDFS-9669: Attachment: HDFS-9669.1.patch Checkstyle nit. > TcpPeerServer should respect

[jira] [Updated] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9645: Target Version/s: (was: HDFS-1312) > DiskBalancer : Add Query RPC > >

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109234#comment-15109234 ] Colin Patrick McCabe commented on HDFS-9576: +1. Thanks, [~zhz]. > HTrace: collect

[jira] [Updated] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9576: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109282#comment-15109282 ] Hudson commented on HDFS-9576: -- FAILURE: Integrated in Hadoop-trunk-Commit #9141 (See

[jira] [Commented] (HDFS-9667) StorageType: SSD precede over DISK

2016-01-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109184#comment-15109184 ] Xiaoyu Yao commented on HDFS-9667: -- Thanks [~aderen] for reporting this, this seems to be a dup of

[jira] [Resolved] (HDFS-9667) StorageType: SSD precede over DISK

2016-01-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-9667. -- Resolution: Fixed > StorageType: SSD precede over DISK > -- > >

[jira] [Updated] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9647: --- Status: Patch Available (was: Open) > DiskBalancer : Add getRuntimeSettings >

[jira] [Commented] (HDFS-9667) StorageType: SSD precede over DISK

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109198#comment-15109198 ] Arpit Agarwal commented on HDFS-9667: - Nice catch [~xyao]. I forgot about that one. > StorageType: SSD

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109273#comment-15109273 ] Hadoop QA commented on HDFS-9669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109393#comment-15109393 ] Chris Nauroth commented on HDFS-9534: - Here are more details on the user scenario that prompted me to

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109432#comment-15109432 ] Kihwal Lee commented on HDFS-8898: -- The change looks good, but it would be better if the log level was

[jira] [Created] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9670: --- Summary: DistCp throws NPE when source is root "/" Key: HDFS-9670 URL: https://issues.apache.org/jira/browse/HDFS-9670 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9500) datanodesSoftwareVersions map may counting wrong when rolling upgrade

2016-01-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109452#comment-15109452 ] Kihwal Lee commented on HDFS-9500: -- No doubt this op will be hot during start-up of a several thousand

[jira] [Updated] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9670: Description: Symptom: {quote} [root@vb0724 ~]# hadoop distcp hdfs://X:8020/ hdfs://Y:8020/ 16/01/20

[jira] [Updated] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9671: --- Attachment: HDFS-9671-HDFS-1312.001.patch Attaching patch for code review purposes only. This patch

[jira] [Commented] (HDFS-9655) NN should start JVM pause monitor before loading fsimage

2016-01-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109313#comment-15109313 ] John Zhuge commented on HDFS-9655: -- Unit test failures seem unrelated. > NN should start JVM pause

[jira] [Commented] (HDFS-9520) PeerCache evicts too frequently causing connection restablishments

2016-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109320#comment-15109320 ] Chris Nauroth commented on HDFS-9520: - [~rajesh.balamohan], as per the prior comments from me and

[jira] [Updated] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9670: Labels: supportability (was: ) > DistCp throws NPE when source is root "/" >

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109337#comment-15109337 ] Hadoop QA commented on HDFS-9669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109364#comment-15109364 ] Rushabh S Shah commented on HDFS-9634: -- The patch looks good to me. Ran the test case on trunk and on

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-01-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109404#comment-15109404 ] Kihwal Lee commented on HDFS-9634: -- I used jdk8 and ran {{TestWebHdfsTimeouts}}. {{testReadTimeout}} would

[jira] [Assigned] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-9670: Assignee: John Zhuge (was: Yongjun Zhang) > DistCp throws NPE when source is root "/" >

[jira] [Created] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-01-20 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9671: -- Summary: DiskBalancer : SubmitPlan implementation Key: HDFS-9671 URL: https://issues.apache.org/jira/browse/HDFS-9671 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root "/"

2016-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109429#comment-15109429 ] Yongjun Zhang commented on HDFS-9670: - Thanks John for looking into. > DistCp throws NPE when source

[jira] [Updated] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-20 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-8898: -- Attachment: HDFS-8898-6.patch Thanks [~kihwal]. Here is the patch with log level and some checkstyle fixes. >

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109589#comment-15109589 ] Arpit Agarwal commented on HDFS-9534: - bq. I had been thinking that the remove operation applies just

[jira] [Updated] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9671: --- Attachment: (was: HDFS-9671-HDFS-1312.001.patch) > DiskBalancer : SubmitPlan implementation >

[jira] [Updated] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9671: --- Attachment: HDFS-9671-HDFS-1312.001.patch > DiskBalancer : SubmitPlan implementation >

[jira] [Commented] (HDFS-6054) MiniQJMHACluster should not use static port to avoid binding failure in unit test

2016-01-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108788#comment-15108788 ] Allen Wittenauer commented on HDFS-6054: testreport comes from jenkins. it shows the last JDK

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109610#comment-15109610 ] Anu Engineer commented on HDFS-9647: Test failures don't seem to be related to this patch. >

[jira] [Commented] (HDFS-9655) NN should start JVM pause monitor before loading fsimage

2016-01-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109655#comment-15109655 ] John Zhuge commented on HDFS-9655: -- Thanks [~eddyxu]. > NN should start JVM pause monitor before loading

[jira] [Commented] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109626#comment-15109626 ] Rushabh S Shah commented on HDFS-9653: -- If the clients are upgraded and the namenode is not upgraded

[jira] [Commented] (HDFS-9655) NN should start JVM pause monitor before loading fsimage

2016-01-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109637#comment-15109637 ] Hudson commented on HDFS-9655: -- FAILURE: Integrated in Hadoop-trunk-Commit #9142 (See

[jira] [Updated] (HDFS-9655) NN should start JVM pause monitor before loading fsimage

2016-01-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9655: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109591#comment-15109591 ] Chris Nauroth commented on HDFS-9534: - Also, would you please update documentation to mention the new

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109051#comment-15109051 ] Arpit Agarwal commented on HDFS-9094: - Hi [~xiaobingo], the patch looks great. Just a couple of

[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109062#comment-15109062 ] Arpit Agarwal commented on HDFS-9666: - Hi [~aderen], thanks for filing this. We considered enabling

[jira] [Commented] (HDFS-9645) DiskBalancer : Add Query RPC

2016-01-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109099#comment-15109099 ] Arpit Agarwal commented on HDFS-9645: - So these are yet to be defined? That should be fine for now

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109601#comment-15109601 ] Hadoop QA commented on HDFS-9647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9643) libhdfs++: Support async cancellation of read operations

2016-01-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9643: -- Attachment: HDFS-9643.HDFS-8707.002.patch New Patch: -FileHandle now holds weak_ptrs to

[jira] [Created] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9672: --- Summary: o.a.h.hdfs.TestLeaseRecovery2 fails intermittently Key: HDFS-9672 URL: https://issues.apache.org/jira/browse/HDFS-9672 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109798#comment-15109798 ] Mingliang Liu commented on HDFS-9669: - +1 (non-binding) Default backlog value should be used here.

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109801#comment-15109801 ] Mingliang Liu commented on HDFS-9669: - I mean *configured value*. Sorry. > TcpPeerServer should

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109818#comment-15109818 ] Hadoop QA commented on HDFS-8898: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

2016-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109821#comment-15109821 ] Colin Patrick McCabe commented on HDFS-9668: The idea seems good. However, I don't understand

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109750#comment-15109750 ] Andrew Wang commented on HDFS-9608: --- Agree with Vinay's analysis, I didn't see any other usages of

[jira] [Commented] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109759#comment-15109759 ] Mingliang Liu commented on HDFS-9672: - The detailed exception message is like: {code} Running

[jira] [Updated] (HDFS-9672) o.a.h.hdfs.TestLeaseRecovery2 fails intermittently

2016-01-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9672: Description: It fails in recent builds, see:

[jira] [Commented] (HDFS-9647) DiskBalancer : Add getRuntimeSettings

2016-01-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109830#comment-15109830 ] Lei (Eddy) Xu commented on HDFS-9647: - Hi, [~anu] thanks a lot for working on this feature. I have a

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108197#comment-15108197 ] Vinayakumar B commented on HDFS-9608: - Changes looks good. I have some comments, 1. To reduce the

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-20 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15108228#comment-15108228 ] Tsz Wo Nicholas Sze commented on HDFS-8999: --- > 1. Will the current default retry policy retry the

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-01-20 Thread Elliott Clark (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark updated HDFS-9669: Attachment: HDFS-9669.0.patch Straight forward patch to make sure that all the places that bind use

[jira] [Updated] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage

2016-01-20 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-1.patch Upload a draft patch for discussion. This patch implements a lock

  1   2   >