[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876926#comment-14876926 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #395 (See [htt

[jira] [Updated] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-18 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9050: Resolution: Not A Problem Status: Resolved (was: Patch Available) > updatePipeline RPC call should o

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-18 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876906#comment-14876906 ] Zhe Zhang commented on HDFS-9050: - [~szetszwo] My original thought was to simplify the code

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876900#comment-14876900 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2333 (See [https://

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

2015-09-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876899#comment-14876899 ] Rakesh R commented on HDFS-8550: Thanks [~walter.k.su] for the help in reviews. Thanks [~zh

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876898#comment-14876898 ] Rakesh R commented on HDFS-7116: Thanks [~vinayrpet], [~ajisakaa], [~szetszwo], all others

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9111: Attachment: HDFS-9111.000.patch > Move hdfs-client protobuf convert methods from PBHelper to PBHelper

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9111: Status: Patch Available (was: Open) > Move hdfs-client protobuf convert methods from PBHelper to PBH

[jira] [Updated] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8740: Description: This jira tracks efforts of moving {{org.apache.hadoop.hdfs.DistributedFileSystem}} clas

[jira] [Updated] (HDFS-9099) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9099: Component/s: (was: build) > Move DistributedFileSystem to hadoop-hdfs-client > --

[jira] [Resolved] (HDFS-9099) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9099. - Resolution: Duplicate > Move DistributedFileSystem to hadoop-hdfs-client >

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876869#comment-14876869 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2360 (See [htt

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876862#comment-14876862 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1154 (See [https://

[jira] [Reopened] (HDFS-8740) Move DistributedFileSystem to hadoop-hdfs-client

2015-09-18 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reopened HDFS-8740: -- Yes, we should work on this. This JIRA should be the last step, it should be done after moving all client side relat

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876841#comment-14876841 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #414 (See

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-18 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8733: - Assignee: Mingliang Liu (was: Yi Liu) > Keep server related definition in hdfs.proto on server side >

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876819#comment-14876819 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #422 (See [htt

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876807#comment-14876807 ] Jing Zhao commented on HDFS-9040: - Good point about the GS bump! Some thinking along the li

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876800#comment-14876800 ] Hudson commented on HDFS-9101: -- FAILURE: Integrated in Hadoop-trunk-Commit #8490 (See [https:

[jira] [Updated] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9101: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876796#comment-14876796 ] Hadoop QA commented on HDFS-8696: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876789#comment-14876789 ] Haohui Mai commented on HDFS-9101: -- +1 > Remove deprecated NameNode.getUri() static helpe

[jira] [Commented] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876783#comment-14876783 ] Hadoop QA commented on HDFS-9101: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876781#comment-14876781 ] Hadoop QA commented on HDFS-8873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876736#comment-14876736 ] Nathan Roberts commented on HDFS-8873: -- bq. Sure. It won't matter since stop() is only

[jira] [Commented] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

2015-09-18 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876726#comment-14876726 ] Aaron T. Myers commented on HDFS-9112: -- Pinging [~templedf], since I know he was just

[jira] [Created] (HDFS-9112) Haadmin fails if multiple name service IDs are configured

2015-09-18 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9112: -- Summary: Haadmin fails if multiple name service IDs are configured Key: HDFS-9112 URL: https://issues.apache.org/jira/browse/HDFS-9112 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-18 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876710#comment-14876710 ] Xiaobing Zhou commented on HDFS-8855: - Build failures from V5 are due to hadoop-common

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-18 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876576#comment-14876576 ] Xiaobing Zhou commented on HDFS-8696: - Thanks [~bobhansen] for review! Patch V4 fixed t

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-18 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.004.patch > Reduce the variances of latency of WebHDFS > --

[jira] [Commented] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876570#comment-14876570 ] Hadoop QA commented on HDFS-9109: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Work started] (HDFS-9110) Improve upon HDFS-8480

2015-09-18 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9110 started by Charlie Helin. --- > Improve upon HDFS-8480 > -- > > Key: HDFS-9110

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Description: Somewhere between InputStream->PositionRead and the asio code the pointer to the de

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876537#comment-14876537 ] Daniel Templeton commented on HDFS-8873: bq. I personally would prefer the default

[jira] [Commented] (HDFS-8882) Use datablocks, parityblocks and cell size from ec zone

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876527#comment-14876527 ] Hadoop QA commented on HDFS-8882: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Description: The configuration setting {{dfs.datanode.dns.interface}} lets the DataNode select its ho

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Status: Patch Available (was: Open) > dfs.datanode.dns.interface does not work with hosts file based

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: HDFS-9109.01.patch v1 patch for Jenkins. Needs test cases. > dfs.datanode.dns.interface

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876509#comment-14876509 ] Hadoop QA commented on HDFS-9106: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876500#comment-14876500 ] Nathan Roberts commented on HDFS-8873: -- Thanks [~templedf] for the patch. A few commen

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876484#comment-14876484 ] Mingliang Liu commented on HDFS-9039: - Thank you [~wheat9] for your insight. I filed ne

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9111: Component/s: (was: build) > Move hdfs-client protobuf convert methods from PBHelper to PBHelperCl

[jira] [Updated] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9111: Summary: Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient (was: Move hdfs-c

[jira] [Created] (HDFS-9111) Move hdfs-client side helper methods converting protobuf from PBHelper to PBHelperClient

2015-09-18 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9111: --- Summary: Move hdfs-client side helper methods converting protobuf from PBHelper to PBHelperClient Key: HDFS-9111 URL: https://issues.apache.org/jira/browse/HDFS-9111 Pr

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.004.patch Once more with feeling. When this JIRA is resolved, I'll open

[jira] [Work started] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9108 started by James Clampffer. - > Pointer to read buffer isn't being passed to kernel >

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

2015-09-18 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Attachment: HDFS-9110.00.patch Suggested solution > Improve upon HDFS-8480 > --

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876392#comment-14876392 ] Hadoop QA commented on HDFS-9103: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9101) Remove deprecated NameNode.getUri() static helper method

2015-09-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9101: - Status: Patch Available (was: Open) > Remove deprecated NameNode.getUri() static helper method > -

[jira] [Created] (HDFS-9110) Improve upon HDFS-8480

2015-09-18 Thread Charlie Helin (JIRA)
Charlie Helin created HDFS-9110: --- Summary: Improve upon HDFS-8480 Key: HDFS-9110 URL: https://issues.apache.org/jira/browse/HDFS-9110 Project: Hadoop HDFS Issue Type: Improvement Affects Ve

[jira] [Assigned] (HDFS-9110) Improve upon HDFS-8480

2015-09-18 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin reassigned HDFS-9110: --- Assignee: Charlie Helin > Improve upon HDFS-8480 > -- > >

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876372#comment-14876372 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #392 (See [htt

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876361#comment-14876361 ] Haohui Mai commented on HDFS-9103: -- It's an explicit design choice to make the failures vi

[jira] [Created] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-18 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-9109: --- Summary: dfs.datanode.dns.interface does not work with hosts file based setups Key: HDFS-9109 URL: https://issues.apache.org/jira/browse/HDFS-9109 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876346#comment-14876346 ] Hadoop QA commented on HDFS-9107: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Attachment: (was: HDFS-9103.1.patch) > Retry reads on DN failure > - > >

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Attachment: HDFS-9103.1.patch > Retry reads on DN failure > - > > K

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Target Version/s: HDFS-8707 > Retry reads on DN failure > - > > Key

[jira] [Created] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9108: - Summary: Pointer to read buffer isn't being passed to kernel Key: HDFS-9108 URL: https://issues.apache.org/jira/browse/HDFS-9108 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876329#comment-14876329 ] Hadoop QA commented on HDFS-8550: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9080) update htrace version to 4.0

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876323#comment-14876323 ] Hadoop QA commented on HDFS-9080: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876320#comment-14876320 ] Hadoop QA commented on HDFS-9103: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Status: Patch Available (was: Open) Changes of note: I changed the semantics of InputStream::PositionRead

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-18 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Attachment: HDFS-9103.1.patch > Retry reads on DN failure > - > > K

[jira] [Work started] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8766 started by James Clampffer. - > Implement a libhdfs(3) compatible API > -

[jira] [Updated] (HDFS-9080) update htrace version to 4.0

2015-09-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Attachment: HDFS-9080.007.patch > update htrace version to 4.0 > --

[jira] [Commented] (HDFS-9080) update htrace version to 4.0

2015-09-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876247#comment-14876247 ] Colin Patrick McCabe commented on HDFS-9080: * fix a case where some tests were

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876242#comment-14876242 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2330 (See [https://

[jira] [Commented] (HDFS-5802) NameNode does not check for inode type before traversing down a path

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876243#comment-14876243 ] Hudson commented on HDFS-5802: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2330 (See [https://

[jira] [Commented] (HDFS-9105) separate replication config for client to create a file or set replication

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876220#comment-14876220 ] Hadoop QA commented on HDFS-9105: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8882) Use datablocks, parityblocks and cell size from ec zone

2015-09-18 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8882: Attachment: HDFS-8882-HDFS-7285-02.patch Updated the patch on latest branch code. Please review. >

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876208#comment-14876208 ] Hudson commented on HDFS-9063: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1151 (See [https://

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876195#comment-14876195 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2357 (See [htt

[jira] [Updated] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9107: -- Status: Patch Available (was: Open) > Prevent NN's unrecoverable death spiral after full GC > --

[jira] [Updated] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-18 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9107: -- Attachment: HDFS-9107.patch Not perfect, but simple way to prevent nodes being marked dead. Tried other

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876110#comment-14876110 ] Hadoop QA commented on HDFS-9039: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876107#comment-14876107 ] Daniel Templeton commented on HDFS-8873: Cool. I'm already planning a follow-up pa

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876099#comment-14876099 ] Colin Patrick McCabe commented on HDFS-8873: bq. Question about the rest of you

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-18 Thread Esteban Gutierrez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876097#comment-14876097 ] Esteban Gutierrez commented on HDFS-9107: - Perhaps us the JvmPauseMonitor to monito

[jira] [Updated] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

2015-09-18 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8550: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Created] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-18 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9107: - Summary: Prevent NN's unrecoverable death spiral after full GC Key: HDFS-9107 URL: https://issues.apache.org/jira/browse/HDFS-9107 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876035#comment-14876035 ] Haohui Mai commented on HDFS-9039: -- Thanks for the work. It might make sense to to separa

[jira] [Updated] (HDFS-9086) Rename dfs.datanode.stripedread.threshold.millis to dfs.datanode.stripedread.timeout.millis

2015-09-18 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9086: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2015-09-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9106: - Status: Patch Available (was: Open) > Transfer failure during pipeline recovery causes permanent write fai

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2015-09-18 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9106: - Attachment: HDFS-9106-poc.patch Attaching a patch with no test to run it through jenkins. > Transfer failu

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876017#comment-14876017 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #410 (See

[jira] [Commented] (HDFS-5802) NameNode does not check for inode type before traversing down a path

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875992#comment-14875992 ] Hudson commented on HDFS-5802: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #391 (See [htt

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9070: Target Version/s: 2.8.0 (was: HDFS-7285) > Allow fsck display pending replica location information for being

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9070: Affects Version/s: (was: HDFS-7285) > Allow fsck display pending replica location information for being-w

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9070: Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-8031) > Allow fsck display pending re

[jira] [Commented] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875947#comment-14875947 ] Jing Zhao commented on HDFS-9070: - For #1, I've moved the issue out of the HDFS-8031 and al

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9070: Summary: Allow fsck display pending replica location information for being-written blocks (was: Erasure codi

[jira] [Commented] (HDFS-9070) Erasure coding: allow fsck display the pending replica information(including datanode information) of being-written EC block group

2015-09-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875944#comment-14875944 ] Jing Zhao commented on HDFS-9070: - Thanks for working on this, Rui! The patch looks good to

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

2015-09-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875939#comment-14875939 ] Rakesh R commented on HDFS-8550: The test failures looks not related to the patch, I just t

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875937#comment-14875937 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #417 (See [htt

[jira] [Updated] (HDFS-9104) DFSInputStream goes into infinite loop

2015-09-18 Thread Aaron McCurry (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron McCurry updated HDFS-9104: Description: I recently have come across a bug that causes an infinite loop in the DFSClient. I hav

[jira] [Commented] (HDFS-9089) Balancer and Mover should use ".system" as reserved inode name instead of "system"

2015-09-18 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875926#comment-14875926 ] Surendra Singh Lilhore commented on HDFS-9089: -- OK. We will keep the same dire

[jira] [Commented] (HDFS-8341) HDFS mover stuck in loop trying to move corrupt block with no other valid replicas, doesn't move rest of other data blocks

2015-09-18 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875924#comment-14875924 ] Tsz Wo Nicholas Sze commented on HDFS-8341: --- > ... it's that it exits and tries f

[jira] [Commented] (HDFS-8341) HDFS mover stuck in loop trying to move corrupt block with no other valid replicas, doesn't move rest of other data blocks

2015-09-18 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875917#comment-14875917 ] Hari Sekhon commented on HDFS-8341: --- [~surendrasingh] it doesn't matter if the block repl

[jira] [Commented] (HDFS-9063) Correctly handle snapshot path for getContentSummary

2015-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875913#comment-14875913 ] Hudson commented on HDFS-9063: -- FAILURE: Integrated in Hadoop-trunk-Commit #8481 (See [https:

  1   2   >