[jira] [Updated] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

2015-09-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7408: - Status: Patch Available (was: Open) > Add a counter in the log that shows the numb

[jira] [Commented] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

2015-09-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740303#comment-14740303 ] Surendra Singh Lilhore commented on HDFS-7408: -- Attached initial patch based o

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740302#comment-14740302 ] Hudson commented on HDFS-7314: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2295 (See [https://

[jira] [Updated] (HDFS-7408) Add a counter in the log that shows the number of block reports processed

2015-09-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-7408: - Attachment: HDFS-7408.001.patch > Add a counter in the log that shows the number of

[jira] [Updated] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

2015-09-10 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Tianyi updated HDFS-8829: Attachment: HDFS-8829.0005.patch Fix codestyle. > DataNode sets SO_RCVBUF explicitly is disabling tcp auto-t

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740264#comment-14740264 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #356 (See [htt

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740219#comment-14740219 ] Hadoop QA commented on HDFS-9027: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Assigned] (HDFS-5795) RemoteBlockReader2#checkSuccess() shoud print error status

2015-09-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-5795: --- Assignee: Xiao Chen > RemoteBlockReader2#checkSuccess() shoud print error status > --

[jira] [Commented] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740199#comment-14740199 ] Hadoop QA commented on HDFS-8874: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740198#comment-14740198 ] Hadoop QA commented on HDFS-8996: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740193#comment-14740193 ] Hadoop QA commented on HDFS-9041: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-9051) webhdfs should support recursive list

2015-09-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-9051: Assignee: Surendra Singh Lilhore > webhdfs should support recursive list > -

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740140#comment-14740140 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #376 (See [htt

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when setting EC policy

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740135#comment-14740135 ] J.Andreina commented on HDFS-8853: -- Thanks [~zhz] for the commit . > Erasure Coding: Prov

[jira] [Commented] (HDFS-9036) In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.

2015-09-10 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740131#comment-14740131 ] J.Andreina commented on HDFS-9036: -- Testcase failures are unrelated . Please review. > In

[jira] [Commented] (HDFS-8782) Upgrade to block ID-based DN storage layout delays DN registration

2015-09-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740128#comment-14740128 ] Duo Zhang commented on HDFS-8782: - I think at least we could upgrade each volume parallel?

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740119#comment-14740119 ] Hadoop QA commented on HDFS-9008: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740115#comment-14740115 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2318 (See [htt

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Alex Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740108#comment-14740108 ] Alex Ivanov commented on HDFS-9052: --- I've confirmed that the CDH 5.0.0/5.0.5 code actuall

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-09-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740094#comment-14740094 ] Anu Engineer commented on HDFS-1312: [~dkaiser] Thanks for you comment. Without going i

[jira] [Commented] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740082#comment-14740082 ] Colin Patrick McCabe commented on HDFS-8996: +1. Note that we are now using sc

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740079#comment-14740079 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #370 (See

[jira] [Commented] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740070#comment-14740070 ] Hadoop QA commented on HDFS-8830: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740063#comment-14740063 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1108 (See [https://

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-09-10 Thread David Kaiser (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740038#comment-14740038 ] David Kaiser commented on HDFS-1312: Anu, I would like to add a comment to the tool pro

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740033#comment-14740033 ] Tsz Wo Nicholas Sze commented on HDFS-9047: --- Sure, let's do it. > deprecate libw

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740028#comment-14740028 ] Tsz Wo Nicholas Sze commented on HDFS-9050: --- What are the advantages by restricti

[jira] [Commented] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739998#comment-14739998 ] Hudson commented on HDFS-7314: -- FAILURE: Integrated in Hadoop-trunk-Commit #8432 (See [https:

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739978#comment-14739978 ] Hadoop QA commented on HDFS-9050: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Comment Edited] (HDFS-8953) DataNode Metrics logging

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739970#comment-14739970 ] Arpit Agarwal edited comment on HDFS-8953 at 9/11/15 1:20 AM: --

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739970#comment-14739970 ] Arpit Agarwal commented on HDFS-8953: - Thanks for the heads up [~vinayrpet]. [~kanaka]

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2015-09-10 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739969#comment-14739969 ] Ming Ma commented on HDFS-9005: --- Yes, that is a good idea. We discussed it briefly in the con

[jira] [Commented] (HDFS-9025) Fix compilation issues on arch linux

2015-09-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739964#comment-14739964 ] James Clampffer commented on HDFS-9025: --- +1 > Fix compilation issues on arch linux >

[jira] [Commented] (HDFS-8952) InputStream.PositionRead() should be aware of available DNs

2015-09-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739963#comment-14739963 ] James Clampffer commented on HDFS-8952: --- +1 > InputStream.PositionRead() should be a

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2015-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739881#comment-14739881 ] Chris Trezzo commented on HDFS-9005: If we decide to add a new JSON facility for datano

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when setting EC policy

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8853: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Target Version/s: H

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when setting EC policy

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8853: Summary: Erasure Coding: Provide ECSchema validation when setting EC policy (was: Erasure Coding: Provide EC

[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8874: --- Attachment: HDFS-8874-trunk-v3.patch [~mingma] V3 attached. I realized I do not need accessor methods t

[jira] [Updated] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9041: Attachment: HDFS-9041.001.patch Thank you [~wheat9] for your insight. The v1 patch addresses this. >

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739776#comment-14739776 ] Haohui Mai commented on HDFS-9041: -- {code} + + +${basedir}/src/main/reso

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739765#comment-14739765 ] Arpit Agarwal commented on HDFS-9027: - +1 for the v1 patch pending Jenkins. Thanks for

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Attachment: HDFS-9027.001.patch Thank you [~arpitagarwal] (online) and [~wheat9] (offline) for review

[jira] [Updated] (HDFS-8830) Support add/remove directories to an existing encryption zone

2015-09-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8830: - Attachment: HDFS-8830.06.patch Rebase the patch and remove unused methods from EncryptonZoneManager. > Sup

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739747#comment-14739747 ] Daniel Templeton commented on HDFS-9024: Not sure why the build failed for the test

[jira] [Comment Edited] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739734#comment-14739734 ] Jing Zhao edited comment on HDFS-9052 at 9/10/15 10:27 PM: --- A pos

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739734#comment-14739734 ] Jing Zhao commented on HDFS-9052: - A possible scenario is like this: 1. We deleted a file "

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Attachment: HDFS-8996.00.patch {{validateLog}} and {{scanLog}} have very similar logics in {{FileJournalMana

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739721#comment-14739721 ] Zhe Zhang commented on HDFS-9050: - Thanks Jing for the feedback. Wire incompatibility is a

[jira] [Commented] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739717#comment-14739717 ] Hadoop QA commented on HDFS-9041: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9008: --- Attachment: HDFS-9008-trunk-v5.patch Attached v5 to make BalancerParameters class final since it only h

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Alex Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739709#comment-14739709 ] Alex Ivanov commented on HDFS-9052: --- I saw [https://issues.apache.org/jira/browse/HDFS-69

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739695#comment-14739695 ] Jing Zhao commented on HDFS-9047: - I also agree the current implementation is not good. So

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739694#comment-14739694 ] Jing Zhao commented on HDFS-9050: - Thanks for working on this, Zhe. But looks like the patc

[jira] [Commented] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739692#comment-14739692 ] Hadoop QA commented on HDFS-9008: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Status: Patch Available (was: Open) > Consolidate validateLog and scanLog in FJM#EditLogFile > -

[jira] [Commented] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739684#comment-14739684 ] Jing Zhao commented on HDFS-9052: - Thanks for the report, Alex. I'm thinking whether the e

[jira] [Commented] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739670#comment-14739670 ] Zhe Zhang commented on HDFS-9050: - This is related to error handing when writing striped fi

[jira] [Updated] (HDFS-8996) Consolidate validateLog and scanLog in FJM#EditLogFile

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8996: Summary: Consolidate validateLog and scanLog in FJM#EditLogFile (was: Remove redundant scanEditLog code) >

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-09-10 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739661#comment-14739661 ] Himanshu commented on HDFS-8750: [~ste...@apache.org] HDFS-8750.004.patch should work, I c

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739643#comment-14739643 ] Arpit Agarwal commented on HDFS-9027: - Hi [~liuml07], thanks for this improvement. # L

[jira] [Created] (HDFS-9052) deleteSnapshot runs into AssertionError

2015-09-10 Thread Alex Ivanov (JIRA)
Alex Ivanov created HDFS-9052: - Summary: deleteSnapshot runs into AssertionError Key: HDFS-9052 URL: https://issues.apache.org/jira/browse/HDFS-9052 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8837) Remove the unnecessary Quota.Counts class

2015-09-10 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739579#comment-14739579 ] Xiaoyu Yao commented on HDFS-8837: -- Thanks [~mingma] for the update. Patch looks good to m

[jira] [Updated] (HDFS-1312) Re-balance disks within a Datanode

2015-09-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-1312: --- Attachment: disk-balancer-proposal.pdf I would like to propose a tool similar to balancer that addresse

[jira] [Updated] (HDFS-9050) updatePipeline RPC call should only update the GS of the block

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9050: Summary: updatePipeline RPC call should only update the GS of the block (was: updatePipeline RPC call should

[jira] [Updated] (HDFS-9050) updatePipeline RPC call should only take new GS as input

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9050: Description: The only usage of the call is in {{DataStreamer#updatePipeline}}, where {{newBlock}} differs fr

[jira] [Updated] (HDFS-9050) updatePipeline RPC call should only take new GS as input

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9050: Attachment: HDFS-9050.00.patch > updatePipeline RPC call should only take new GS as input > -

[jira] [Updated] (HDFS-9050) updatePipeline RPC call should only take new GS as input

2015-09-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9050: Status: Patch Available (was: Open) > updatePipeline RPC call should only take new GS as input > ---

[jira] [Created] (HDFS-9051) webhdfs should support recursive list

2015-09-10 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-9051: -- Summary: webhdfs should support recursive list Key: HDFS-9051 URL: https://issues.apache.org/jira/browse/HDFS-9051 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9047: --- Component/s: webhdfs > deprecate libwebhdfs in branch-2; remove from trunk > --

[jira] [Created] (HDFS-9050) updatePipeline RPC call should only take new GS as input

2015-09-10 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-9050: --- Summary: updatePipeline RPC call should only take new GS as input Key: HDFS-9050 URL: https://issues.apache.org/jira/browse/HDFS-9050 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8846: -- Fix Version/s: 2.7.2 Just pulled this into branch-2.7 (release 2.7.2) as it alrea

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7314: -- Attachment: HDFS-7314-branch-2.7.2.txt Attaching patch that I committed to 2.7.2.

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7314: -- Fix Version/s: 2.7.2 Just pulled this into branch-2.7 (release 2.7.2) as it alrea

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7609: -- Attachment: HDFS-7609-branch-2.7.2.txt Attaching patch that I committed for 2.7.2

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7609: -- Fix Version/s: 2.7.2 Just pulled this into branch-2.7 (release 2.7.2) as it alrea

[jira] [Updated] (HDFS-8431) hdfs crypto class not found in Windows

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8431: -- Fix Version/s: 2.7.2 Just pulled this into branch-2.7 (release 2.7.2) as it alrea

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8219: -- Fix Version/s: 2.7.2 > setStoragePolicy with folder behavior is different after c

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8219: -- Just pulled this into branch-2.7 (release 2.7.2) as it already exists in 2.6.1. bran

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739456#comment-14739456 ] Vinayakumar B commented on HDFS-9024: - oops, I got confused. Thought dfshealth,html usi

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

2015-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8046: -- Fix Version/s: 2.7.2 Just pulled this into branch-2.7 (release 2.7.2) as it alrea

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2015-09-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739386#comment-14739386 ] Colin Patrick McCabe commented on HDFS-9005: Yes, a refresh command would be ni

[jira] [Commented] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739352#comment-14739352 ] Haohui Mai commented on HDFS-9049: -- Why does it need to be configurable? How does it benef

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739345#comment-14739345 ] Daniel Templeton commented on HDFS-9024: I don't see any UI files that use TotalFil

[jira] [Created] (HDFS-9049) Make Datanode Netty reverse proxy port to be configurable

2015-09-10 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-9049: --- Summary: Make Datanode Netty reverse proxy port to be configurable Key: HDFS-9049 URL: https://issues.apache.org/jira/browse/HDFS-9049 Project: Hadoop HDFS Iss

[jira] [Resolved] (HDFS-9045) DatanodeHttpServer is not setting Endpoint based on configured policy and not loading ssl configuration.

2015-09-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-9045. -- Resolution: Invalid This is invalid as the Netty serves as a reverse proxy for the Jetty server. The jet

[jira] [Updated] (HDFS-9008) Balancer#Parameters class could use a builder pattern

2015-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-9008: --- Attachment: HDFS-9008-trunk-v4.patch [~mingma] V4 attached to address your comments and the checkstyle

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739318#comment-14739318 ] Vinayakumar B commented on HDFS-6955: - Yes, that would work. Thank you. [~kanaka], can

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739312#comment-14739312 ] Arpit Agarwal commented on HDFS-6955: - We can rename the internal counter to reservedFo

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739306#comment-14739306 ] Vinayakumar B commented on HDFS-6955: - bq. Hi Vinayakumar B, good point. Perhaps we can

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739300#comment-14739300 ] Arpit Agarwal commented on HDFS-6955: - Hi [~vinayrpet], good point. Perhaps we can just

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739273#comment-14739273 ] Vinayakumar B commented on HDFS-6955: - bq. Do we need the separate counter for tmp or c

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739253#comment-14739253 ] Arpit Agarwal commented on HDFS-6955: - Thanks for fixing this [~kanaka]. Do we need th

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739247#comment-14739247 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2292 (See [https://

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739227#comment-14739227 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9004) Add upgrade domain to DatanodeInfo

2015-09-10 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739226#comment-14739226 ] Rushabh S Shah commented on HDFS-9004: -- Hi [~mingma], The patch looks neat. Just one m

[jira] [Commented] (HDFS-6763) Initialize file system-wide quota once on transitioning to active

2015-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739221#comment-14739221 ] Hudson commented on HDFS-6763: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #353 (See [htt

[jira] [Updated] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9041: Status: Patch Available (was: Open) > Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Patch Available (was: Open) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Open (was: Patch Available) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Updated] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-10 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9010: Status: Open (was: Patch Available) > Replace NameNode.DEFAULT_PORT with > HdfsClientConfigKeys.DFS

  1   2   >