[jira] [Commented] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-11-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006787#comment-15006787 ] Harsh J commented on HDFS-8298: --- I'm closing this JIRA as Invalid. This is not a bug, but a misunderstanding

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-11-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.002.patch Rebased patch on current HDFS-8707. > libhdfs++ should respect

[jira] [Commented] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-11-16 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006885#comment-15006885 ] Hari Sekhon commented on HDFS-8298: --- Hi [~qwertymaniac], I understand your points but this is

[jira] [Resolved] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-11-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-8298. --- Resolution: Invalid Closing out - for specific identified improvements (such as log improvements, or ideas

[jira] [Assigned] (HDFS-9227) Check block checksums for integrity

2015-11-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9227: - Assignee: James Clampffer > Check block checksums for integrity >

[jira] [Assigned] (HDFS-9271) Implement basic NN operations

2015-11-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9271: - Assignee: James Clampffer > Implement basic NN operations > -

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Attachment: HDFS-9358.002.patch Thanks for the comment, [~walter.k.su]. bq. 1. We can set

[jira] [Commented] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006913#comment-15006913 ] Brahma Reddy Battula commented on HDFS-9375: [~linyiqun] thanks for updating the patch.. Patch

[jira] [Updated] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-11-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-8298: -- Environment: (was: HDP 2.2) > HA: NameNode should not shut down completely without quorum, doesn't recover

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-11-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006739#comment-15006739 ] Wei-Chiu Chuang commented on HDFS-9347: --- Thanks for the comment. My rev01 patch did use waitFor() to

[jira] [Resolved] (HDFS-8770) ReplicationMonitor thread received Runtime exception: NullPointerException when BlockManager.chooseExcessReplicates

2015-11-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8770. - Resolution: Duplicate HDFS-9313 probably fixed this as a workaround. And HDFS-9314 is filed to improve

[jira] [Updated] (HDFS-9411) HDFS ZoneLabel support

2015-11-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9411: Attachment: HDFS_ZoneLabels-16112015.pdf Attaching the initial design doc. Please take a look.

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006995#comment-15006995 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #681 (See

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007075#comment-15007075 ] Haohui Mai commented on HDFS-9103: -- {code}

[jira] [Assigned] (HDFS-9432) WebHDFS: Some GET operations are wrongly documented as PUT operations

2015-11-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9432: --- Assignee: Xiaobing Zhou > WebHDFS: Some GET operations are wrongly documented as PUT

[jira] [Commented] (HDFS-9432) WebHDFS: Some GET operations are wrongly documented as PUT operations

2015-11-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006946#comment-15006946 ] Xiaobing Zhou commented on HDFS-9432: - I was thinking it still needs some fixes when I picked it up,

[jira] [Updated] (HDFS-9408) Build both static and dynamic libraries for libhdfspp

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9408: - Summary: Build both static and dynamic libraries for libhdfspp (was: extend the build system to produce

[jira] [Commented] (HDFS-9408) Build both static and dynamic libraries for libhdfspp

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007028#comment-15007028 ] Haohui Mai commented on HDFS-9408: -- Verified the build on Mac OS X. +1. I'll commit it shortly. > Build

[jira] [Updated] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Attachment: HDFS-9348-002.patch > DFS GetErasureCodingPolicy API on a non-existent file should be handled >

[jira] [Updated] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Summary: Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

[jira] [Created] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-16 Thread Rakesh R (JIRA)
Rakesh R created HDFS-9433: -- Summary: DFS getEZForPath API on a non-existent file should throw FileNotFoundException Key: HDFS-9433 URL: https://issues.apache.org/jira/browse/HDFS-9433 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9433: --- Attachment: HDFS-9433-00.patch > DFS getEZForPath API on a non-existent file should throw

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007151#comment-15007151 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1405 (See

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007150#comment-15007150 ] Bob Hansen commented on HDFS-9117: -- [~wheat9]: thanks for the review. bq. In the first cut maybe we can

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006982#comment-15006982 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-trunk-Commit #8806 (See

[jira] [Commented] (HDFS-8770) ReplicationMonitor thread received Runtime exception: NullPointerException when BlockManager.chooseExcessReplicates

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007000#comment-15007000 ] Xiao Chen commented on HDFS-8770: - Thanks [~walter.k.su] for the reference. This should be the same as

[jira] [Updated] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Attachment: HDFS-9348-002.patch > Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should

[jira] [Commented] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007128#comment-15007128 ] Rakesh R commented on HDFS-9348: As per the offline discussion with [~umamaheswararao], I've separated out

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.001.patch > Improve BlockPlacementPolicyDefault's picking of excess replicas >

[jira] [Updated] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Attachment: (was: HDFS-9348-002.patch) > Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007062#comment-15007062 ] Sangjin Lee commented on HDFS-9413: --- +1 on adding it to the 2.6.x release (it'd be 2.6.3). Please cherry

[jira] [Updated] (HDFS-9271) Implement basic NN operations

2015-11-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9271: -- Assignee: Aliaksei Sandryhaila (was: James Clampffer) > Implement basic NN operations >

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006945#comment-15006945 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007005#comment-15007005 ] Xiao Chen commented on HDFS-9314: - Thanks [~mingma] for creating this, and nice work on HDFS-9313! Looks

[jira] [Updated] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9413: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8031 > DFS GetErasureCodingPolicy API on a non-existent

[jira] [Updated] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9348: --- Description: Presently calling {{dfs#getErasureCodingPolicy()}} on a non-existent file is returning the

[jira] [Updated] (HDFS-9408) Build both static and dynamic libraries for libhdfspp

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9408: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9433: --- Target Version/s: 2.8.0 Status: Patch Available (was: Open) Attaching patch to throw

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007216#comment-15007216 ] Hadoop QA commented on HDFS-9358: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007321#comment-15007321 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2610 (See

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007363#comment-15007363 ] Haohui Mai commented on HDFS-9103: -- bq. I'd be happy to change them to use value assignment rather than

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007389#comment-15007389 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #608 (See

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Assignee: Xiao Chen Status: Patch Available (was: Open) > Improve BlockPlacementPolicyDefault's

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-11-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.003.patch > libhdfs++ should respect NN retry configuration settings >

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007398#comment-15007398 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007524#comment-15007524 ] Zhe Zhang commented on HDFS-9314: - The patch LGTM overall. Only ask is to add a short Javadoc for the new

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007561#comment-15007561 ] Zhe Zhang commented on HDFS-9342: - Thanks Walter. The fix looks OK for closing file and allocation new

[jira] [Commented] (HDFS-9348) Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007426#comment-15007426 ] Hadoop QA commented on HDFS-9348: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007553#comment-15007553 ] Zhe Zhang commented on HDFS-9382: - Great idea Uma. With this proposed work, we should probably revisit

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007439#comment-15007439 ] Zhe Zhang commented on HDFS-9314: - Thanks for the patch Xiao. Quick comment before I finish reviewing:

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-11-16 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007277#comment-15007277 ] HeeSoo Kim commented on HDFS-7984: -- The test failures are unrelated to the change made for this jira. >

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007269#comment-15007269 ] Hudson commented on HDFS-9413: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #669 (See

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-11-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007259#comment-15007259 ] Allen Wittenauer commented on HDFS-9263: Could we at least get a fix in that moves the directory so

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++

2015-11-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007274#comment-15007274 ] Bob Hansen commented on HDFS-9328: -- Is there a way to prevent clang-format from changing {code} -//

[jira] [Commented] (HDFS-8056) Decommissioned dead nodes should continue to be counted as dead after NN restart

2015-11-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007317#comment-15007317 ] Andrew Wang commented on HDFS-8056: --- Thanks for working on this Ming, +1 LGTM. Seems inline with our

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007182#comment-15007182 ] Hudson commented on HDFS-9413: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2545 (See

[jira] [Commented] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-11-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007203#comment-15007203 ] Andrew Wang commented on HDFS-8298: --- This same issue is also discussed on HDFS-1137, which goes into why

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.015.patch New patch: * Makes configurations immutable * Load only from

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007307#comment-15007307 ] James Clampffer commented on HDFS-9103: --- "It can be moved into the bindings/c instead of being a

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.002.patch Thanks [~zhz] for the prompt review! Attached patch 002 to address your

[jira] [Commented] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007667#comment-15007667 ] Arpit Agarwal commented on HDFS-9397: - +1 for the fix, pending Jenkins. Thanks for the contribution

[jira] [Updated] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9397: Status: Patch Available (was: Open) > Fix typo for readChecksum() LOG.warn in BlockSender.java >

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007681#comment-15007681 ] Xiaoyu Yao commented on HDFS-9387: -- +1 for the fixes. I will commit HDFS-9387 and HDFS-9421 shortly. >

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007683#comment-15007683 ] Hadoop QA commented on HDFS-9314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9434: -- Attachment: h9434_20151116.patch h9434_20151116.patch: changes the log message to trace

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9434: -- Status: Patch Available (was: Open) > Recommission a datanode with 500k blocks may

[jira] [Commented] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007705#comment-15007705 ] Xiaoyu Yao commented on HDFS-9421: -- +1 for the fix. The test failures are not related. I will commit it

[jira] [Updated] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9421: - Affects Version/s: 2.8.0 > NNThroughputBenchmark replication test NPE with -namenode option >

[jira] [Commented] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007714#comment-15007714 ] Mingliang Liu commented on HDFS-9421: - Thanks for your reporting this issue, reviewing and committing

[jira] [Updated] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9421: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007721#comment-15007721 ] Xiaoyu Yao commented on HDFS-9434: -- Thanks [~szetszwo] for reporting the issue and posting the fix. The

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

2015-11-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007576#comment-15007576 ] Haohui Mai commented on HDFS-8155: -- Note that this patch introduces a new dependency,

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007597#comment-15007597 ] Zhe Zhang commented on HDFS-9314: - Thanks Xiao! +1 pending Jenkins. My concern about other BPPs is that

[jira] [Updated] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9387: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007700#comment-15007700 ] Hudson commented on HDFS-9387: -- FAILURE: Integrated in Hadoop-trunk-Commit #8807 (See

[jira] [Created] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9434: - Summary: Recommission a datanode with 500k blocks may pause NN for 30 seconds Key: HDFS-9434 URL: https://issues.apache.org/jira/browse/HDFS-9434 Project:

[jira] [Commented] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-16 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007678#comment-15007678 ] Lin Yiqun commented on HDFS-9375: - Thanks [~brahmareddy] review. I have removed this line and update the

[jira] [Updated] (HDFS-9375) Set balancer bandwidth for specific node

2015-11-16 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9375: Attachment: HDFS-9375.004.patch > Set balancer bandwidth for specific node >

[jira] [Updated] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2015-11-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9387: - Summary: Fix namenodeUri parameter parsing in NNThroughputBenchmark (was: Parse namenodeUri parameter

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007689#comment-15007689 ] Xiao Chen commented on HDFS-9314: - The test failures all seems unrelated. > Improve

[jira] [Commented] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2015-11-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007717#comment-15007717 ] Mingliang Liu commented on HDFS-9387: - Thanks for your review and commit! > Fix namenodeUri parameter

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-11-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007971#comment-15007971 ] Walter Su commented on HDFS-9347: - I know. It's just the 2 pieces of code is similar. We can remove the

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9433: --- Status: Patch Available (was: Open) > DFS getEZForPath API on a non-existent file should throw

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008014#comment-15008014 ] Hudson commented on HDFS-9358: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #671 (See

[jira] [Updated] (HDFS-9433) DFS getEZForPath API on a non-existent file should throw FileNotFoundException

2015-11-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9433: --- Status: Open (was: Patch Available) > DFS getEZForPath API on a non-existent file should throw

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008016#comment-15008016 ] Hadoop QA commented on HDFS-9434: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008034#comment-15008034 ] Hudson commented on HDFS-9421: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #609 (See

[jira] [Commented] (HDFS-9387) Fix namenodeUri parameter parsing in NNThroughputBenchmark

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008035#comment-15008035 ] Hudson commented on HDFS-9387: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #609 (See

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008039#comment-15008039 ] Hudson commented on HDFS-9358: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #684 (See

[jira] [Commented] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008045#comment-15008045 ] Hadoop QA commented on HDFS-9397: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9397: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008057#comment-15008057 ] Hudson commented on HDFS-9358: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1408 (See

[jira] [Updated] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9397: --- Assignee: Enrique Flores (was: Nicole Pazmany) > Fix typo for readChecksum() LOG.warn in

[jira] [Commented] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007729#comment-15007729 ] Hudson commented on HDFS-9421: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8808 (See

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-16 Thread He Liangliang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007908#comment-15007908 ] He Liangliang commented on HDFS-9422: - No, the lock can make NO difference, EXCEPT we move the

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9358: Component/s: test > TestNodeCount#testNodeCount timed out > - > >

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9358: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 Status:

[jira] [Commented] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007947#comment-15007947 ] Hudson commented on HDFS-9421: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #683 (See

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007951#comment-15007951 ] Hudson commented on HDFS-9358: -- FAILURE: Integrated in Hadoop-trunk-Commit #8810 (See

  1   2   >