[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127885#comment-15127885 ] Rui Li commented on HDFS-7866: -- Thanks [~zhz] for pointing me to the discussion and {{BlockSt

[jira] [Assigned] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su reassigned HDFS-9716: --- Assignee: Walter Su > o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk > --

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127923#comment-15127923 ] Kai Zheng commented on HDFS-7866: - bq. For striped blocks, we will possibly support replica

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127930#comment-15127930 ] Kai Zheng commented on HDFS-7866: - bq. If we want to support custom policies later, we stil

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127932#comment-15127932 ] Walter Su commented on HDFS-9716: - There are 2 ways to make BlockGroup under-replicated: 1.

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127941#comment-15127941 ] Kai Zheng commented on HDFS-9716: - Thanks [~liuml07] for reporting this and [~walter.k.su]

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127954#comment-15127954 ] Kai Zheng commented on HDFS-9716: - bq. java.io.File.length() returns 0 if the file is not f

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127981#comment-15127981 ] Haohui Mai commented on HDFS-9724: -- Is {ObjectMapper#writeValueAsString()} reentrant? > W

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127991#comment-15127991 ] Vinayakumar B commented on HDFS-9715: - {{TestDFSRollback}} is failing because it expect

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9716: Attachment: HDFS-9716.01.patch > o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk > --

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9716: Labels: test (was: ) Affects Version/s: (was: 2.8.0) Status: Patch Availabl

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128002#comment-15128002 ] Vinayakumar B commented on HDFS-9503: - bq. I don't know if it is incompatible, just say

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128003#comment-15128003 ] Walter Su commented on HDFS-9716: - {{MiniDFSCluster.getBlockFile}} on _dead DN_ is called b

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128008#comment-15128008 ] Walter Su commented on HDFS-9716: - You can easily reproduce the failure by delay line 345 w

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128024#comment-15128024 ] Kai Zheng commented on HDFS-9716: - bq. You can easily reproduce the failure by delay line 3

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128028#comment-15128028 ] Kai Zheng commented on HDFS-9716: - Note the mentioned misordering is from the existing code

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128033#comment-15128033 ] Hadoop QA commented on HDFS-9730: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9716: Attachment: HDFS-9716.02.patch Thanks [~drankye]. Uploaded 02 patch to address that. > o.a.h.hdfs.TestRecove

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-02 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128099#comment-15128099 ] Akira AJISAKA commented on HDFS-9724: - bq. Is {{ObjectMapper#writeValueAsString()}} ree

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128104#comment-15128104 ] Vinayakumar B commented on HDFS-9730: - Its been a while since all unit tests passed in

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128139#comment-15128139 ] Hadoop QA commented on HDFS-9244: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-02-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9732: - Target Version/s: 3.0.0 (was: 2.8.0) > Remove DelegationTokenIdentifier.toString() —for better log

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128156#comment-15128156 ] Hadoop QA commented on HDFS-9716: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-02-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-9708: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) y

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128195#comment-15128195 ] Hadoop QA commented on HDFS-8905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-02-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128218#comment-15128218 ] Steve Loughran commented on HDFS-9525: -- should i open a new JIRA to cover my issues?

[jira] [Created] (HDFS-9737) libhdfs++: Create examples of consuming libhdfs++

2016-02-02 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9737: Summary: libhdfs++: Create examples of consuming libhdfs++ Key: HDFS-9737 URL: https://issues.apache.org/jira/browse/HDFS-9737 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128393#comment-15128393 ] Hadoop QA commented on HDFS-9716: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9738) libhdfs++: Implement simple authentication

2016-02-02 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9738: Summary: libhdfs++: Implement simple authentication Key: HDFS-9738 URL: https://issues.apache.org/jira/browse/HDFS-9738 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9738) libhdfs++: Implement simple authentication

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9738: - Attachment: HDFS-9738.HDFS-8707.000.patch Implemented basic AuthN by passing the effective user to the NN o

[jira] [Updated] (HDFS-9738) libhdfs++: Implement simple authentication

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9738: - Status: Patch Available (was: Open) > libhdfs++: Implement simple authentication > ---

[jira] [Updated] (HDFS-9737) libhdfs++: Create examples of consuming libhdfs++

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9737: - Attachment: HDFS-9737.HDFS-8707.000.patch > libhdfs++: Create examples of consuming libhdfs++ > ---

[jira] [Updated] (HDFS-9737) libhdfs++: Create examples of consuming libhdfs++

2016-02-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9737: - Status: Patch Available (was: Open) > libhdfs++: Create examples of consuming libhdfs++ >

[jira] [Updated] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7708: --- Attachment: HDFS-7708-002.patch > Balancer should delete its pid file when it completes rebalance > ---

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702

2016-02-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128449#comment-15128449 ] Daniel Templeton commented on HDFS-9637: This patch will need to be updated after H

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128458#comment-15128458 ] Kihwal Lee commented on HDFS-9730: -- It is reproduced in 2.7 by making following temporary

[jira] [Updated] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7708: --- Status: Patch Available (was: Open) > Balancer should delete its pid file when it completes rebalance > --

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128464#comment-15128464 ] Rakesh R commented on HDFS-7708: Hi [~ajisakaa], Attached patch, here I've tried {{HADOOP_P

[jira] [Commented] (HDFS-9737) libhdfs++: Create examples of consuming libhdfs++

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128473#comment-15128473 ] Hadoop QA commented on HDFS-9737: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9739: Summary: DatanodeStorage.isValidStorageId() is broken Key: HDFS-9739 URL: https://issues.apache.org/jira/browse/HDFS-9739 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9737) libhdfs++: Create examples of consuming libhdfs++

2016-02-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128482#comment-15128482 ] James Clampffer commented on HDFS-9737: --- Current patch looks good, is the plan to add

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128479#comment-15128479 ] Kihwal Lee commented on HDFS-9730: -- Filed HDFS-9739 for the broken {{isValidStorageId()}}.

[jira] [Updated] (HDFS-9395) getContentSummary is audit logged as success even if failed

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Status: Patch Available (was: Open) > getContentSummary is audit logged as success even if failed >

[jira] [Commented] (HDFS-8979) Clean up checkstyle warnings in hadoop-hdfs-client module

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128484#comment-15128484 ] Kihwal Lee commented on HDFS-8979: -- While working on HDFS-9730, it was found that {{Datan

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128502#comment-15128502 ] Kihwal Lee commented on HDFS-9696: -- Thanks, [~yzhangal]! > Garbage snapshot records linge

[jira] [Commented] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128522#comment-15128522 ] Daryn Sharp commented on HDFS-9072: --- +1 but please file a new jira since this appears to

[jira] [Commented] (HDFS-9738) libhdfs++: Implement simple authentication

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128526#comment-15128526 ] Hadoop QA commented on HDFS-9738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9740: Summary: Use a reasonable limit in DFSTestUtil.waitForMetric() Key: HDFS-9740 URL: https://issues.apache.org/jira/browse/HDFS-9740 Project: Hadoop HDFS Issue Type: B

[jira] [Commented] (HDFS-4115) TestHDFSCLI.testAll fails one test due to number format

2016-02-02 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128540#comment-15128540 ] Tony Wu commented on HDFS-4115: --- Hi [~sureshms], [~jingzhao] & [~scurrilous], I ran into thi

[jira] [Assigned] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned HDFS-9740: -- Assignee: Chang Li > Use a reasonable limit in DFSTestUtil.waitForMetric() > ---

[jira] [Commented] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128542#comment-15128542 ] Kihwal Lee commented on HDFS-9072: -- bq. please file a new jira since this appears to loop

[jira] [Commented] (HDFS-9724) WebHDFS listing is too slow after HDFS-6565

2016-02-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128552#comment-15128552 ] Chris Nauroth commented on HDFS-9724: - bq. ...yes, as long as you always configure inst

[jira] [Updated] (HDFS-9258) NN should indicate which nodes are stale

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9258: -- Status: Patch Available (was: In Progress) > NN should indicate which nodes are stale >

[jira] [Updated] (HDFS-9258) NN should indicate which nodes are stale

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9258: -- Status: In Progress (was: Patch Available) > NN should indicate which nodes are stale >

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9740: --- Status: Patch Available (was: Open) [~kihwal] uploaded a patch to change wait time to 60 seconds > Use a reas

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9740: --- Attachment: HDFS-9740.patch > Use a reasonable limit in DFSTestUtil.waitForMetric() > -

[jira] [Assigned] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned HDFS-9739: -- Assignee: Chang Li > DatanodeStorage.isValidStorageId() is broken >

[jira] [Updated] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9395: -- Summary: getContentSummary and other FS operations are audit logged as success even if failed (was: getC

[jira] [Commented] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128579#comment-15128579 ] Kihwal Lee commented on HDFS-9072: -- Committed the patch to 2.7. > Fix random failures in

[jira] [Updated] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9072: - Fix Version/s: 2.7.3 > Fix random failures in TestJMXGet > - > >

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-02-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128595#comment-15128595 ] Steve Loughran commented on HDFS-9732: -- This is a pain; I was just seeing that the deb

[jira] [Commented] (HDFS-9258) NN should indicate which nodes are stale

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128598#comment-15128598 ] Hadoop QA commented on HDFS-9258: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-9739: --- Assignee: (was: Chang Li) > DatanodeStorage.isValidStorageId() is broken >

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2016-02-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128605#comment-15128605 ] Yongjun Zhang commented on HDFS-9696: - Very welcome [~kihwal]! > Garbage snapshot rec

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Attachment: 002-HDFS-9178.branch-2.6.patch The patch for branch-2.6 is stale. Update 002 patch that sync wi

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128649#comment-15128649 ] Kihwal Lee commented on HDFS-9739: -- @ Mingliang Liu Can you take a look? > DatanodeStorag

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128657#comment-15128657 ] Kihwal Lee commented on HDFS-9178: -- +1 It looks like the only difference is in {{DataNodeF

[jira] [Comment Edited] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128649#comment-15128649 ] Kihwal Lee edited comment on HDFS-9739 at 2/2/16 5:55 PM: -- [~liuml

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128671#comment-15128671 ] Kihwal Lee commented on HDFS-9730: -- bq. Its been a while since all unit tests passed in hd

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128675#comment-15128675 ] Xiao Chen commented on HDFS-9721: - Failed tests seem unrelated. > Allow Delimited PB OIV t

[jira] [Updated] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4660: - Fix Version/s: 2.6.4 > Block corruption can happen during pipeline recovery > -

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-02-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128689#comment-15128689 ] Chris Nauroth commented on HDFS-9732: - Yes, agreed. I would be +1 for an approach that

[jira] [Commented] (HDFS-4660) Block corruption can happen during pipeline recovery

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128690#comment-15128690 ] Junping Du commented on HDFS-4660: -- I have commit the 2.6 patch to branch-2.6. Thanks [~ki

[jira] [Commented] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128715#comment-15128715 ] Junping Du commented on HDFS-9178: -- Thanks [~kihwal] for review the patch! I have commit t

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Fix Version/s: 2.6.4 > Slow datanode I/O can cause a wrong node to be marked bad >

[jira] [Commented] (HDFS-9698) Long running Balancer should renew TGT

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128733#comment-15128733 ] Zhe Zhang commented on HDFS-9698: - Thanks Jing and Chris for the helpful discussion. Yes I

[jira] [Updated] (HDFS-9698) Long running Balancer should renew TGT

2016-02-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9698: Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > Long running Balancer should

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8722: - Fix Version/s: 2.6.4 > Optimize datanode writes for small writes and flushes >

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

2016-02-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128736#comment-15128736 ] Junping Du commented on HDFS-8722: -- I have merge the 2.6 patch to branch-2.6. Thanks [~kih

[jira] [Commented] (HDFS-9395) getContentSummary and other FS operations are audit logged as success even if failed

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128753#comment-15128753 ] Hadoop QA commented on HDFS-9395: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9739: --- Assignee: Mingliang Liu > DatanodeStorage.isValidStorageId() is broken > -

[jira] [Updated] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9721: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128781#comment-15128781 ] Hudson commented on HDFS-9721: -- FAILURE: Integrated in Hadoop-trunk-Commit #9225 (See [https:

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128789#comment-15128789 ] Colin Patrick McCabe commented on HDFS-9669: +1. Thanks, [~eclark]. > TcpPeer

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Issue Type: Improvement (was: Bug) > TcpPeerServer should respect ipc.server.listen.qu

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128797#comment-15128797 ] Xiao Chen commented on HDFS-9721: - Thanks for the helpful reviews and commit [~eddyxu]. >

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9669: --- Resolution: Fixed Fix Version/s: 2.7.3 Target Version/s: 2.7.3

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Summary: Improve the performance and GC friendliness of NameNode startup and full block

[jira] [Commented] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128838#comment-15128838 ] Hudson commented on HDFS-9669: -- FAILURE: Integrated in Hadoop-trunk-Commit #9226 (See [https:

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128866#comment-15128866 ] Hadoop QA commented on HDFS-7708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128869#comment-15128869 ] Hudson commented on HDFS-9260: -- FAILURE: Integrated in Hadoop-trunk-Commit #9227 (See [https:

[jira] [Commented] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2016-02-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128876#comment-15128876 ] Hadoop QA commented on HDFS-9740: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9260: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-02-02 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128897#comment-15128897 ] HeeSoo Kim commented on HDFS-9525: -- [~steve_l] Thank you for your feedback. {quote} {{"ha

[jira] [Comment Edited] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127262#comment-15127262 ] Yongjun Zhang edited comment on HDFS-9406 at 2/2/16 7:59 PM: - C

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128939#comment-15128939 ] Mingliang Liu commented on HDFS-9739: - Thanks [~kihwal] for reporting this. The patch

[jira] [Created] (HDFS-9741) libhdfs++: GetLastError not returning meaningful messages after some failures

2016-02-02 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-9741: Summary: libhdfs++: GetLastError not returning meaningful messages after some failures Key: HDFS-9741 URL: https://issues.apache.org/jira/browse/HDFS-9741 Project: Hadoop HDF

[jira] [Updated] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9739: Attachment: HDFS-9739.000.patch The v0 patch simply adds the {{UUID.fromString}} back. I think we an

[jira] [Created] (HDFS-9742) TestAclsEndToEnd#testGoodWithWhitelistWithoutBlacklist occasionally fails in java8 trunk

2016-02-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9742: - Summary: TestAclsEndToEnd#testGoodWithWhitelistWithoutBlacklist occasionally fails in java8 trunk Key: HDFS-9742 URL: https://issues.apache.org/jira/browse/HDFS-9742

[jira] [Commented] (HDFS-9739) DatanodeStorage.isValidStorageId() is broken

2016-02-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15128965#comment-15128965 ] Kihwal Lee commented on HDFS-9739: -- If the patch works, {{TestDatanodeStartupFixesLegacySt

  1   2   3   >