[jira] [Commented] (HDFS-9345) Erasure Coding: create dummy coder and schema

2015-11-02 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986864#comment-14986864 ] Rui Li commented on HDFS-9345: -- [~drankye] told me that dummy schema depends on some other JIR

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986857#comment-14986857 ] Hudson commented on HDFS-9313: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #631 (See [htt

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.019.patch The v19 patch is the latest effort of simplifying the {{BlockManagerS

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986837#comment-14986837 ] Hadoop QA commented on HDFS-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986821#comment-14986821 ] Walter Su commented on HDFS-9361: - I think it's not an issue. It's because the defect of th

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986819#comment-14986819 ] Hudson commented on HDFS-9313: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1354 (See [https://

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-02 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986818#comment-14986818 ] Walter Su commented on HDFS-6101: - The test failed is possibly because the stopped DN doesn

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Attachment: HDFS-9364.001.patch Patch 001 fixes the unnecessary DNS resolution by checking against configured

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Status: Patch Available (was: Open) > Unnecessary DNS resolution attempts when NameNodeProxies > ---

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986793#comment-14986793 ] Hudson commented on HDFS-9313: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2561 (See [htt

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986796#comment-14986796 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2561 (See [htt

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986795#comment-14986795 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2561 (See [htt

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986794#comment-14986794 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2561 (See [htt

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986782#comment-14986782 ] Hadoop QA commented on HDFS-9360: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils()

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986751#comment-14986751 ] Hadoop QA commented on HDFS-9363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9007: -- Attachment: HDFS-9007-2.patch > Fix HDFS Balancer to honor upgrade domain policy > --

[jira] [Updated] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9007: -- Attachment: (was: HDFS-9007-2.patch) > Fix HDFS Balancer to honor upgrade domain policy > ---

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986728#comment-14986728 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #565 (See [htt

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986729#comment-14986729 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #565 (See [htt

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986727#comment-14986727 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #565 (See [htt

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986730#comment-14986730 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #565 (See [htt

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986693#comment-14986693 ] Hudson commented on HDFS-9313: -- FAILURE: Integrated in Hadoop-trunk-Commit #8746 (See [https:

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986675#comment-14986675 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #630 (See [htt

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986676#comment-14986676 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #630 (See [htt

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986677#comment-14986677 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #630 (See [htt

[jira] [Commented] (HDFS-9354) Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986673#comment-14986673 ] Chris Nauroth commented on HDFS-9354: - That was a very strange test-patch run. I submi

[jira] [Commented] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986674#comment-14986674 ] Chris Nauroth commented on HDFS-9362: - That was a very strange test-patch run. I submi

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986659#comment-14986659 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1353 (See [https://

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986660#comment-14986660 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1353 (See [https://

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986661#comment-14986661 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1353 (See [https://

[jira] [Commented] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986637#comment-14986637 ] Hudson commented on HDFS-9313: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #620 (See

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986638#comment-14986638 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #620 (See

[jira] [Commented] (HDFS-9354) Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986623#comment-14986623 ] Hadoop QA commented on HDFS-9354: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986610#comment-14986610 ] Hadoop QA commented on HDFS-9362: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986611#comment-14986611 ] Rakesh R commented on HDFS-9348: Thank you [~umamaheswararao], [~andrew.wang], [~hitliuyi]

[jira] [Updated] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

2015-11-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9313: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9360) Storage type usage isn't updated properly after file deletion

2015-11-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9360: -- Attachment: HDFS-9360-2.patch Thanks [~xyao]. Here is the updated patch with your suggestion. > Storage type usa

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986567#comment-14986567 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2560 (See [htt

[jira] [Commented] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986561#comment-14986561 ] Hudson commented on HDFS-9329: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2501 (See [https://

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986564#comment-14986564 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2501 (See [https://

[jira] [Updated] (HDFS-9007) Fix HDFS Balancer to honor upgrade domain policy

2015-11-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9007: -- Attachment: HDFS-9007-2.patch Thanks [~eddyxu]! With function overloading of getDatanodeInfo, the generics funct

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986536#comment-14986536 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #619 (See

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986537#comment-14986537 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #619 (See

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986525#comment-14986525 ] Hudson commented on HDFS-9275: -- FAILURE: Integrated in Hadoop-trunk-Commit #8745 (See [https:

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986526#comment-14986526 ] Hudson commented on HDFS-9312: -- FAILURE: Integrated in Hadoop-trunk-Commit #8745 (See [https:

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986524#comment-14986524 ] Hudson commented on HDFS-9308: -- FAILURE: Integrated in Hadoop-trunk-Commit #8745 (See [https:

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986520#comment-14986520 ] Wei-Chiu Chuang commented on HDFS-9249: --- Also, could you apply&run the rev4 patch? It

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-02 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986514#comment-14986514 ] Liangliang Gu commented on HDFS-9276: - First of all, the new test is used to reproduce

[jira] [Updated] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9308: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved (w

[jira] [Updated] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-02 Thread Liangliang Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liangliang Gu updated HDFS-9276: Attachment: HDFS-9276.11.patch > Failed to Update HDFS Delegation Token for long running application

[jira] [Created] (HDFS-9365) Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376

2015-11-02 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9365: - Summary: Balaner should call getNNServiceRpcAddressesForCluster after HDFS-6376 Key: HDFS-9365 URL: https://issues.apache.org/jira/browse/HDFS-9365 Project:

[jira] [Commented] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986495#comment-14986495 ] Xiao Chen commented on HDFS-9351: - The findbugs warning / test failures / asflicense are un

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986491#comment-14986491 ] Wei-Chiu Chuang commented on HDFS-9249: --- (1) It is not intuitive initially because of

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986478#comment-14986478 ] Xiao Chen commented on HDFS-9364: - Example stacktrace: {noformat} at java.net.Inet4

[jira] [Comment Edited] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986476#comment-14986476 ] Yi Liu edited comment on HDFS-9348 at 11/3/15 1:41 AM: --- Thanks Uma fo

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986477#comment-14986477 ] Hadoop QA commented on HDFS-9249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9348) DFS GetErasureCodingPolicy API on a non-existent file should be handled properly

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986476#comment-14986476 ] Yi Liu commented on HDFS-9348: -- Thanks Uma for ping me, and Rakesh for the work. I think it ma

[jira] [Updated] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils()

2015-11-02 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9363: -- Attachment: HDFS-9363.001.patch In v1 patch: * Add {{fetchReplica()}} to {{FsDatasetTestUtils()}}. * Modify {{Tes

[jira] [Updated] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils()

2015-11-02 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9363: -- Status: Patch Available (was: Open) > Add fetchReplica() to FsDatasetTestUtils() > -

[jira] [Created] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9364: --- Summary: Unnecessary DNS resolution attempts when NameNodeProxies Key: HDFS-9364 URL: https://issues.apache.org/jira/browse/HDFS-9364 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8777) Erasure Coding: add tests for taking snapshots on EC files

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986455#comment-14986455 ] Hudson commented on HDFS-8777: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #564 (See [htt

[jira] [Commented] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986451#comment-14986451 ] Hudson commented on HDFS-9329: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #564 (See [htt

[jira] [Updated] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9275: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: Patch A

[jira] [Updated] (HDFS-9354) Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9354: Component/s: test > Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows >

[jira] [Updated] (HDFS-9354) Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9354: Hadoop Flags: Reviewed Thank you, Xiaoyu. +1 for patch v01, pending a fresh Jenkins run. > Fix Test

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-11-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986437#comment-14986437 ] Yongjun Zhang commented on HDFS-9249: - Hi [~jojochuang], Thanks for reporting and work

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986435#comment-14986435 ] Hadoop QA commented on HDFS-9129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986431#comment-14986431 ] Yi Liu commented on HDFS-9275: -- Will commit shortly. > Wait previous ErasureCodingWork to fin

[jira] [Updated] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9312: Resolution: Fixed Fix Version/s: 2.8.0 3.0.0 Status: Resolved (w

[jira] [Created] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils()

2015-11-02 Thread Tony Wu (JIRA)
Tony Wu created HDFS-9363: - Summary: Add fetchReplica() to FsDatasetTestUtils() Key: HDFS-9363 URL: https://issues.apache.org/jira/browse/HDFS-9363 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986427#comment-14986427 ] Hadoop QA commented on HDFS-9308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9275) Wait previous ErasureCodingWork to finish before schedule another one

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986424#comment-14986424 ] Yi Liu commented on HDFS-9275: -- Looks good now, +1. > Wait previous ErasureCodingWork to fini

[jira] [Commented] (HDFS-2261) AOP unit tests are not getting compiled or run

2015-11-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986409#comment-14986409 ] Haohui Mai commented on HDFS-2261: -- +1 on removing them. > AOP unit tests are not getting

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2015-11-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986402#comment-14986402 ] Yi Liu commented on HDFS-9276: -- Liangliang, thanks for the update. See following comments. (I

[jira] [Commented] (HDFS-2261) AOP unit tests are not getting compiled or run

2015-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986391#comment-14986391 ] Karthik Kambatla commented on HDFS-2261: Just circling back. Has been two years sin

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986388#comment-14986388 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1352 (See [https://

[jira] [Updated] (HDFS-9354) Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows

2015-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9354: - Attachment: HDFS-9354.01.patch Attach patch that uses @After to ensure cluster shutdown for JUnit based tes

[jira] [Commented] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986369#comment-14986369 ] Hadoop QA commented on HDFS-9351: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986346#comment-14986346 ] Xiaoyu Yao commented on HDFS-9362: -- Change looks good to me. +1 pending Jenkins. > TestAu

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986315#comment-14986315 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #629 (See [htt

[jira] [Commented] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2015-11-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986303#comment-14986303 ] Zhe Zhang commented on HDFS-9289: - The test looks reasonable. I can see 2 minor issues: # {

[jira] [Commented] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986291#comment-14986291 ] Hadoop QA commented on HDFS-9312: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986279#comment-14986279 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #618 (See

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2015-11-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986273#comment-14986273 ] Daryn Sharp commented on HDFS-8674: --- [~mingma] It's a LinkedHashSet to cover the cases yo

[jira] [Commented] (HDFS-9318) considerLoad factor can be improved

2015-11-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986263#comment-14986263 ] Kihwal Lee commented on HDFS-9318: -- The precommit ran but failed to post the result becaus

[jira] [Commented] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986240#comment-14986240 ] Mingliang Liu commented on HDFS-9362: - +1 (non-binding) pending Jenkins. Thank you [~c

[jira] [Commented] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986237#comment-14986237 ] Arpit Agarwal commented on HDFS-9362: - +1 pending Jenkins. Thanks [~cnauroth]! > TestA

[jira] [Commented] (HDFS-9343) Empty caller context considered invalid

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986232#comment-14986232 ] Chris Nauroth commented on HDFS-9343: - The new tests written for this patch assume Unix

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986231#comment-14986231 ] Chris Nauroth commented on HDFS-9184: - The new tests written for this patch assume Unix

[jira] [Updated] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9362: Status: Patch Available (was: Open) > TestAuditLogger#testAuditLoggerWithCallContext assumes Unix li

[jira] [Updated] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9362: Attachment: HDFS-9362.001.patch Here is a patch that changes the asserts to be platform-neutral in th

[jira] [Created] (HDFS-9362) TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.

2015-11-02 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9362: --- Summary: TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Key: HDFS-9362 URL: https://issues.apache.org/jira/browse/HDFS-9362

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986227#comment-14986227 ] Hadoop QA commented on HDFS-7984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9361: -- Description: TestReplaceDatanodeOnFailure sometimes fail (See HDFS-6101). (For background informa

[jira] [Updated] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9361: -- Description: TestReplaceDatanodeOnFailure sometimes fail (See HDFS-6101). (For background informa

[jira] [Created] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9361: - Summary: Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently Key: HDFS-9361 URL: https://issues.apache.org/jira/browse/HDFS-9361

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-11-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.004.patch I had an offline discussion with [~yzhangal] and had learned a lo

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986203#comment-14986203 ] Hudson commented on HDFS-9339: -- FAILURE: Integrated in Hadoop-trunk-Commit #8744 (See [https:

[jira] [Commented] (HDFS-9360) Storage type usage isn't updated properly after file deletion

2015-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986190#comment-14986190 ] Hadoop QA commented on HDFS-9360: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8777) Erasure Coding: add tests for taking snapshots on EC files

2015-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986189#comment-14986189 ] Hudson commented on HDFS-8777: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2500 (See [https://

  1   2   >