[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9516: -- Fix Version/s: (was: 2.9.0) 2.7.3 Committed to branch-2.8 and bran

[jira] [Commented] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061710#comment-15061710 ] Hudson commented on HDFS-9516: -- FAILURE: Integrated in Hadoop-trunk-Commit #8983 (See [https:

[jira] [Updated] (HDFS-8477) describe dfs.ha.zkfc.port in hdfs-default.xml

2015-12-17 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-8477: -- Attachment: HDFS-8477-04.patch > describe dfs.ha.zkfc.port in hdfs-default.xml >

[jira] [Commented] (HDFS-8477) describe dfs.ha.zkfc.port in hdfs-default.xml

2015-12-17 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061753#comment-15061753 ] Kanaka Kumar Avvaru commented on HDFS-8477: --- Yes, it is RPC port. Thanks for corr

[jira] [Commented] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061826#comment-15061826 ] Steve Loughran commented on HDFS-9508: -- [~jojochuang] you can move JIRAs under the "Mo

[jira] [Commented] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061856#comment-15061856 ] Hadoop QA commented on HDFS-9393: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8477) describe dfs.ha.zkfc.port in hdfs-default.xml

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061914#comment-15061914 ] Hadoop QA commented on HDFS-8477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-9571: -- Summary: Fix ASF Licence warnings in Jenkins reports Key: HDFS-9571 URL: https://issues.apache.org/jira/browse/HDFS-9571 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061973#comment-15061973 ] Wei-Chiu Chuang commented on HDFS-9508: --- Thank you for the tips! It's embarrassing to

[jira] [Updated] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9571: --- Status: Patch Available (was: Open) > Fix ASF Licence warnings in Jenkins reports > --

[jira] [Updated] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9571: --- Attachment: HDFS-9571.patch > Fix ASF Licence warnings in Jenkins reports > ---

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-12-17 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-7866: - Attachment: HDFS-7866.4.patch The v4 patch is mainly for review and testing. It basically includes: 1. Add a new sy

[jira] [Updated] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-12-17 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-7866: - Status: Patch Available (was: In Progress) > Erasure coding: NameNode manages EC schemas > ---

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062040#comment-15062040 ] Tsz Wo Nicholas Sze commented on HDFS-9173: --- - {code} final long safeLengt

[jira] [Updated] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9515: -- Attachment: HDFS-9515.003.patch There are around 103 potential occurrence. {noformat} find . -nam

[jira] [Commented] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062048#comment-15062048 ] Hadoop QA commented on HDFS-9515: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9515: -- Attachment: HDFS-9515.004.patch Rev04: rebased my local repo and made a new patch. > NPE in Test

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062166#comment-15062166 ] Hadoop QA commented on HDFS-9571: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages EC schemas

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062185#comment-15062185 ] Hadoop QA commented on HDFS-7866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9570: --- Assignee: Travis Campbell Status: Patch Available (was: Open) > Minor typos, grammar, an

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062217#comment-15062217 ] Brahma Reddy Battula commented on HDFS-9571: {{TestMiniDFSCluster.java}} and {{

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062218#comment-15062218 ] Hadoop QA commented on HDFS-9570: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9561) PIpieline recovery near the end of a block may fail

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062255#comment-15062255 ] Kihwal Lee commented on HDFS-9561: -- {{recoverClose()}} itself works fine. If a block is al

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062272#comment-15062272 ] Kihwal Lee commented on HDFS-9569: -- +1 looks good to me. > Log the name of the fsimage be

[jira] [Updated] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-9570: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9569: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved (was:

[jira] [Updated] (HDFS-8765) Implement local block reader in libhdfspp

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8765: -- Attachment: short_circuit_demo.patch Adding a hacked together demo of the short circuit protocol.

[jira] [Commented] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062307#comment-15062307 ] Hadoop QA commented on HDFS-9515: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9572: --- Summary: Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Key: HDFS-9572 URL: https://issues.apache.org/jira/browse/HDFS-9572

[jira] [Commented] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062311#comment-15062311 ] Kihwal Lee commented on HDFS-9393: -- +1 from me too. > After choosing favored nodes, choo

[jira] [Updated] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9572: Status: Patch Available (was: Open) > Prevent DataNode log spam if a client connects on the data tra

[jira] [Updated] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9572: Attachment: HDFS-9572.001.patch I'm attaching a patch. We already skipped logging the {{EOFException

[jira] [Commented] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062321#comment-15062321 ] Wei-Chiu Chuang commented on HDFS-9515: --- javac warnings are false positives. TestJMX

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062343#comment-15062343 ] Hudson commented on HDFS-9569: -- FAILURE: Integrated in Hadoop-trunk-Commit #8984 (See [https:

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062344#comment-15062344 ] Hudson commented on HDFS-9570: -- FAILURE: Integrated in Hadoop-trunk-Commit #8984 (See [https:

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062358#comment-15062358 ] Yongjun Zhang commented on HDFS-9569: - Thanks a lot [~kihwal] for the review and commit

[jira] [Updated] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9571: --- Attachment: HDFS-9571-002.patch > Fix ASF Licence warnings in Jenkins reports > ---

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062381#comment-15062381 ] Brahma Reddy Battula commented on HDFS-9571: {quote} -1 asflicense 0m

[jira] [Updated] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9515: -- Attachment: HDFS-9515.005.patch Rev05: reset cluster to null in @Before method; make sure cluster

[jira] [Commented] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062496#comment-15062496 ] James Clampffer commented on HDFS-9325: --- I get an error when trying to build, I'm gue

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062511#comment-15062511 ] Chris Nauroth commented on HDFS-9571: - [~ste...@apache.org], this overlaps somewhat wit

[jira] [Updated] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9565: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062521#comment-15062521 ] Chris Nauroth commented on HDFS-9552: - The whitespace warning was triggered on a file n

[jira] [Updated] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9552: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062533#comment-15062533 ] Arpit Agarwal commented on HDFS-9572: - +1 for the patch, pending Jenkins. I also verif

[jira] [Updated] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9487: -- Attachment: HDFS-9487.HDFS-8707.002.patch Thanks for the patch [~bobthansen]! It works for me wi

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062544#comment-15062544 ] Wei-Chiu Chuang commented on HDFS-9565: --- Thank you very much! [~arpitagarwal] > Test

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062555#comment-15062555 ] Chris Nauroth commented on HDFS-9570: - [~aw], do you mind if I merge this down through

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062560#comment-15062560 ] Allen Wittenauer commented on HDFS-9570: *shrugs* If you want. I always avoid branc

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062568#comment-15062568 ] Hudson commented on HDFS-9552: -- FAILURE: Integrated in Hadoop-trunk-Commit #8985 (See [https:

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062569#comment-15062569 ] Hudson commented on HDFS-9565: -- FAILURE: Integrated in Hadoop-trunk-Commit #8985 (See [https:

[jira] [Commented] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062600#comment-15062600 ] Hadoop QA commented on HDFS-9572: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-3599) Better expose when under-construction files are preventing DN decommission

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-3599: --- Assignee: Zhe Zhang > Better expose when under-construction files are preventing DN decommission > ---

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062643#comment-15062643 ] Steve Loughran commented on HDFS-9571: -- chris, I've been too busy to finish off '9263,

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062661#comment-15062661 ] Chris Nauroth commented on HDFS-9570: - I'd like to get the doc improvements visible on

[jira] [Created] (HDFS-9573) o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals

2015-12-17 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9573: Summary: o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals Key: HDFS-9573 URL: https://issues.apache.org/jira/browse/HDFS-9573 Project

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062668#comment-15062668 ] Chris Nauroth commented on HDFS-9571: - [~ste...@apache.org], thanks for the go-ahead.

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062686#comment-15062686 ] Hadoop QA commented on HDFS-9571: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9515) Avoid calling MiniDFSCluster#shutdown if the cluster was not started successfully

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9515: Summary: Avoid calling MiniDFSCluster#shutdown if the cluster was not started successfully (was: NPE

[jira] [Commented] (HDFS-9515) Avoid calling MiniDFSCluster#shutdown if the cluster was not started successfully

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062689#comment-15062689 ] Arpit Agarwal commented on HDFS-9515: - +1 Thanks for the comprehensive patch [~jojochu

[jira] [Commented] (HDFS-9515) Avoid calling MiniDFSCluster#shutdown if the cluster was not started successfully

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062691#comment-15062691 ] Arpit Agarwal commented on HDFS-9515: - I will commit it once Jenkins comes back with re

[jira] [Commented] (HDFS-9571) Fix ASF Licence warnings in Jenkins reports

2015-12-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062717#comment-15062717 ] Uma Maheswara Rao G commented on HDFS-9571: --- Thank you Brahma for taking care of

[jira] [Commented] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062740#comment-15062740 ] Hadoop QA commented on HDFS-9487: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062745#comment-15062745 ] Hudson commented on HDFS-9570: -- FAILURE: Integrated in Hadoop-trunk-Commit #8986 (See [https:

[jira] [Updated] (HDFS-8765) Implement local block reader in libhdfspp

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8765: -- Attachment: short-circuit-demo.patch2 Cleaned up the demo slightly. Got rid of all the old accri

[jira] [Updated] (HDFS-9373) Erasure coding: friendly log information for write operations with some failed streamers

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Summary: Erasure coding: friendly log information for write operations with some failed streamers (was: Show

[jira] [Updated] (HDFS-9373) Erasure coding: friendly log information for write operations with some failed streamers

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: P

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062825#comment-15062825 ] Zhe Zhang commented on HDFS-9347: - Thanks Wei-Chiu. New patch does look cleaner. Actually

[jira] [Commented] (HDFS-9373) Erasure coding: friendly log information for write operations with some failed streamers

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062843#comment-15062843 ] Hudson commented on HDFS-9373: -- FAILURE: Integrated in Hadoop-trunk-Commit #8987 (See [https:

[jira] [Commented] (HDFS-9515) Avoid calling MiniDFSCluster#shutdown if the cluster was not started successfully

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062868#comment-15062868 ] Hadoop QA commented on HDFS-9515: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9515) NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9515: Summary: NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference (was: Avoid calling

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062880#comment-15062880 ] Zhe Zhang commented on HDFS-9173: - bq. syncList contains both data and parity blocks {{getS

[jira] [Updated] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9487: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++ Enable builds with

[jira] [Commented] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

2015-12-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062887#comment-15062887 ] James Clampffer commented on HDFS-9487: --- Committed to HDFS-8707. Thanks for the cont

[jira] [Updated] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9347: -- Attachment: HDFS-9347.004.patch Rev04: assert a failure in assertNoThreadsMatching() if anyThread

[jira] [Updated] (HDFS-9515) NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference

2015-12-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9515: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Reopened] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-9569: - I have reverted this patch from trunk, branch-2, branch-2.8 and branch-2.7. This patch introduced a t

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062920#comment-15062920 ] Chris Nauroth commented on HDFS-9569: - Pre-commit did flag the test failure in the last

[jira] [Updated] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9572: Hadoop Flags: Reviewed The license warnings are a known issue tracked in HDFS-9571. There are no new

[jira] [Commented] (HDFS-9515) NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062938#comment-15062938 ] Wei-Chiu Chuang commented on HDFS-9515: --- Thanks [~arpitagarwal] for reviewing this hu

[jira] [Updated] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9347: -- Attachment: (was: HDFS-9347.004.patch) > Invariant assumption in TestQuorumJournalManager.shu

[jira] [Commented] (HDFS-9515) NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062943#comment-15062943 ] Hudson commented on HDFS-9515: -- FAILURE: Integrated in Hadoop-trunk-Commit #8989 (See [https:

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062942#comment-15062942 ] Hudson commented on HDFS-9569: -- FAILURE: Integrated in Hadoop-trunk-Commit #8989 (See [https:

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15062945#comment-15062945 ] Hadoop QA commented on HDFS-9347: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9347: -- Attachment: HDFS-9347.004.patch Forgot the rebase my local repo. Re-attach the patch. > Invarian

[jira] [Updated] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9572: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) I h

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-12-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163.005.patch [~daryn], thank you very much for your in-depth analysis and helpful commen

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063023#comment-15063023 ] Daryn Sharp commented on HDFS-9533: --- +1. Fully agree non-active has no business touching

[jira] [Created] (HDFS-9574) Reduce client failures during datanode restart

2015-12-17 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-9574: Summary: Reduce client failures during datanode restart Key: HDFS-9574 URL: https://issues.apache.org/jira/browse/HDFS-9574 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9574) Reduce client failures during datanode restart

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063037#comment-15063037 ] Kihwal Lee commented on HDFS-9574: -- Read fails like this: {noformat} java.io.IOException:

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063038#comment-15063038 ] Zhe Zhang commented on HDFS-9347: - Thanks Wei-Chiu. +1 on the 04 patch pending a few minors

[jira] [Assigned] (HDFS-9574) Reduce client failures during datanode restart

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-9574: Assignee: Kihwal Lee > Reduce client failures during datanode restart >

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Attachment: HDFS-9574.patch Since {{DataXceiverServer}} is shared by multiple block pools, we cannot simply

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Status: Patch Available (was: Open) > Reduce client failures during datanode restart > ---

[jira] [Commented] (HDFS-9572) Prevent DataNode log spam if a client connects on the data transfer port but sends no data.

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063050#comment-15063050 ] Hudson commented on HDFS-9572: -- FAILURE: Integrated in Hadoop-trunk-Commit #8990 (See [https:

[jira] [Updated] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9347: -- Attachment: HDFS-9347.005.patch Rev05: address Zhe's comments. IntelliJ automatically indent my c

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063069#comment-15063069 ] Hadoop QA commented on HDFS-9347: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-12-17 Thread Yanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063079#comment-15063079 ] Yanping Wang commented on HDFS-8562: Oracle Java team had a bug/issue filed for this is

[jira] [Updated] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9533: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 3.0.0

[jira] [Commented] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2015-12-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063119#comment-15063119 ] Hudson commented on HDFS-9533: -- FAILURE: Integrated in Hadoop-trunk-Commit #8991 (See [https:

  1   2   >