[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958435#comment-14958435 ] Hudson commented on HDFS-9188: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #533 (See

[jira] [Commented] (HDFS-9044) Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958440#comment-14958440 ] Hadoop QA commented on HDFS-9044: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958452#comment-14958452 ] Hadoop QA commented on HDFS-9205: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958457#comment-14958457 ] Yongjun Zhang commented on HDFS-9092: - Thanks [~liuml07]. It'd be nice to find out why

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958515#comment-14958515 ] Hudson commented on HDFS-9188: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2436 (See [https://

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958556#comment-14958556 ] Hudson commented on HDFS-9188: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #499 (See [htt

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-10-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958576#comment-14958576 ] J.Andreina commented on HDFS-8545: -- bq. On a second thought, along with new overloaded API

[jira] [Updated] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-10-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8545: - Attachment: HDFS-8545.5.patch > Add an API to fetch the total file length from a specific path, apart from

[jira] [Updated] (HDFS-8545) Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path

2015-10-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8545: - Summary: Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a s

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958602#comment-14958602 ] Tsz Wo Nicholas Sze commented on HDFS-9205: --- The failed tests are not related. >

[jira] [Commented] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958665#comment-14958665 ] Hadoop QA commented on HDFS-8947: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958668#comment-14958668 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-trunk-Commit #8641 (See [https:

[jira] [Updated] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9205: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Statu

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958688#comment-14958688 ] Tsz Wo Nicholas Sze commented on HDFS-9053: --- {noformat} 24 8 Object[] No

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958697#comment-14958697 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-trunk-Commit #8642 (See [https:

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958696#comment-14958696 ] Walter Su commented on HDFS-9139: - Hi, guys! I have a question: Is it parallel in test suit

[jira] [Created] (HDFS-9248) Fix some tests failed because of JUnit run in parallel after HDFS-9139

2015-10-15 Thread Walter Su (JIRA)
Walter Su created HDFS-9248: --- Summary: Fix some tests failed because of JUnit run in parallel after HDFS-9139 Key: HDFS-9248 URL: https://issues.apache.org/jira/browse/HDFS-9248 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8050) Separate the client conf key from DFSConfigKeys

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958704#comment-14958704 ] Tsz Wo Nicholas Sze commented on HDFS-8050: --- We moved some client conf properties

[jira] [Updated] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

2015-10-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9219: - Attachment: HDFS-9219.1.patch Attached an initial patch . Please review. > Even if permission is enabled i

[jira] [Updated] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

2015-10-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9219: - Status: Patch Available (was: Open) > Even if permission is enabled in an environment, while resolving res

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958750#comment-14958750 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1271 (See [https://

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958761#comment-14958761 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #535 (See

[jira] [Commented] (HDFS-8545) Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958763#comment-14958763 ] Hadoop QA commented on HDFS-8545: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958771#comment-14958771 ] Vinayakumar B commented on HDFS-9139: - AFAIK, Its testsuite in parallel. bq. It looks l

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958786#comment-14958786 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #548 (See [htt

[jira] [Commented] (HDFS-8545) Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path

2015-10-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958793#comment-14958793 ] Vinayakumar B commented on HDFS-8545: - Thanks [~andreina] for the update. Refactor loo

[jira] [Updated] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9157: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958805#comment-14958805 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-trunk-Commit #8643 (See [https:

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958816#comment-14958816 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2484 (See [htt

[jira] [Commented] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958836#comment-14958836 ] Hadoop QA commented on HDFS-9219: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9246) TestGlobPaths#pTestCurlyBracket is failing

2015-10-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9246: --- Attachment: HDFS-9246.01.patch > TestGlobPaths#pTestCurlyBracket is failing > -

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958857#comment-14958857 ] Walter Su commented on HDFS-9139: - Yes, you're right. Thanks! > Enable parallel JUnit test

[jira] [Resolved] (HDFS-9248) Fix some tests failed because of JUnit run in parallel after HDFS-9139

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-9248. - Resolution: Invalid > Fix some tests failed because of JUnit run in parallel after HDFS-9139 >

[jira] [Updated] (HDFS-9246) TestGlobPaths#pTestCurlyBracket is failing

2015-10-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9246: --- Attachment: (was: HDFS-9246.01.patch) > TestGlobPaths#pTestCurlyBracket is failing

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958923#comment-14958923 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2438 (See [https://

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958924#comment-14958924 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2438 (See [https://

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

2015-10-15 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Status: Open (was: Patch Available) > Minicluster with Kerberos generates some stacks when check

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

2015-10-15 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Status: Patch Available (was: Open) retriggering a hadoopqa run... > Minicluster with Kerberos

[jira] [Updated] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

2015-10-15 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-9213: -- Attachment: hdfs-9213.v1.patch > Minicluster with Kerberos generates some stacks when checking th

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9173: Attachment: HDFS-9173.04.patch #1, Done. Good catch. #2, Done. "public" is removed. (It is for step 3.) #3, d

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9173: Status: Patch Available (was: Open) > Erasure Coding: Lease recovery for striped file >

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958954#comment-14958954 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #549 (See [htt

[jira] [Commented] (HDFS-9139) Enable parallel JUnit tests for HDFS Pre-commit

2015-10-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958967#comment-14958967 ] Chris Nauroth commented on HDFS-9139: - Vinay is correct. I specifically chose parallel

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958985#comment-14958985 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #536 (See

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958993#comment-14958993 ] Hudson commented on HDFS-9157: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1272 (See [https://

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959008#comment-14959008 ] Tony Wu commented on HDFS-9236: --- Thanks to [~yzhangal] for offline review and valuable commen

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959049#comment-14959049 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2485 (See [htt

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-10-15 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-9083: - Target Version/s: 2.8.0 (was: 3.0.0, 2.8.0) > Replication violates block placement policy. > -

[jira] [Commented] (HDFS-9213) Minicluster with Kerberos generates some stacks when checking the ports

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959062#comment-14959062 ] Hadoop QA commented on HDFS-9213: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9236: -- Attachment: HDFS-9236.002.patch Removed block size check on NN. > Missing sanity check for block size during blo

[jira] [Resolved] (HDFS-9246) TestGlobPaths#pTestCurlyBracket is failing

2015-10-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-9246. Resolution: Fixed I've reverted the patch that caused this issue, so closing this one. > Tes

[jira] [Commented] (HDFS-8947) NameNode, DataNode and NFS gateway to support JvmPauseMonitor as a service

2015-10-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959098#comment-14959098 ] Sunil G commented on HDFS-8947: --- A clean jenkins run is not achieved now also. I tried to run

[jira] [Created] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9249: - Summary: NPE thrown if an IOException is thrown in NameNode. Key: HDFS-9249 URL: https://issues.apache.org/jira/browse/HDFS-9249 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959119#comment-14959119 ] Wei-Chiu Chuang commented on HDFS-9249: --- The IOException can only be thrown by NameNo

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Labels: supportability (was: ) > NPE thrown if an IOException is thrown in NameNode. > -

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959157#comment-14959157 ] Yongjun Zhang commented on HDFS-9236: - Hi [~twu], Thanks for reporting the finding out

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959161#comment-14959161 ] Kihwal Lee commented on HDFS-9220: -- Test failures seem unrelated. They failed due to {{ja

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9220: - Fix Version/s: 2.7.2 3.0.0 > Reading small file (< 512 bytes) that is open for append fa

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959171#comment-14959171 ] Steve Loughran commented on HDFS-9249: -- If its being raised by ugi/keytab load faiiure

[jira] [Updated] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9220: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Reading

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959175#comment-14959175 ] Kihwal Lee commented on HDFS-9220: -- I've committed this to trunk, branch-2 and branch-2.7.

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959183#comment-14959183 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-trunk-Commit #8645 (See [https:

[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959191#comment-14959191 ] Hudson commented on HDFS-9157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #501 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959192#comment-14959192 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #501 (See [htt

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959220#comment-14959220 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #551 (See [htt

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959251#comment-14959251 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2487 (See [htt

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959253#comment-14959253 ] Tony Wu commented on HDFS-9236: --- Hi [~yzhangal], Thanks a lot for looking at the patch. Rega

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959255#comment-14959255 ] Hadoop QA commented on HDFS-9236: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9219) Even if permission is enabled in an environment, while resolving reserved paths there is no check on permission.

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959264#comment-14959264 ] Mingliang Liu commented on HDFS-9219: - Thank you for elaborating this. It makes sense t

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959267#comment-14959267 ] James Clampffer commented on HDFS-9207: --- +1 > Move the implementation to the hdfs-na

[jira] [Resolved] (HDFS-9247) Add an Apache license header to DatanodeStats.java

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HDFS-9247. - Resolution: Fixed > Add an Apache license header to DatanodeStats.java > --

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-15 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959287#comment-14959287 ] Bob Hansen commented on HDFS-9207: -- +1 > Move the implementation to the hdfs-native-clien

[jira] [Created] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9250: --- Summary: LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty Key: HDFS-9250 URL: https://issues.apache.org/jira/browse/HDFS-9250 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959292#comment-14959292 ] Jitendra Nath Pandey commented on HDFS-9184: [~liuml07], I think the InterfaceA

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Attachment: HDFS-9250.001.patch Patch 001 fixes the described exception. Added test case in a new test class

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Status: Patch Available (was: Open) > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959329#comment-14959329 ] Mingliang Liu commented on HDFS-9092: - It happens to me sometimes when the Jenkins did

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959332#comment-14959332 ] Yongjun Zhang commented on HDFS-3059: - HI [~xiaochen], Thanks for working on this issu

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959355#comment-14959355 ] Mingliang Liu commented on HDFS-9092: - s/Do/Does/ > Nfs silently drops overlapping wri

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959361#comment-14959361 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1274 (See [https://

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959367#comment-14959367 ] Anu Engineer commented on HDFS-4015: [~liuml07] Thanks for looking that the Hadoop QA r

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9223: - Issue Type: Sub-task (was: Bug) Parent: HDFS-8966 > Code cleanup for DatanodeDescriptor and Heartb

[jira] [Resolved] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-9207. -- Resolution: Fixed Committed to the HDFS-8707 branch. Thanks James and Bob for the reviews! > Move the im

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959385#comment-14959385 ] Jitendra Nath Pandey commented on HDFS-9184: [~liuml07], I think it will be a g

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959398#comment-14959398 ] Rakesh R commented on HDFS-9173: Awesome work [~walter.k.su], its really interesting. I've

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959400#comment-14959400 ] Wei-Chiu Chuang commented on HDFS-9249: --- [~ste...@apache.org] Thanks for the suggesti

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9236: -- Attachment: HDFS-9236.003.patch Addressed [~yzhangal]'s review comments. > Missing sanity check for block size d

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959412#comment-14959412 ] Wei-Chiu Chuang commented on HDFS-9249: --- Hadoop JIRA does not allow me to edit commen

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.001.patch Check for null pointer, and add more verbose log info when IOExce

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959417#comment-14959417 ] Yongjun Zhang commented on HDFS-9236: - Hi [~twu], Thanks for the updated rev 3 which l

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Status: Patch Available (was: Open) > NPE thrown if an IOException is thrown in NameNode. >

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959431#comment-14959431 ] Kihwal Lee commented on HDFS-9208: -- [~liuml07] Are you actively working on this? > Disabl

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7964: -- Attachment: HDFS-7964.patch Updated, simplified. > Add support for async edit logging >

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959448#comment-14959448 ] Daryn Sharp commented on HDFS-9198: --- Most of the test failures are a race condition from

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.03.patch Updating the patch to fix all reported test failures. Main change is to add l

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959475#comment-14959475 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #538 (See

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959496#comment-14959496 ] Mingliang Liu commented on HDFS-9208: - Hi [~kihwal], this is on my list this week but I

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9208: Assignee: Kihwal Lee (was: Mingliang Liu) > Disabling atime may fail clients like distCp > -

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959556#comment-14959556 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959561#comment-14959561 ] Hadoop QA commented on HDFS-9250: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

  1   2   >