[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960263#comment-14960263 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Comment Edited] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960114#comment-14960114 ] Yi Liu edited comment on HDFS-7964 at 10/16/15 6:40 AM: Thanks [~da

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960230#comment-14960230 ] Jing Zhao commented on HDFS-9129: - Thanks for the work, Mingliang! Glad to hear that finall

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960222#comment-14960222 ] Walter Su commented on HDFS-9173: - Oh, I get your point. I can do that. I must be very care

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960207#comment-14960207 ] Hadoop QA commented on HDFS-9253: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9254: Status: Patch Available (was: In Progress) > HDFS Secure Mode Documentation updates > --

[jira] [Updated] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9254: Attachment: HDFS-9254.01.patch v1 patch. # Documents missing settings in hdfs-default.xml. # Add more

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.005.patch The failing test is not related. The v5 patch is not tracking safe bl

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Attachment: HDFS-9253.002.patch > Refactor tests of libhdfs into a directory >

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960162#comment-14960162 ] Zhe Zhang commented on HDFS-9173: - bq. #2. about syncBlockFinalized, syncBlockUnfinalized.

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to FsDatasetTestUtils to get block file size and genstamp.

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960161#comment-14960161 ] Hadoop QA commented on HDFS-9252: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Open (was: Patch Available) > Logging HDFS operation's caller context into audit logs >

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Status: Patch Available (was: Open) > Logging HDFS operation's caller context into audit logs >

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960144#comment-14960144 ] Hadoop QA commented on HDFS-7964: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8425) [umbrella] Performance tuning, investigation and optimization for erasure coding

2015-10-15 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Fukudome updated HDFS-8425: -- Attachment: testdfsio-read-mbsec.png testdfsio-write-mbsec.png Hi. I have ran Tes

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960115#comment-14960115 ] Walter Su commented on HDFS-9173: - bq. #2. about {{syncBlockFinalized}}, {{syncBlockUnfinal

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7964: - Status: Patch Available (was: Open) > Add support for async edit logging > -- > >

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960114#comment-14960114 ] Yi Liu commented on HDFS-7964: -- Thanks [~daryn] for the work. Further comments: *1.* In FSEd

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960100#comment-14960100 ] Hadoop QA commented on HDFS-9253: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960092#comment-14960092 ] Walter Su commented on HDFS-9173: - bq. #3, In StripedRecoveryTask#recover we are calling ca

[jira] [Updated] (HDFS-8972) EINVAL Invalid argument when RAM_DISK usage 90%+

2015-10-15 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Chen updated HDFS-8972: -- Description: the directory which uses LAZY_PERSIST policy , so use "df" command look up tmpfs is usage >=90% ,

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to FsDatasetTestUtils to get block file size and genstamp.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Status: Patch Available (was: Open) > Change TestFileTruncate to FsDatasetTestUtils to get block fil

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960050#comment-14960050 ] Ming Ma commented on HDFS-8647: --- [~brahmareddy], can you please check again if TestBalancer a

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960044#comment-14960044 ] Xiao Chen commented on HDFS-9250: - Hi Andrew, thanks for the comments and additional inform

[jira] [Created] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-15 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-9254: --- Summary: HDFS Secure Mode Documentation updates Key: HDFS-9254 URL: https://issues.apache.org/jira/browse/HDFS-9254 Project: Hadoop HDFS Issue Type: Bug

[jira] [Work started] (HDFS-9254) HDFS Secure Mode Documentation updates

2015-10-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9254 started by Arpit Agarwal. --- > HDFS Secure Mode Documentation updates > -- >

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960039#comment-14960039 ] Andrew Wang commented on HDFS-9250: --- It may also be good to add a Precondition check some

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960038#comment-14960038 ] Andrew Wang commented on HDFS-9250: --- Hi Xiao, thanks for working on this, So one questio

[jira] [Commented] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960033#comment-14960033 ] Hadoop QA commented on HDFS-9245: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapsho

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960018#comment-14960018 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9205) Do not schedule corrupt blocks for replication

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9205: -- Fix Version/s: (was: 3.0.0) 2.8.0 Merged this to branch-2. > Do n

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960014#comment-14960014 ] Xiao Chen commented on HDFS-3059: - Thanks Yongjun for the comments. Attached patch 06 addre

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960011#comment-14960011 ] Hadoop QA commented on HDFS-9251: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960004#comment-14960004 ] Wei-Chiu Chuang commented on HDFS-9249: --- This is more of a supportability improvement

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Attachment: HDFS-3059.06.patch > ssl-server.xml causes NullPointer > - > >

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Open (was: Patch Available) > ssl-server.xml causes NullPointer > -

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Attachment: HDFS-9253.001.patch > Refactor tests of libhdfs into a directory >

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959988#comment-14959988 ] Yi Liu commented on HDFS-9053: -- Hi Nicholas, sorry, I may bypass some description here. For 2

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959972#comment-14959972 ] Tsz Wo Nicholas Sze commented on HDFS-9053: --- > For small elements size (assume #

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959955#comment-14959955 ] Yi Liu edited comment on HDFS-9053 at 10/16/15 12:56 AM: - Thanks [~

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959955#comment-14959955 ] Yi Liu commented on HDFS-9053: -- Thanks [~szetszwo] for the comments. {quote} >> 24 8 Obje

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959950#comment-14959950 ] Hadoop QA commented on HDFS-9253: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959929#comment-14959929 ] Hadoop QA commented on HDFS-9184: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.002.patch Patch 002 with more tests added. > Reconfigure DN concurrent move on

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Attachment: HDFS-9245.000.patch Hi [~yzhangal], please review the patch v0. Thanks. > Fix findbugs w

[jira] [Updated] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9245: Status: Patch Available (was: Open) > Fix findbugs warnings in hdfs-nfs/WriteCtx > -

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959884#comment-14959884 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2440 (See [https://

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959859#comment-14959859 ] Zhe Zhang commented on HDFS-9173: - Thanks Walter for the updates. Some additional comments:

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.004.patch The v4 patch is to address the failing tests and further refactoring

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959826#comment-14959826 ] Daryn Sharp commented on HDFS-9239: --- It seems like a good idea at first, but I don't thin

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959819#comment-14959819 ] Haohui Mai commented on HDFS-9253: -- The v0 patch moves the tests of libhdfs into the {{lib

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Attachment: HDFS-9253.000.patch > Refactor tests of libhdfs into a directory >

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Status: Patch Available (was: Open) > Refactor tests of libhdfs into a directory > ---

[jira] [Created] (HDFS-9253) Refactor tests of libhdfs into a directory

2015-10-15 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9253: Summary: Refactor tests of libhdfs into a directory Key: HDFS-9253 URL: https://issues.apache.org/jira/browse/HDFS-9253 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9251: Attachment: HDFS-9251.01.patch Address whitespace warnings. The findbugs warnings and test failures

[jira] [Commented] (HDFS-8831) Trash Support for files in HDFS encryption zone

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959792#comment-14959792 ] Mingliang Liu commented on HDFS-8831: - Thanks for working on this. The design doc is ve

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959786#comment-14959786 ] Hadoop QA commented on HDFS-9251: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959780#comment-14959780 ] Hadoop QA commented on HDFS-8766: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8831) Trash Support for files in HDFS encryption zone

2015-10-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Attachment: HDFS-8831-10152015.pdf Attach a design document for review and discussion. > Trash Support fo

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.006.patch Stripped stuff out. > Implement a libhdfs(3) compatibl

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959752#comment-14959752 ] Hadoop QA commented on HDFS-9198: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to FsDatasetTestUtils to get block file size and genstamp.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Attachment: HDFS-9252.00.patch Add {{getDataLenght()}} and {{getPersistentGenStamp()}} to {{FsDatase

[jira] [Created] (HDFS-9252) Change TestFileTruncate to FsDatasetTestUtils to get block file size and genstamp.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9252: --- Summary: Change TestFileTruncate to FsDatasetTestUtils to get block file size and genstamp. Key: HDFS-9252 URL: https://issues.apache.org/jira/browse/HDFS-9252 Project:

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959726#comment-14959726 ] Hadoop QA commented on HDFS-9079: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959715#comment-14959715 ] Hadoop QA commented on HDFS-9249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959676#comment-14959676 ] Hadoop QA commented on HDFS-9236: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9198: -- Attachment: HDFS-9198-trunk.patch Took care of minor findbugs warning, cleanup up most of the silly style

[jira] [Updated] (HDFS-9083) Replication violates block placement policy.

2015-10-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-9083: --- Priority: Blocker (was: Major) > Replication violates block placement policy. > --

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959577#comment-14959577 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #502 (See [htt

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959574#comment-14959574 ] Xiao Chen commented on HDFS-9250: - The Findbugs warning and test failure are not relevant.

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9251: Status: Patch Available (was: Open) > Refactor TestWriteToReplica and TestFsDatasetImpl to avoid exp

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9251: Attachment: HDFS-9251.00.patch This patch: * Add {{CreateFinalizedReplica}}, {{CreateRbw}}, {{CreateR

[jira] [Created] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-15 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9251: --- Summary: Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code. Key: HDFS-9251 URL: https://issues.apache.org/jira/browse/HDFS-9251

[jira] [Updated] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9184: Attachment: HDFS-9184.007.patch Thanks for your view, [~jnp]. The v7 patch addresses the latest comme

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959561#comment-14959561 ] Hadoop QA commented on HDFS-9250: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

2015-10-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959556#comment-14959556 ] Hadoop QA commented on HDFS-9129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959496#comment-14959496 ] Mingliang Liu commented on HDFS-9208: - Hi [~kihwal], this is on my list this week but I

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9208: Assignee: Kihwal Lee (was: Mingliang Liu) > Disabling atime may fail clients like distCp > -

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959475#comment-14959475 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #538 (See

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.03.patch Updating the patch to fix all reported test failures. Main change is to add l

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959448#comment-14959448 ] Daryn Sharp commented on HDFS-9198: --- Most of the test failures are a race condition from

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2015-10-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7964: -- Attachment: HDFS-7964.patch Updated, simplified. > Add support for async edit logging >

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959431#comment-14959431 ] Kihwal Lee commented on HDFS-9208: -- [~liuml07] Are you actively working on this? > Disabl

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Status: Patch Available (was: Open) > NPE thrown if an IOException is thrown in NameNode. >

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959417#comment-14959417 ] Yongjun Zhang commented on HDFS-9236: - Hi [~twu], Thanks for the updated rev 3 which l

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.001.patch Check for null pointer, and add more verbose log info when IOExce

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959412#comment-14959412 ] Wei-Chiu Chuang commented on HDFS-9249: --- Hadoop JIRA does not allow me to edit commen

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-10-15 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Wu updated HDFS-9236: -- Attachment: HDFS-9236.003.patch Addressed [~yzhangal]'s review comments. > Missing sanity check for block size d

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

2015-10-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959400#comment-14959400 ] Wei-Chiu Chuang commented on HDFS-9249: --- [~ste...@apache.org] Thanks for the suggesti

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-10-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959398#comment-14959398 ] Rakesh R commented on HDFS-9173: Awesome work [~walter.k.su], its really interesting. I've

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-15 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959385#comment-14959385 ] Jitendra Nath Pandey commented on HDFS-9184: [~liuml07], I think it will be a g

[jira] [Resolved] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-9207. -- Resolution: Fixed Committed to the HDFS-8707 branch. Thanks James and Bob for the reviews! > Move the im

[jira] [Updated] (HDFS-9223) Code cleanup for DatanodeDescriptor and HeartbeatManager

2015-10-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9223: - Issue Type: Sub-task (was: Bug) Parent: HDFS-8966 > Code cleanup for DatanodeDescriptor and Heartb

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

2015-10-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959367#comment-14959367 ] Anu Engineer commented on HDFS-4015: [~liuml07] Thanks for looking that the Hadoop QA r

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959361#comment-14959361 ] Hudson commented on HDFS-9220: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1274 (See [https://

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959355#comment-14959355 ] Mingliang Liu commented on HDFS-9092: - s/Do/Does/ > Nfs silently drops overlapping wri

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959332#comment-14959332 ] Yongjun Zhang commented on HDFS-3059: - HI [~xiaochen], Thanks for working on this issu

[jira] [Commented] (HDFS-9092) Nfs silently drops overlapping write requests and causes data copying to fail

2015-10-15 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959329#comment-14959329 ] Mingliang Liu commented on HDFS-9092: - It happens to me sometimes when the Jenkins did

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Status: Patch Available (was: Open) > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is

  1   2   >