[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.006.patch As per offline discussion, the v6 patch prefers synchronized {{getSaf

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961728#comment-14961728 ] Hadoop QA commented on HDFS-9250: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8671) Add client support for HTTP/2 stream channels

[ https://issues.apache.org/jira/browse/HDFS-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-8671: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed to H

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961710#comment-14961710 ] Akira AJISAKA commented on HDFS-8836: - Some comments from me. {code} +skipEmpt

[jira] [Commented] (HDFS-8836) Skip newline on empty files with getMerge -nl

[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961682#comment-14961682 ] Akira AJISAKA commented on HDFS-8836: - Sorry for late response. bq. One could set up m

[jira] [Commented] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961680#comment-14961680 ] Arpit Agarwal commented on HDFS-8880: - I'll address #3 by eliminating the extra thread.

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Attachment: (was: HDFS-9250.002.patch) > LocatedBlock#addCachedLoc may throw ArrayStoreException when cac

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Status: Patch Available (was: Open) > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961646#comment-14961646 ] Xiao Chen commented on HDFS-9250: - Hey [~andrew.wang], Thanks again for bringing up HDFS-8

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Attachment: HDFS-9250.002.patch > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Attachment: HDFS-9250.002.patch > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[jira] [Commented] (HDFS-8671) Add client support for HTTP/2 stream channels

[ https://issues.apache.org/jira/browse/HDFS-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961635#comment-14961635 ] Haohui Mai commented on HDFS-8671: -- LGTM. +1 > Add client support for HTTP/2 stream chann

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961607#comment-14961607 ] Colin Patrick McCabe commented on HDFS-9251: Thanks, [~eddyxu]. {code} 222

[jira] [Updated] (HDFS-7087) Ability to list /.reserved

[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7087: Status: Patch Available (was: Open) > Ability to list /.reserved > -- > >

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961598#comment-14961598 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #507 (See [htt

[jira] [Commented] (HDFS-7964) Add support for async edit logging

[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961593#comment-14961593 ] Jing Zhao commented on HDFS-7964: - Thanks for rebasing the patch, Daryn. The patch looks go

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961589#comment-14961589 ] Mingliang Liu commented on HDFS-9184: - Thanks for your comment [~daijy]. To address thi

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961574#comment-14961574 ] Daniel Dai commented on HDFS-9184: -- If we want to impose a limitation on the length, it is

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.003.patch Add null check when creating iterator of storages > Improve perf

[jira] [Commented] (HDFS-9230) Report space overhead of unfinalized upgrade/rollingUpgrade

[ https://issues.apache.org/jira/browse/HDFS-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961561#comment-14961561 ] Andrew Wang commented on HDFS-9230: --- For hardlink upgrades, you could check the link coun

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961557#comment-14961557 ] Mingliang Liu commented on HDFS-9241: - {quote} Old applications can still depend on had

[jira] [Commented] (HDFS-9236) Missing sanity check for block size during block recovery

[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961543#comment-14961543 ] Tony Wu commented on HDFS-9236: --- checksyle and pre-patch error are not related to this patch.

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961540#comment-14961540 ] Jitendra Nath Pandey commented on HDFS-9239: bq. .. Well before node liveness i

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961530#comment-14961530 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2444 (See [https://

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Description: This patch changes the datastructures used for BlockInfos and Replicas to keep them

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961480#comment-14961480 ] Jitendra Nath Pandey commented on HDFS-9184: I will commit it to trunk if there

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961475#comment-14961475 ] Jitendra Nath Pandey commented on HDFS-9184: +1 > Logging HDFS operation's cal

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961458#comment-14961458 ] Arpit Agarwal commented on HDFS-4015: - bq. When the operator makes the name node leave

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961413#comment-14961413 ] Mingliang Liu commented on HDFS-9184: - The failing tests seem unrelated and can pass lo

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Affects Version/s: 2.7.0 > Reconfigure lazy writer interval on the fly >

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure {code} dfs.datanode.lazywriter.interval.sec {code} without restar

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure dfs.datanode.lazywriter.interval.sec without restarting DN. > Re

[jira] [Created] (HDFS-9262) Reconfigure lazy writer interval on the fly

Xiaobing Zhou created HDFS-9262: --- Summary: Reconfigure lazy writer interval on the fly Key: HDFS-9262 URL: https://issues.apache.org/jira/browse/HDFS-9262 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-9245) Fix findbugs warnings in hdfs-nfs/WriteCtx

[ https://issues.apache.org/jira/browse/HDFS-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961358#comment-14961358 ] Li Lu commented on HDFS-9245: - Yes I think using volatile here is appropriate. Findbugs also tu

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961338#comment-14961338 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1279 (See [https://

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961317#comment-14961317 ] Hudson commented on HDFS-9257: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #506 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961316#comment-14961316 ] Hudson commented on HDFS-9205: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #506 (See [htt

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9259: -- Assignee: Mingliang Liu Thanks [~liuml07]! I have assigned it to you. > Make SO_SNDBUF size configurable at DFSC

[jira] [Updated] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9259: -- Description: We recently found that cross-DC hdfs write could be really slow. Further investigation identified t

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961301#comment-14961301 ] Hudson commented on HDFS-9253: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #558 (See [htt

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961279#comment-14961279 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #543 (See

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961242#comment-14961242 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2492 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961226#comment-14961226 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2443 (See [https://

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961227#comment-14961227 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2443 (See [https://

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961221#comment-14961221 ] Hadoop QA commented on HDFS-9249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961217#comment-14961217 ] Haohui Mai commented on HDFS-8766: -- Thanks for updating the patch. Some comments: 1. Remo

[jira] [Commented] (HDFS-9255) Consolidate block recovery related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961210#comment-14961210 ] Hadoop QA commented on HDFS-9255: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961186#comment-14961186 ] Arpit Agarwal commented on HDFS-9254: - The test failures do seem to be caused by my pat

[jira] [Updated] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9253: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Comment Edited] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961182#comment-14961182 ] Haohui Mai edited comment on HDFS-9253 at 10/16/15 6:42 PM: I'v

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.002.patch Merged with latest head > Improve performance and GC friendlines

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961174#comment-14961174 ] Hudson commented on HDFS-9253: -- FAILURE: Integrated in Hadoop-trunk-Commit #8652 (See [https:

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961132#comment-14961132 ] Hadoop QA commented on HDFS-9208: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-9261) Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group

Rakesh R created HDFS-9261: -- Summary: Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group Key: HDFS-9261 URL: https://issues.apache.org/jira/browse/HDFS-92

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961110#comment-14961110 ] Mingliang Liu commented on HDFS-9129: - The failing tests can pass locally. Addressing t

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Affects Version/s: 3.0.0 > Erasure coding: emulate race conditions among striped streamers in write > pipeli

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Component/s: erasure-coding > Erasure coding: emulate race conditions among striped streamers in write > pip

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Summary: Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. (was

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9260: Assignee: Staffan Friberg > Improve performance and GC friendliness of startup and FBRs > ---

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961091#comment-14961091 ] Mingliang Liu commented on HDFS-9259: - Hi [~mingma], can I work on this, if we reach co

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961087#comment-14961087 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2491 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961086#comment-14961086 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2491 (See [htt

[jira] [Commented] (HDFS-9253) Refactor tests of libhdfs into a directory

[ https://issues.apache.org/jira/browse/HDFS-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961075#comment-14961075 ] Jing Zhao commented on HDFS-9253: - +1 > Refactor tests of libhdfs into a directory > -

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961049#comment-14961049 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #542 (See

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961048#comment-14961048 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #542 (See

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Target Version/s: 2.8.0 Status: Patch Available (was: Open) > Disabling atime may fail clien

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS Block and Replica Management 20151013.pdf > Improve performance and GC friendlin

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: (was: HDFS Block and Replica Management 20151013.pdf) > Improve performance and G

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS Block and Replica Management 20151013.pdf > Improve performance and GC friendlin

[jira] [Updated] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg updated HDFS-9260: -- Attachment: HDFS-7435.001.patch > Improve performance and GC friendliness of startup and FBRs > -

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961037#comment-14961037 ] Hudson commented on HDFS-9257: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #557 (See [htt

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961036#comment-14961036 ] Hudson commented on HDFS-9205: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #557 (See [htt

[jira] [Created] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

Staffan Friberg created HDFS-9260: - Summary: Improve performance and GC friendliness of startup and FBRs Key: HDFS-9260 URL: https://issues.apache.org/jira/browse/HDFS-9260 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9249: -- Attachment: HDFS-9249.002.patch Attaching rev2. This patch adds a test case that verifies the fix

[jira] [Assigned] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-9098: --- Assignee: Zhe Zhang > Erasure coding: emulate race conditions among striped streamers in write > pipe

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960995#comment-14960995 ] Steve Loughran commented on HDFS-9254: -- I'd thought "underdocumented" is a complete su

[jira] [Updated] (HDFS-9255) Consolidate block recovery related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-9255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9255: Attachment: HDFS-9255.03.patch > Consolidate block recovery related implementation into a single class >

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960987#comment-14960987 ] Haohui Mai commented on HDFS-9241: -- bq. the changes for the hdfs client classpath make ins

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960983#comment-14960983 ] Haohui Mai commented on HDFS-9241: -- bq. One other thing to consider is "would we expect th

[jira] [Updated] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9250: Status: Open (was: Patch Available) > LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960974#comment-14960974 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1278 (See [https://

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960975#comment-14960975 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1278 (See [https://

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Attachment: HDFS-9208.patch The {{setTimes()}} call through {{getBlockLocations()}} does not force update,

[jira] [Created] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

Ming Ma created HDFS-9259: - Summary: Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario Key: HDFS-9259 URL: https://issues.apache.org/jira/browse/HDFS-9259 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9254) HDFS Secure Mode Documentation updates

[ https://issues.apache.org/jira/browse/HDFS-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960901#comment-14960901 ] Arpit Agarwal commented on HDFS-9254: - Documentation-only patch, needs no new tests. Te

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960884#comment-14960884 ] Rakesh R commented on HDFS-8287: Thank you [~kaisasak] for taking care this, latest patch m

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960879#comment-14960879 ] Hudson commented on HDFS-9257: -- FAILURE: Integrated in Hadoop-trunk-Commit #8651 (See [https:

[jira] [Commented] (HDFS-9205) Do not schedule corrupt blocks for replication

[ https://issues.apache.org/jira/browse/HDFS-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960870#comment-14960870 ] Hudson commented on HDFS-9205: -- FAILURE: Integrated in Hadoop-trunk-Commit #8650 (See [https:

[jira] [Updated] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9257: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960854#comment-14960854 ] Harsh J commented on HDFS-9257: --- +1, failed tests are unrelated. Tests shouldn't be necessary

[jira] [Assigned] (HDFS-9258) NN should indicate which nodes are stale

[ https://issues.apache.org/jira/browse/HDFS-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla reassigned HDFS-9258: - Assignee: Kuhu Shukla > NN should indicate which nodes are stale > ---

[jira] [Created] (HDFS-9258) NN should indicate which nodes are stale

Daryn Sharp created HDFS-9258: - Summary: NN should indicate which nodes are stale Key: HDFS-9258 URL: https://issues.apache.org/jira/browse/HDFS-9258 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota without need to get file and directory counts

[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960823#comment-14960823 ] Ming Ma commented on HDFS-8898: --- Thanks [~kihwal]! I will update the patch with new unit test

[jira] [Commented] (HDFS-9257) improve error message for "Absolute path required" in INode.java to contain the rejected path

[ https://issues.apache.org/jira/browse/HDFS-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960788#comment-14960788 ] Hadoop QA commented on HDFS-9257: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960785#comment-14960785 ] Steve Loughran commented on HDFS-9241: -- One other thing to consider is "would we expec

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960776#comment-14960776 ] Kihwal Lee commented on HDFS-9239: -- It may not help much with the namenode side. Even on e

[jira] [Comment Edited] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960776#comment-14960776 ] Kihwal Lee edited comment on HDFS-9239 at 10/16/15 2:24 PM: It

[jira] [Commented] (HDFS-9249) NPE thrown if an IOException is thrown in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-9249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960775#comment-14960775 ] Steve Loughran commented on HDFS-9249: -- don't worry about being new: welcome to the fu

[jira] [Commented] (HDFS-7964) Add support for async edit logging

[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960721#comment-14960721 ] Daryn Sharp commented on HDFS-7964: --- # The thread is the only one calling the real logEdi

[jira] [Commented] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14960683#comment-14960683 ] Steve Loughran commented on HDFS-8880: -- I'd be in favour of improving our own general

  1   2   >