[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696558#comment-14696558 ] Hudson commented on HDFS-7263: -- FAILURE: Integrated in Hadoop-trunk-Commit #8299 (See [https:

[jira] [Updated] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7263: Labels: (was: 2.6.1-candidate) > Snapshot read can reveal future bytes for appended files. > --

[jira] [Commented] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696550#comment-14696550 ] Vinayakumar B commented on HDFS-7263: - Cherry-picked to 2.6.1 > Snapshot read can reve

[jira] [Updated] (HDFS-7263) Snapshot read can reveal future bytes for appended files.

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7263: Fix Version/s: 2.6.1 > Snapshot read can reveal future bytes for appended files. > --

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696547#comment-14696547 ] Hudson commented on HDFS-7213: -- FAILURE: Integrated in Hadoop-trunk-Commit #8298 (See [https:

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696548#comment-14696548 ] Hudson commented on HDFS-7235: -- FAILURE: Integrated in Hadoop-trunk-Commit #8298 (See [https:

[jira] [Commented] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696535#comment-14696535 ] Vinayakumar B commented on HDFS-7235: - Cherry-picked to 2.6.1 > DataNode#transferBlock

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7235: Fix Version/s: 2.6.1 > DataNode#transferBlock should report blocks that don't exist using > reportBa

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7235: Labels: (was: 2.6.1-candidate) > DataNode#transferBlock should report blocks that don't exist using

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Labels: (was: 2.6.1-candidate) > processIncrementalBlockReport performance degradation > --

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Fix Version/s: 2.7.0 > processIncrementalBlockReport performance degradation > --

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7213: Fix Version/s: (was: 2.7.0) 2.6.1 > processIncrementalBlockReport performance

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2015-08-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696524#comment-14696524 ] Vinayakumar B commented on HDFS-7213: - Cherry-picked to 2.6.1. > processIncrementalBlo

[jira] [Commented] (HDFS-8824) Do not use small blocks for balancing the cluster

2015-08-13 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696520#comment-14696520 ] Jitendra Nath Pandey commented on HDFS-8824: +1 for the latest patch. > Do not

[jira] [Assigned] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-13 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8894: - Assignee: kanaka kumar avvaru > Set SO_KEEPALIVE on DN server sockets > --

[jira] [Assigned] (HDFS-6939) Support path-based filtering of inotify events

2015-08-13 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reassigned HDFS-6939: Assignee: Surendra Singh Lilhore > Support path-based filtering of inotify e

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696458#comment-14696458 ] Hadoop QA commented on HDFS-8287: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8622: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696399#comment-14696399 ] Hadoop QA commented on HDFS-8895: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696394#comment-14696394 ] Hadoop QA commented on HDFS-8435: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696383#comment-14696383 ] Hadoop QA commented on HDFS-8828: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-08-13 Thread Zhihua Deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696376#comment-14696376 ] Zhihua Deng commented on HDFS-7980: --- Recently, we encountered the same problem in

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-13 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287-HDFS-7285.03.patch > DFSStripedOutputStream.writeChunk should not wait for writing pa

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-08-13 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696349#comment-14696349 ] Kai Sasaki commented on HDFS-8287: -- I rebased HDFS-7285. Could you please check it? Thank

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-08-13 Thread Zhihua Deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihua Deng updated HDFS-7980: -- Attachment: (was: hadoop-241.patch) > Incremental BlockReport will dramatically slow down the startup

[jira] [Commented] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-13 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696329#comment-14696329 ] Ming Ma commented on HDFS-6244: --- Thanks [~l201514]! The patch adds key with prefix of "dfs.f

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-08-13 Thread Zhihua Deng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihua Deng updated HDFS-7980: -- Attachment: hadoop-241.patch > Incremental BlockReport will dramatically slow down the startup of a name

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2015-08-13 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-8891: - Attachment: HDFS-8891.002.patch Thanks [~jingzhao] for review. Upload 2th path base on [~jingzhao]'s commen

[jira] [Updated] (HDFS-8070) Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode

2015-08-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8070: Attachment: HDFS-8070.branch-2.6.patch Attaching a patch for branch-2.6. If we are going to include H

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-08-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7915: Attachment: HDFS-7915.branch-2.6.patch HADOOP-11802 depends on this issue. If we are going to cherry-

[jira] [Updated] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2015-08-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7278: -- Labels: 2.6.1-candidate (was: ) > Add a command that allows sysadmins to manually trigger full block rep

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696288#comment-14696288 ] Brahma Reddy Battula commented on HDFS-7649: [~arpitagarwal] thanks a lot for y

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696262#comment-14696262 ] Yi Liu commented on HDFS-8859: -- Seems Jenkins has some problem and all are timeout, I randomly

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696224#comment-14696224 ] Yongjun Zhang commented on HDFS-8828: - Thank you [~yufeigu] and [~jingzhao]! > Utiliz

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696167#comment-14696167 ] Yufei Gu commented on HDFS-8828: Thank you, [~jingzhao]. Glad to have you review the code.

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696164#comment-14696164 ] Yufei Gu commented on HDFS-8828: Hi [~yzhangal], Thanks very much for code review. I've do

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696162#comment-14696162 ] Yufei Gu commented on HDFS-8828: No. Just one CREATE item in snapshot diff report in this c

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Attachment: HDFS-8828.007.patch > Utilize Snapshot diff report to build copy list in distcp > -

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Status: Open (was: Patch Available) > Make Trash Interval configurable for each of the namespaces >

[jira] [Updated] (HDFS-6244) Make Trash Interval configurable for each of the namespaces

2015-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6244: -- Status: Patch Available (was: Open) > Make Trash Interval configurable for each of the namespaces >

[jira] [Updated] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

2015-08-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8895: -- Release Note: This removes the deprecated DistributedFileSystem#getFileBlockStorageLocations API used for

[jira] [Updated] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

2015-08-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8895: -- Attachment: HDFS-8895.001.patch Patch attached, deleting lots of the code. I looked at the original patch

[jira] [Updated] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

2015-08-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8895: -- Status: Patch Available (was: Open) > Remove deprecated BlockStorageLocation APIs >

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

2015-08-13 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696103#comment-14696103 ] Ravi Prakash commented on HDFS-6407: The patch looks good to me. +1. > new namenode UI

[jira] [Commented] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696079#comment-14696079 ] Hudson commented on HDFS-7649: -- FAILURE: Integrated in Hadoop-trunk-Commit #8295 (See [https:

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

2015-08-13 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Status: Patch Available (was: Open) > createNonRecursive support needed in WebHdfsFileSystem to support

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

2015-08-13 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Attachment: HDFS-8435.003.patch New patch that applies to both trunk and branch 2. The failed tests we

[jira] [Commented] (HDFS-8888) Support volumes in HDFS

2015-08-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696039#comment-14696039 ] Konstantin Shvachko commented on HDFS-: --- Could you please explain your concep

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

2015-08-13 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Status: Open (was: Patch Available) > createNonRecursive support needed in WebHdfsFileSystem to support

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696023#comment-14696023 ] Jing Zhao commented on HDFS-8828: - Sure. I will review the patch. Thanks for the work, Yufe

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696000#comment-14696000 ] Yongjun Zhang commented on HDFS-8828: - Hi [~yufeigu], Thanks for answering my question

[jira] [Updated] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

2015-08-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7649: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

2015-08-13 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-8895: - Summary: Remove deprecated BlockStorageLocation APIs Key: HDFS-8895 URL: https://issues.apache.org/jira/browse/HDFS-8895 Project: Hadoop HDFS Issue Type: Improveme

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

2015-08-13 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695800#comment-14695800 ] Chang Li commented on HDFS-6407: [~wheat9] how soon could you check in this code? Are you s

[jira] [Updated] (HDFS-8883) NameNode Metrics : Add FSNameSystem lock Queue Length

2015-08-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8883: Priority: Major (was: Minor) > NameNode Metrics : Add FSNameSystem lock Queue Length > -

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Resolution: Won't Fix Status: Resolved (was: Patch Available) Close it and leave getCorruptF

[jira] [Updated] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8859: -- Priority: Major (was: Critical) This is a good change although it does not reduce the ov

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695685#comment-14695685 ] Yongjun Zhang commented on HDFS-8828: - Hello [~yufeigu], I expect every new CREATE/MOD

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695634#comment-14695634 ] Jing Zhao commented on HDFS-8891: - Thanks for working on this, Yong! Agree we should keep t

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-13 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemanja Matkovic updated HDFS-8078: --- Description: /patch1st exception, on put: 15/03/23 18:43:18 WARN hdfs.DFSClient: DataStreamer

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-13 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemanja Matkovic updated HDFS-8078: --- Description: 1st exception, on put: 15/03/23 18:43:18 WARN hdfs.DFSClient: DataStreamer Except

[jira] [Commented] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

2015-08-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695599#comment-14695599 ] Zhe Zhang commented on HDFS-8808: - Both reported test issues are unrelated and pass locally

[jira] [Created] (HDFS-8894) Set SO_KEEPALIVE on DN server sockets

2015-08-13 Thread Nathan Roberts (JIRA)
Nathan Roberts created HDFS-8894: Summary: Set SO_KEEPALIVE on DN server sockets Key: HDFS-8894 URL: https://issues.apache.org/jira/browse/HDFS-8894 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2015-08-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695585#comment-14695585 ] Tsz Wo Nicholas Sze commented on HDFS-8890: --- Oops, my previous comment is incorre

[jira] [Updated] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-13 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8854: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Commented] (HDFS-8890) Allow admin to specify which blockpools the balancer should run on

2015-08-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695580#comment-14695580 ] Tsz Wo Nicholas Sze commented on HDFS-8890: --- We probably already have this featur

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695574#comment-14695574 ] Xiaoyu Yao commented on HDFS-8865: -- Thanks for the patch, [~kihwal]! It looks pretty good

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695518#comment-14695518 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2232 (See [htt

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695521#comment-14695521 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2232 (See [htt

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695482#comment-14695482 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #283 (See

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695479#comment-14695479 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #283 (See

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695467#comment-14695467 ] Yufei Gu commented on HDFS-8828: Hi [~yzhangal], Thank you for detailed review. For 3, we

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695457#comment-14695457 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #275 (See [htt

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695454#comment-14695454 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #275 (See [htt

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695390#comment-14695390 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2213 (See [https://

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

2015-08-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7926: -- Labels: (was: 2.6.1-candidate) Removing the 2.6.1-candidate label as truncate is not a feature in 2.6.

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695387#comment-14695387 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2213 (See [https://

[jira] [Commented] (HDFS-8891) HDFS concat should keep srcs order

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695320#comment-14695320 ] Hadoop QA commented on HDFS-8891: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

2015-08-13 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8893: - Assignee: Daryn Sharp > DNs with failed volumes stop serving during rolling upgrade > -

[jira] [Created] (HDFS-8893) DNs with failed volumes stop serving during rolling upgrade

2015-08-13 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-8893: Summary: DNs with failed volumes stop serving during rolling upgrade Key: HDFS-8893 URL: https://issues.apache.org/jira/browse/HDFS-8893 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695178#comment-14695178 ] Hadoop QA commented on HDFS-8859: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695126#comment-14695126 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1016 (See [https://

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695123#comment-14695123 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1016 (See [https://

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695119#comment-14695119 ] Hudson commented on HDFS-8622: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #286 (See [htt

[jira] [Commented] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695116#comment-14695116 ] Hudson commented on HDFS-8879: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #286 (See [htt

[jira] [Comment Edited] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694879#comment-14694879 ] Yi Liu edited comment on HDFS-8859 at 8/13/15 12:02 PM: Thanks [~sz

[jira] [Updated] (HDFS-8859) Improve DataNode ReplicaMap memory footprint to save about 45%

2015-08-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Summary: Improve DataNode ReplicaMap memory footprint to save about 45% (was: Improve DataNode (ReplicaMap) memory

[jira] [Assigned] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-13 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8892: - Assignee: kanaka kumar avvaru > ShortCircuitCache.CacheCleaner can add Slot.isInva

[jira] [Created] (HDFS-8892) ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too

2015-08-13 Thread Ravikumar (JIRA)
Ravikumar created HDFS-8892: --- Summary: ShortCircuitCache.CacheCleaner can add Slot.isInvalid() check too Key: HDFS-8892 URL: https://issues.apache.org/jira/browse/HDFS-8892 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

2015-08-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695077#comment-14695077 ] Hadoop QA commented on HDFS-8808: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2015-08-13 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-8891: - Status: Patch Available (was: Open) > HDFS concat should keep srcs order > ---

[jira] [Updated] (HDFS-8891) HDFS concat should keep srcs order

2015-08-13 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-8891: - Attachment: HDFS-8891.001.patch First patch, please review > HDFS concat should keep srcs order >

[jira] [Updated] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Attachment: HDFS-8859.004.patch > Improve DataNode (ReplicaMap) memory footprint to save about 45% > --

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694879#comment-14694879 ] Yi Liu commented on HDFS-8859: -- Thanks [~szetszwo] for the review! Update the patch to address

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14694855#comment-14694855 ] Yongjun Zhang commented on HDFS-8828: - Hi [~yufeigu], Thanks for the new rev 006 whic

[jira] [Updated] (HDFS-7610) Fix removal of dynamically added DN volumes

2015-08-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7610: -- Labels: 2.6.1-candidate (was: ) > Fix removal of dynamically added DN volumes >