[jira] [Commented] (HDFS-7889) Subclass DFSOutputStream to support writing striping layout files

2015-04-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392245#comment-14392245 ] Vinayakumar B commented on HDFS-7889: - Hi [~libo-intel], thanks for the nice work. Her

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.03.patch The 02 patch missed the symlink check before calling {{getStoragePolicyID}}.

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392189#comment-14392189 ] Jing Zhao commented on HDFS-8035: - +1 for the latest patch. You may need to update the jira

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392181#comment-14392181 ] Hadoop QA commented on HDFS-8035: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Benoit Perroud (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392159#comment-14392159 ] Benoit Perroud commented on HDFS-6634: -- Hi [~cmccabe] Cool, HDFS-7446 is exactly what

[jira] [Updated] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7622: Assignee: Takuya Fukudome (was: Jing Zhao) > Erasure Coding: handling file truncation >

[jira] [Commented] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392127#comment-14392127 ] Jing Zhao commented on HDFS-7622: - Sure. Thanks for working on this. > Erasure Coding: han

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392110#comment-14392110 ] Hadoop QA commented on HDFS-7888: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7622) Erasure Coding: handling file truncation

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392106#comment-14392106 ] Takuya Fukudome commented on HDFS-7622: --- Hi [~jingzhao], I want to work on this jira

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392099#comment-14392099 ] Takuya Fukudome commented on HDFS-7619: --- Thank you, Jing! I want to work on HDFS-7622

[jira] [Commented] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392081#comment-14392081 ] Hadoop QA commented on HDFS-8041: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392071#comment-14392071 ] Hadoop QA commented on HDFS-7811: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392044#comment-14392044 ] Hudson commented on HDFS-7916: -- FAILURE: Integrated in Hadoop-trunk-Commit #7492 (See [https:

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392029#comment-14392029 ] Jing Zhao commented on HDFS-7619: - Yes, you're right. I will move the jira to HDFS-8031. >

[jira] [Updated] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7619: Parent Issue: HDFS-8031 (was: HDFS-7285) > Erasure Coding: Handling files in snapshots > --

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7916: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391991#comment-14391991 ] Hadoop QA commented on HDFS-6481: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7619) Erasure Coding: Handling files in snapshots

2015-04-01 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391986#comment-14391986 ] Takuya Fukudome commented on HDFS-7619: --- Hi [~jingzhao], If my understanding is corr

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391982#comment-14391982 ] Brahma Reddy Battula commented on HDFS-7060: Thanks a lot for taking look into

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391952#comment-14391952 ] Hudson commented on HDFS-8008: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See [https:

[jira] [Commented] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391954#comment-14391954 ] Hudson commented on HDFS-8001: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See [https:

[jira] [Commented] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391955#comment-14391955 ] Hudson commented on HDFS-8036: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7490 (See [https:

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391939#comment-14391939 ] Hadoop QA commented on HDFS-8008: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391935#comment-14391935 ] Hadoop QA commented on HDFS-: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391932#comment-14391932 ] Li Bo commented on HDFS-7888: - The changes also look good to me. Thanks for the review of Zhe,

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391924#comment-14391924 ] Hadoop QA commented on HDFS-7996: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8035: - Attachment: HDFS-8035.003.patch > Move checking replication and get client DN to BM and DM respectively > -

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2015-04-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391871#comment-14391871 ] Brahma Reddy Battula commented on HDFS-5215: Testcase failures and javadoc war

[jira] [Updated] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-8001: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > RpcProg

[jira] [Updated] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-8001: - Fix Version/s: 2.7.0 > RpcProgramNfs3 : wrong parsing of dfs.blocksize > --

[jira] [Commented] (HDFS-8001) RpcProgramNfs3 : wrong parsing of dfs.blocksize

2015-04-01 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391849#comment-14391849 ] Brandon Li commented on HDFS-8001: -- I've committed the patch. Thank you, [~rcatherinot] fo

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391843#comment-14391843 ] Hadoop QA commented on HDFS-7979: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

2015-04-01 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391839#comment-14391839 ] Yi Liu commented on HDFS-7916: -- +1 > 'reportBadBlocks' from datanodes to standby Node BPServi

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7888: Attachment: HDFS-7888-trunk-004.patch Thanks Nicholas for the review! Rebased to resolve conflict with HDFS-

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391822#comment-14391822 ] Hadoop QA commented on HDFS-7523: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391820#comment-14391820 ] Colin Patrick McCabe commented on HDFS-8026: I'm not sure if there is an open j

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391814#comment-14391814 ] Tsz Wo Nicholas Sze commented on HDFS-7888: --- Unfortunately, the patch does not ap

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391810#comment-14391810 ] Colin Patrick McCabe commented on HDFS-7979: Unfortunately, this latest patch a

[jira] [Updated] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8008: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7888: -- Component/s: hdfs-client Priority: Minor (was: Major) Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391797#comment-14391797 ] Hudson commented on HDFS-7922: -- FAILURE: Integrated in Hadoop-trunk-Commit #7489 (See [https:

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8036: - Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) I've comm

[jira] [Updated] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7811: Attachment: HDFS-7811.02.patch I did some simple cleanup based on the current 01 patch. Please see if it's c

[jira] [Updated] (HDFS-7782) Erasure coding: pread from files in striped layout

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7782: Attachment: HDFS-7782-005.patch 005 patch implements pread (non-hedged). It also moves 2 utility functions fr

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391750#comment-14391750 ] Vijay Bhat commented on HDFS-: -- [~cnauroth] - great suggestion Chris, thanks! I extend

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Status: Patch Available (was: Open) > Consider remaining space during block blockplacement if dfs space is

[jira] [Updated] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8041: - Attachment: HDFS-8041.v1.patch > Consider remaining space during block blockplacement if dfs space is highl

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391748#comment-14391748 ] Jing Zhao commented on HDFS-7811: - Thanks for updating the patch, Xiaoyu! The patch looks g

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat updated HDFS-: - Attachment: HDFS-.001.patch > Abort NameNode and DataNode startup if security is enabled but block acce

[jira] [Created] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-8041: Summary: Consider remaining space during block blockplacement if dfs space is highly utilized Key: HDFS-8041 URL: https://issues.apache.org/jira/browse/HDFS-8041 Project: Had

[jira] [Assigned] (HDFS-8041) Consider remaining space during block blockplacement if dfs space is highly utilized

2015-04-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-8041: Assignee: Kihwal Lee > Consider remaining space during block blockplacement if dfs space is highly

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat updated HDFS-: - Target Version/s: 2.6.0, 3.0.0 (was: 3.0.0, 2.6.0) Release Note: The patch has the following chang

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391733#comment-14391733 ] Colin Patrick McCabe commented on HDFS-6634: Hi [~bperroud], HDFS-7446 changed

[jira] [Resolved] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-8040. Resolution: Not a Problem > Able to move encryption zone to Trash > -

[jira] [Updated] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7922: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8026: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391707#comment-14391707 ] Colin Patrick McCabe commented on HDFS-7922: Hi [~rakeshr], I agree that the te

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391705#comment-14391705 ] Xiaoyu Yao commented on HDFS-8040: -- Thanks [~clamb] for the explanation. That makes more s

[jira] [Comment Edited] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391651#comment-14391651 ] Chris Nauroth edited comment on HDFS-8008 at 4/1/15 10:45 PM: --

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391656#comment-14391656 ] Charles Lamb commented on HDFS-8040: [~xyao], [~ssath...@hortonworks.com], This is act

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391651#comment-14391651 ] Chris Nauroth commented on HDFS-8008: - The test failure is unrelated and tracked separa

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391648#comment-14391648 ] Hadoop QA commented on HDFS-8008: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391632#comment-14391632 ] Hadoop QA commented on HDFS-7888: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391615#comment-14391615 ] Hadoop QA commented on HDFS-8008: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391604#comment-14391604 ] Haohui Mai commented on HDFS-7060: -- I agree with Colin that it needs to be well thought ou

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391589#comment-14391589 ] Hudson commented on HDFS-8026: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7488 (See [https:

[jira] [Commented] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391566#comment-14391566 ] Hadoop QA commented on HDFS-7437: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8035) Move checking replication and get client DN to BM and DM respectively

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391562#comment-14391562 ] Hadoop QA commented on HDFS-8035: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391538#comment-14391538 ] Colin Patrick McCabe commented on HDFS-7060: [~Xinwei Qin], [~brahmareddy], do

[jira] [Comment Edited] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391504#comment-14391504 ] Colin Patrick McCabe edited comment on HDFS-7999 at 4/1/15 9:45 PM: -

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Priority: Major (was: Minor) > Avoid taking locks when sending heartbeats from the Dat

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391504#comment-14391504 ] Colin Patrick McCabe commented on HDFS-7999: bq. Make the heartbeat lockless ca

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Priority: Minor (was: Critical) Issue Type: Improvement (was: Bug) > Avoid taki

[jira] [Comment Edited] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391501#comment-14391501 ] Colin Patrick McCabe edited comment on HDFS-7060 at 4/1/15 9:31 PM: -

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Summary: Avoid taking locks when sending heartbeats from the DataNode (was: Contention

[jira] [Commented] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391501#comment-14391501 ] Colin Patrick McCabe commented on HDFS-7060: While I agree that making the Data

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-04-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-6481: -- Target Version/s: (was: 2.6.0) > DatanodeManager#getDatanodeStorageInfos() should check the length of > storag

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391460#comment-14391460 ] Xiaoyu Yao commented on HDFS-8040: -- [~clamb], I was able to repro this on latest trunk. Ch

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391458#comment-14391458 ] Colin Patrick McCabe commented on HDFS-7993: I agree that this is confusing cur

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391411#comment-14391411 ] Charles Lamb commented on HDFS-8040: Hi [~ssath...@hortonworks.com], I tried reproduci

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-04-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391396#comment-14391396 ] Jing Zhao commented on HDFS-7839: - Thanks for working on this, Zhe! The patch looks good to

[jira] [Updated] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8036: -- Hadoop Flags: Reviewed +1 patch looks good. > Use snapshot path as source when using sna

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

2015-04-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391353#comment-14391353 ] Andrew Wang commented on HDFS-7725: --- Thanks for working on this Ming. Nice find, patch lo

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391350#comment-14391350 ] Chris Nauroth commented on HDFS-8008: - +1 for patch v003 pending Jenkins. Thanks again

[jira] [Updated] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8008: - Attachment: HDFS-8008.003.patch > Support client-side back off when the datanodes are congested > -

[jira] [Commented] (HDFS-7978) Add LOG.isDebugEnabled() guard for some LOG.debug(..)

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391342#comment-14391342 ] Hudson commented on HDFS-7978: -- FAILURE: Integrated in Hadoop-trunk-Commit #7487 (See [https:

[jira] [Updated] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8040: - Issue Type: Bug (was: Task) > Able to move encryption zone to Trash >

[jira] [Updated] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread sumana sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sumana sathish updated HDFS-8040: - Summary: Able to move encryption zone to Trash (was: Able to remove encryption zone to Trash) > A

[jira] [Updated] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7996: Attachment: HDFS-7996.002.patch Thanks for the suggestions, [~cmccabe]. I made the changes accordingl

[jira] [Updated] (HDFS-8040) Able to remove encryption zone to Trash

2015-04-01 Thread sumana sathish (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sumana sathish updated HDFS-8040: - Summary: Able to remove encryption zone to Trash (was: Can remove encryption zone to Trash) > Abl

[jira] [Commented] (HDFS-8025) Addendum for HDFS-3087

2015-04-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391332#comment-14391332 ] Andrew Wang commented on HDFS-8025: --- Hey Ming, thanks for working on this. Did you consid

[jira] [Created] (HDFS-8040) Can remove encryption zone to Trash

2015-04-01 Thread sumana sathish (JIRA)
sumana sathish created HDFS-8040: Summary: Can remove encryption zone to Trash Key: HDFS-8040 URL: https://issues.apache.org/jira/browse/HDFS-8040 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-7978) Add LOG.isDebugEnabled() guard for some LOG.debug(..)

2015-04-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7978: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) > Add L

[jira] [Commented] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391320#comment-14391320 ] Hadoop QA commented on HDFS-8039: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7978) Add LOG.isDebugEnabled() guard for some LOG.debug(..)

2015-04-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391315#comment-14391315 ] Andrew Wang commented on HDFS-7978: --- I ran the failed test locally, seems independently f

[jira] [Updated] (HDFS-7979) Initialize block report IDs with a random number

2015-04-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7979: -- Attachment: HDFS-7979.003.patch Good point about 0 being an invalid value, I forgot about that on the NN

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-04-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391274#comment-14391274 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- Here is the list we discussed. h2.

[jira] [Commented] (HDFS-8036) Use snapshot path as source when using snapshot diff report in DistCp

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391264#comment-14391264 ] Hadoop QA commented on HDFS-8036: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Raymie Stata (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymie Stata updated HDFS-8008: --- Component/s: dfsclient > Support client-side back off when the datanodes are congested > --

[jira] [Updated] (HDFS-7888) Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing

2015-04-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7888: Attachment: HDFS-7888-trunk-003.patch Thanks Jing for the review! These 2 changes sound good to me. Since the

  1   2   >