[jira] [Commented] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201722#comment-14201722 ] Hudson commented on HDFS-7226: -- FAILURE: Integrated in Hadoop-trunk-Commit #6477 (See [https:

[jira] [Updated] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-11-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7226: Fix Version/s: (was: 2.7.0) 2.6.0 Thank you again for fixing this, Yongjun. I

[jira] [Updated] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-11-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7221: Target Version/s: 2.6.0 (was: 2.7.0) Fix Version/s: (was: 2.7.0) 2.6

[jira] [Commented] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201699#comment-14201699 ] Hudson commented on HDFS-7221: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6476 (See [https:

[jira] [Commented] (HDFS-7374) Allow decommissioning of dead DataNodes

2014-11-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201646#comment-14201646 ] Ming Ma commented on HDFS-7374: --- Zhe, thanks for reporting this. At the high level, there is

[jira] [Commented] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager

2014-11-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201643#comment-14201643 ] stack commented on HDFS-7358: - A few comments: +private volatile boolean isClosed = false;

[jira] [Updated] (HDFS-7310) Mover can give first priority to local DN if it has target storage type available in local DN

2014-11-06 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7310: Attachment: HDFS-7310-003.patch Addressed [~jingzhao]'s comments. > Mover can give first priority to

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314-4.patch It turns out a new bug not related to this was discovered by this change. If DataS

[jira] [Commented] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201584#comment-14201584 ] Hadoop QA commented on HDFS-7375: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201585#comment-14201585 ] Hadoop QA commented on HDFS-7358: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7295) Support arbitrary max expiration times for delegation token

2014-11-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201559#comment-14201559 ] Vinod Kumar Vavilapalli commented on HDFS-7295: --- It is already configurable.

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201426#comment-14201426 ] Akira AJISAKA commented on HDFS-7373: - Good idea! The patch looks good to me, +1 (non-b

[jira] [Updated] (HDFS-7364) Balancer always shows zero Bytes Already Moved

2014-11-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7364: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Updated] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7343: Target Version/s: (was: HDFS-EC) > A comprehensive and flexible storage policy engine > ---

[jira] [Commented] (HDFS-7364) Balancer always shows zero Bytes Already Moved

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201414#comment-14201414 ] Hudson commented on HDFS-7364: -- FAILURE: Integrated in Hadoop-trunk-Commit #6473 (See [https:

[jira] [Updated] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager

2014-11-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7358: -- Attachment: h7358_20141106.patch h7358_20141106.patch: releases arrays during close. > C

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-11-06 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201410#comment-14201410 ] Plamen Jeliazkov commented on HDFS-7056: Regarding (4), I see two issues right now.

[jira] [Commented] (HDFS-7364) Balancer always shows zero Bytes Already Moved

2014-11-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201405#comment-14201405 ] Jing Zhao commented on HDFS-7364: - +1. I will commit it shortly. > Balancer always shows z

[jira] [Commented] (HDFS-7364) Balancer always shows zero Bytes Already Moved

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201401#comment-14201401 ] Hadoop QA commented on HDFS-7364: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7375: - Attachment: HDFS-7375.001.patch > Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement >

[jira] [Commented] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201334#comment-14201334 ] Hadoop QA commented on HDFS-7375: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager

2014-11-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201317#comment-14201317 ] stack commented on HDFS-7358: - bq. Hi stack, do you want to open source your test program? Its

[jira] [Commented] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201284#comment-14201284 ] Kai Zheng commented on HDFS-7343: - As far as I understand for now, the policy engine propos

[jira] [Commented] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201258#comment-14201258 ] Kai Zheng commented on HDFS-7343: - Yes Andrew. I linked the mentioned issue and will take t

[jira] [Assigned] (HDFS-7343) A comprehensive and flexible storage policy engine

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-7343: --- Assignee: Kai Zheng > A comprehensive and flexible storage policy engine > ---

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201227#comment-14201227 ] Charles Lamb commented on HDFS-7331: bq. Do folks agree with the above? This makes sen

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201218#comment-14201218 ] Hadoop QA commented on HDFS-7314: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201219#comment-14201219 ] Hadoop QA commented on HDFS-6757: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201220#comment-14201220 ] Aaron T. Myers commented on HDFS-7331: -- {quote} If I understand correctly, the metrics

[jira] [Commented] (HDFS-7279) Use netty to implement DatanodeWebHdfsMethods

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201188#comment-14201188 ] Hadoop QA commented on HDFS-7279: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201156#comment-14201156 ] Kihwal Lee commented on HDFS-7373: -- - There is actually no new findbugs warning. It says 0

[jira] [Commented] (HDFS-7358) Clients may get stuck waiting when using ByteArrayManager

2014-11-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201089#comment-14201089 ] Tsz Wo Nicholas Sze commented on HDFS-7358: --- > Patch works for me. My little prog

[jira] [Updated] (HDFS-7364) Balancer always shows zero Bytes Already Moved

2014-11-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7364: -- Priority: Minor (was: Major) Summary: Balancer always shows zero Bytes Already Moved

[jira] [Updated] (HDFS-7364) Balancer always show zero Bytes Already Moved

2014-11-06 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7364: -- Attachment: h7364_20141106.patch h7364_20141106.patch: adds bytesAlreadyMoved checks to t

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201044#comment-14201044 ] Haohui Mai commented on HDFS-7331: -- bq. By 'it' do you mean the '#getDatanodeNetworkCounts

[jira] [Commented] (HDFS-7365) Remove hdfs.server.blockmanagement.MutableBlockCollection

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201034#comment-14201034 ] Hudson commented on HDFS-7365: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6470 (See [https:

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201031#comment-14201031 ] Charles Lamb commented on HDFS-7331: @wheat9, Thanks for the comments. bq. Does the s

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201030#comment-14201030 ] Aaron T. Myers commented on HDFS-7331: -- bq. Is there a reason to make it configurable?

[jira] [Updated] (HDFS-7365) Remove hdfs.server.blockmanagement.MutableBlockCollection

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7365: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7375: - Status: Patch Available (was: Open) > Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement > ---

[jira] [Updated] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7375: - Attachment: HDFS-7375.000.patch > Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement >

[jira] [Created] (HDFS-7375) Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement

2014-11-06 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7375: Summary: Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagement Key: HDFS-7375 URL: https://issues.apache.org/jira/browse/HDFS-7375 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7314: -- Attachment: HDFS-7314-3.patch Thanks, Colin. Here is the updated patch. 1. It turns out {{closeClient}} isn't ne

[jira] [Comment Edited] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200880#comment-14200880 ] Haohui Mai edited comment on HDFS-7331 at 11/6/14 8:52 PM: --- Thank

[jira] [Commented] (HDFS-7310) Mover can give first priority to local DN if it has target storage type available in local DN

2014-11-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200881#comment-14200881 ] Jing Zhao commented on HDFS-7310: - Thanks for working on this, [~vinayrpet]! The patch look

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200880#comment-14200880 ] Haohui Mai commented on HDFS-7331: -- Thanks for the work. Some comments: {code} +final

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.008.patch > Simplify lease manager with INodeID > ---

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-11-06 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200872#comment-14200872 ] Haohui Mai commented on HDFS-6757: -- Rebased onto the latest trunk. > Simplify lease manag

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200803#comment-14200803 ] Hadoop QA commented on HDFS-7373: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200804#comment-14200804 ] Hadoop QA commented on HDFS-7331: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7374) Allow decommissioning of dead DataNodes

2014-11-06 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200625#comment-14200625 ] Zhe Zhang commented on HDFS-7374: - This use case has a (slightly) conflicting objective as

[jira] [Created] (HDFS-7374) Allow decommissioning of dead DataNodes

2014-11-06 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7374: --- Summary: Allow decommissioning of dead DataNodes Key: HDFS-7374 URL: https://issues.apache.org/jira/browse/HDFS-7374 Project: Hadoop HDFS Issue Type: Bug R

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200568#comment-14200568 ] Colin Patrick McCabe commented on HDFS-7314: bq. 1. abort is only used for this

[jira] [Updated] (HDFS-7331) Add Datanode network counts to datanode jmx page

2014-11-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7331: --- Attachment: HDFS-7331.002.patch [~wheat9], [~atm], [~andrew.wang], Thanks for your review. I've attach

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200458#comment-14200458 ] Kihwal Lee commented on HDFS-7373: -- The patch makes {{TransferFsImage#receiveFile()}} dele

[jira] [Updated] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7373: - Status: Patch Available (was: Open) > Clean up temporary files after fsimage transfer failures > -

[jira] [Updated] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7373: - Attachment: HDFS-7373.patch > Clean up temporary files after fsimage transfer failures > --

[jira] [Assigned] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-7373: Assignee: Kihwal Lee > Clean up temporary files after fsimage transfer failures > --

[jira] [Created] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-11-06 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-7373: Summary: Clean up temporary files after fsimage transfer failures Key: HDFS-7373 URL: https://issues.apache.org/jira/browse/HDFS-7373 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-7364) Balancer always show zero Bytes Already Moved

2014-11-06 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200425#comment-14200425 ] Mit Desai commented on HDFS-7364: - Nice catch. Here balancer exits here after 5 iterations

[jira] [Commented] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200297#comment-14200297 ] Hudson commented on HDFS-7357: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200295#comment-14200295 ] Hudson commented on HDFS-7199: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7336) Unused member DFSInputStream.buffersize

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200281#comment-14200281 ] Hudson commented on HDFS-7336: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7361) TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200288#comment-14200288 ] Hudson commented on HDFS-7361: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7329) MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200283#comment-14200283 ] Hudson commented on HDFS-7329: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7366) BlockInfo should take replication as an short in the constructor

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200296#comment-14200296 ] Hudson commented on HDFS-7366: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7367) HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200298#comment-14200298 ] Hudson commented on HDFS-7367: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7359) NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200290#comment-14200290 ] Hudson commented on HDFS-7359: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200284#comment-14200284 ] Hudson commented on HDFS-7333: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200282#comment-14200282 ] Hudson commented on HDFS-7335: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See [htt

[jira] [Commented] (HDFS-7366) BlockInfo should take replication as an short in the constructor

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200201#comment-14200201 ] Hudson commented on HDFS-7366: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Commented] (HDFS-7336) Unused member DFSInputStream.buffersize

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200203#comment-14200203 ] Hudson commented on HDFS-7336: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Commented] (HDFS-7361) TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200208#comment-14200208 ] Hudson commented on HDFS-7361: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Commented] (HDFS-7329) MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200204#comment-14200204 ] Hudson commented on HDFS-7329: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Commented] (HDFS-7367) HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200202#comment-14200202 ] Hudson commented on HDFS-7367: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Commented] (HDFS-7359) NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200197#comment-14200197 ] Hudson commented on HDFS-7359: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See [https://

[jira] [Comment Edited] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200157#comment-14200157 ] Yi Liu edited comment on HDFS-7368 at 11/6/14 1:27 PM: --- Snapshot, acl

[jira] [Commented] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200157#comment-14200157 ] Yi Liu commented on HDFS-7368: -- I think snapshot, acl and xattr are generic concept of filesys

[jira] [Commented] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200147#comment-14200147 ] Hadoop QA commented on HDFS-7368: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200140#comment-14200140 ] Kai Zheng commented on HDFS-7337: - The points made in the prototype patch are: * Multiple e

[jira] [Updated] (HDFS-7372) Active Replication Repair command / job

2014-11-06 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated HDFS-7372: -- Description: Please add an Active Replication Repair command / job as often under-replicated blocks take

[jira] [Created] (HDFS-7372) Active Replication Repair command / job

2014-11-06 Thread Hari Sekhon (JIRA)
Hari Sekhon created HDFS-7372: - Summary: Active Replication Repair command / job Key: HDFS-7372 URL: https://issues.apache.org/jira/browse/HDFS-7372 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-7333) Improve log message in Storage.tryLock()

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200109#comment-14200109 ] Hudson commented on HDFS-7333: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7361) TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200113#comment-14200113 ] Hudson commented on HDFS-7361: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7366) BlockInfo should take replication as an short in the constructor

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200121#comment-14200121 ] Hudson commented on HDFS-7366: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7359) NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200115#comment-14200115 ] Hudson commented on HDFS-7359: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7335) Redundant checkOperation() in FSN.analyzeFileState()

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200107#comment-14200107 ] Hudson commented on HDFS-7335: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7367) HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200123#comment-14200123 ] Hudson commented on HDFS-7367: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7329) MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails.

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200108#comment-14200108 ] Hudson commented on HDFS-7329: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200120#comment-14200120 ] Hudson commented on HDFS-7199: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7357) FSNamesystem.checkFileProgress should log file path

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200122#comment-14200122 ] Hudson commented on HDFS-7357: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7336) Unused member DFSInputStream.buffersize

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200106#comment-14200106 ] Hudson commented on HDFS-7336: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See [https://b

[jira] [Commented] (HDFS-7371) Loading EC schemas from configuration

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200051#comment-14200051 ] Kai Zheng commented on HDFS-7371: - In the above defined schemas, the options/parameters lik

[jira] [Commented] (HDFS-7371) Loading EC schemas from configuration

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200049#comment-14200049 ] Kai Zheng commented on HDFS-7371: - Configuring multiple erasure codecs (*JerasureRS*, *ISAR

[jira] [Created] (HDFS-7371) Loading EC schemas from configuration

2014-11-06 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7371: --- Summary: Loading EC schemas from configuration Key: HDFS-7371 URL: https://issues.apache.org/jira/browse/HDFS-7371 Project: Hadoop HDFS Issue Type: Task Re

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200034#comment-14200034 ] Kai Zheng commented on HDFS-7337: - [~zhz], would you take a look at the quick prototype pat

[jira] [Updated] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2014-11-06 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7337: Attachment: HDFS-7337-prototype-v1.patch Initial prototype patch for quick ideas. > Configurable and pluggab

[jira] [Updated] (HDFS-7370) TestCheckpoint failed in trunk due to mismatching message

2014-11-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7370: Resolution: Duplicate Status: Resolved (was: Patch Available) Thanks [~hitliuyi] for pointin

[jira] [Updated] (HDFS-7368) Support HDFS specific 'shell' on command 'hdfs dfs' invocation

2014-11-06 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7368: Status: Patch Available (was: Open) > Support HDFS specific 'shell' on command 'hdfs dfs' invocation

[jira] [Commented] (HDFS-7370) TestCheckpoint failed in trunk due to mismatching message

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200016#comment-14200016 ] Hadoop QA commented on HDFS-7370: - {color:red}-1 overall{color}. Here are the results of t

  1   2   >