[jira] [Commented] (HDFS-6292) Display HDFS per user and per group usage on the webUI

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982786#comment-13982786 ] Vinayakumar B commented on HDFS-6292: - Good one Ravi. I think calculating in Secondary

[jira] [Commented] (HDFS-6291) FSImage may be left unclosed in BootstrapStandby#doRun()

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982788#comment-13982788 ] Vinayakumar B commented on HDFS-6291: - Yes! you are right. image.close() should be

[jira] [Updated] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Nikola Vujic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Vujic updated HDFS-5168: --- Attachment: HDFS-5168.patch attaching original patch again. BlockPlacementPolicy does not work for

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982798#comment-13982798 ] Hadoop QA commented on HDFS-6261: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13982933#comment-13982933 ] Hadoop QA commented on HDFS-5168: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983007#comment-13983007 ] Charles Lamb commented on HDFS-6258: Hi Yi, Here are a few minor things that I picked

[jira] [Updated] (HDFS-6218) Audit log should use true client IP for proxied webhdfs operations

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6218: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6269: - Target Version/s: 2.5.0 (was: 2.4.1) NameNode Audit Log should differentiate between webHDFS open and

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983024#comment-13983024 ] Kihwal Lee commented on HDFS-6269: -- The test failure is due to HDFS-6250. NameNode Audit

[jira] [Commented] (HDFS-6218) Audit log should use true client IP for proxied webhdfs operations

2014-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983030#comment-13983030 ] Hudson commented on HDFS-6218: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5579 (See

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983031#comment-13983031 ] Eric Payne commented on HDFS-6269: -- The patch for this JIRA did not cause the unit test

[jira] [Created] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6293: Summary: Issues with OIV processing PB-based fsimages Key: HDFS-6293 URL: https://issues.apache.org/jira/browse/HDFS-6293 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6176) Remove assignments to method arguments

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983066#comment-13983066 ] Charles Lamb commented on HDFS-6176: Hi Suresh, Thanks. I've been tied up with other

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983095#comment-13983095 ] Kihwal Lee commented on HDFS-6293: -- Outputting in the new XML format is fast and consumes

[jira] [Updated] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6293: - Attachment: Heap Histogram.html Attaching heap histogram of OIV. The max heap was set to 2GB to make it

[jira] [Comment Edited] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983105#comment-13983105 ] Kihwal Lee edited comment on HDFS-6293 at 4/28/14 3:33 PM: ---

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983131#comment-13983131 ] Kihwal Lee commented on HDFS-6293: -- The 2.4.0 pb-fsimage does contain tokens, but OIV does

[jira] [Resolved] (HDFS-4793) uploading file larger than the spaceQuota limit should not create 0 byte file

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4793. --- Resolution: Duplicate Duplicate HDFS-172. uploading file larger than the spaceQuota

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983196#comment-13983196 ] Colin Patrick McCabe commented on HDFS-6287: OK, time to implement

[jira] [Commented] (HDFS-6286) adding a timeout setting for local read io

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983194#comment-13983194 ] Colin Patrick McCabe commented on HDFS-6286: It seems like enabling hedged

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983198#comment-13983198 ] Colin Patrick McCabe commented on HDFS-6288: +1. Thanks, Juan.

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983206#comment-13983206 ] Colin Patrick McCabe commented on HDFS-6288: Oops, there is a test failure that

[jira] [Updated] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6288: -- Attachment: HDFS-6288.002.patch Fix unit test testPreadLocalFS DFSInputStream Pread doesn't update

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983215#comment-13983215 ] Andrew Wang commented on HDFS-6288: --- I think Juan's new patch handles this case, so I'm

[jira] [Updated] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6287: --- Attachment: HDFS-6287.003.patch Here's a version that tries to compile with SSE

[jira] [Commented] (HDFS-1309) FileSystem.rename will fail silently

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983259#comment-13983259 ] Colin Patrick McCabe commented on HDFS-1309: Is this still an issue in branch

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983265#comment-13983265 ] Daryn Sharp commented on HDFS-6269: --- +1 Looks good to me. NameNode Audit Log should

[jira] [Created] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-6294: -- Summary: Use INode IDs to avoid conflicts when a file open for write is renamed Key: HDFS-6294 URL: https://issues.apache.org/jira/browse/HDFS-6294

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: HDFS-6294.001.patch Use INode IDs to avoid conflicts when a file open

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983282#comment-13983282 ] Colin Patrick McCabe commented on HDFS-6294: One reason why this comes up is

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983286#comment-13983286 ] Steve Loughran commented on HDFS-6294: -- There's a test for this in HADOOP-9361 which

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983287#comment-13983287 ] Hadoop QA commented on HDFS-6287: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: (was: HDFS-6294.001.patch) Use INode IDs to avoid conflicts when a

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983288#comment-13983288 ] Marcelo Vanzin commented on HDFS-6293: -- Hi Kihwal, We have developed some code

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: HDFS-6294.001.patch Use INode IDs to avoid conflicts when a file open

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Status: Patch Available (was: Open) Use INode IDs to avoid conflicts when a file

[jira] [Updated] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6287: --- Attachment: HDFS-6287.004.patch Looks like on older glibc versions like the one our

[jira] [Commented] (HDFS-6252) Namenode old webUI should be deprecated

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983314#comment-13983314 ] Jing Zhao commented on HDFS-6252: - The current patch looks good to me. The failed tests

[jira] [Updated] (HDFS-6252) Namenode old webUI should be deprecated

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6252: Target Version/s: 3.0.0 Namenode old webUI should be deprecated ---

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983334#comment-13983334 ] Colin Patrick McCabe commented on HDFS-6294: bq. There's a test for this in

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983361#comment-13983361 ] Haohui Mai commented on HDFS-6293: -- bq. Another issue is the complete change of

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983362#comment-13983362 ] Kihwal Lee commented on HDFS-6293: -- [~va...@rededc.com.br]: Thanks for sharing your

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983412#comment-13983412 ] Kihwal Lee commented on HDFS-6293: -- bq. This is by design. I understand that it has merits

[jira] [Commented] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983413#comment-13983413 ] Charles Lamb commented on HDFS-6258: Yi, Probably the easiest thing to do is for you

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983459#comment-13983459 ] Hadoop QA commented on HDFS-6288: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6288: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983508#comment-13983508 ] Hudson commented on HDFS-6288: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5581 (See

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983511#comment-13983511 ] Juan Yu commented on HDFS-6288: --- cool, thanks. DFSInputStream Pread doesn't update

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983547#comment-13983547 ] Hadoop QA commented on HDFS-6287: - {color:green}+1 overall{color}. Here are the results of

[jira] [Comment Edited] (HDFS-5851) Support memory as a storage medium

2014-04-28 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13981608#comment-13981608 ] Sanjay Radia edited comment on HDFS-5851 at 4/28/14 10:23 PM: --

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983679#comment-13983679 ] Aaron T. Myers commented on HDFS-6289: -- I feel confident that the

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983692#comment-13983692 ] Hadoop QA commented on HDFS-6294: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983734#comment-13983734 ] Suresh Srinivas commented on HDFS-6293: --- OfflineImageViewer just dumps the fsimage in

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983802#comment-13983802 ] Todd Lipcon commented on HDFS-6289: --- {code} +// TODO(atm): This should be

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983805#comment-13983805 ] Aaron T. Myers commented on HDFS-6289: -- Thanks for the review, Todd. bq. Maybe you

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983825#comment-13983825 ] Todd Lipcon commented on HDFS-6289: --- Is there any test you could write to show that bug?

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983835#comment-13983835 ] Arpit Agarwal commented on HDFS-5851: - I scheduled a Google+ hangout for 4/30 3-4pm PDT

[jira] [Updated] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6289: - Attachment: HDFS-6289.patch You're right, should probably take care of this separately. I only

[jira] [Created] (HDFS-6295) Add decommissioning state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6295: - Summary: Add decommissioning state and node state filtering to dfsadmin Key: HDFS-6295 URL: https://issues.apache.org/jira/browse/HDFS-6295 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6295) Add decommissioning state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6295: -- Attachment: hdfs-6295-1.patch Patch attached. This adds a new DN state decommissioning, and lets users

[jira] [Updated] (HDFS-6295) Add decommissioning state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6295: -- Status: Patch Available (was: Open) Add decommissioning state and node state filtering to dfsadmin

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983870#comment-13983870 ] Tsz Wo Nicholas Sze commented on HDFS-2882: --- Vinay, the patch cannot be applied

[jira] [Resolved] (HDFS-4211) failed volume causes DataNode#getVolumeInfo NPEs on multi-BP DN

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4211. --- Resolution: Duplicate Resolving this as a duplicate of HDFS-2882. failed volume

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983920#comment-13983920 ] Hadoop QA commented on HDFS-2882: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983926#comment-13983926 ] Hadoop QA commented on HDFS-2882: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5168: -- Component/s: namenode BlockPlacementPolicy does not work for cross node group

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983960#comment-13983960 ] Tsz Wo Nicholas Sze commented on HDFS-5168: --- DNSToSwitchMapping is a \@Public

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983964#comment-13983964 ] Hadoop QA commented on HDFS-6289: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6165) hdfs dfs -rm -r and hdfs -rmdir commands can't remove empty directory

2014-04-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6165: Attachment: HDFS-6165.005.patch hdfs dfs -rm -r and hdfs -rmdir commands can't remove empty

[jira] [Commented] (HDFS-6165) hdfs dfs -rm -r and hdfs -rmdir commands can't remove empty directory

2014-04-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983980#comment-13983980 ] Yongjun Zhang commented on HDFS-6165: - Hi, Thanks a lot for your earlier comments, and

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Sanghyun Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983998#comment-13983998 ] Sanghyun Yun commented on HDFS-5147: hdfs dfsadmin -safemode enter This command's

[jira] [Commented] (HDFS-6165) hdfs dfs -rm -r and hdfs -rmdir commands can't remove empty directory

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984008#comment-13984008 ] Hadoop QA commented on HDFS-6165: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984016#comment-13984016 ] Jing Zhao commented on HDFS-5147: - [~yunsh], you need to specify specific NN URI in the -fs

[jira] [Commented] (HDFS-6297) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984021#comment-13984021 ] Dasha Boudnik commented on HDFS-6297: - I'm looking into this. Add new CLI cases to

[jira] [Created] (HDFS-6296) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
Dasha Boudnik created HDFS-6296: --- Summary: Add new CLI cases to reflect new features of dfs and dfsadmin Key: HDFS-6296 URL: https://issues.apache.org/jira/browse/HDFS-6296 Project: Hadoop HDFS

[jira] [Created] (HDFS-6297) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
Dasha Boudnik created HDFS-6297: --- Summary: Add new CLI cases to reflect new features of dfs and dfsadmin Key: HDFS-6297 URL: https://issues.apache.org/jira/browse/HDFS-6297 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6295) Add decommissioning state and node state filtering to dfsadmin

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984044#comment-13984044 ] Hadoop QA commented on HDFS-6295: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-2882: Attachment: HDFS-2882.patch Attaching the updated patch. DN continues to start up, even if block

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Sanghyun Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984047#comment-13984047 ] Sanghyun Yun commented on HDFS-5147: [~jingzhao], thanks for your answers. I known -fs