[jira] [Commented] (HDFS-6292) Display HDFS per user and per group usage on the webUI

2014-04-28 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984079#comment-13984079 ] Ravi Prakash commented on HDFS-6292: Hi Vinayakumar! Thanks for your feedback! I consid

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984078#comment-13984078 ] Vinayakumar B commented on HDFS-5147: - Adding to above comment, in NameNodeRpcServer c

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984077#comment-13984077 ] Vinayakumar B commented on HDFS-5147: - For getting the safemode status from active name

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984062#comment-13984062 ] Jing Zhao commented on HDFS-5147: - The issue is that it is hard to make sure the safemode c

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984059#comment-13984059 ] Vinayakumar B commented on HDFS-6294: - Do you mean we can support continue writing to f

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Sanghyun Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984047#comment-13984047 ] Sanghyun Yun commented on HDFS-5147: [~jingzhao], thanks for your answers. I known -fs

[jira] [Updated] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-2882: Attachment: HDFS-2882.patch Attaching the updated patch. > DN continues to start up, even if block

[jira] [Commented] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984044#comment-13984044 ] Hadoop QA commented on HDFS-6295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6297) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
Dasha Boudnik created HDFS-6297: --- Summary: Add new CLI cases to reflect new features of dfs and dfsadmin Key: HDFS-6297 URL: https://issues.apache.org/jira/browse/HDFS-6297 Project: Hadoop HDFS

[jira] [Created] (HDFS-6296) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
Dasha Boudnik created HDFS-6296: --- Summary: Add new CLI cases to reflect new features of dfs and dfsadmin Key: HDFS-6296 URL: https://issues.apache.org/jira/browse/HDFS-6296 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6297) Add new CLI cases to reflect new features of dfs and dfsadmin

2014-04-28 Thread Dasha Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984021#comment-13984021 ] Dasha Boudnik commented on HDFS-6297: - I'm looking into this. > Add new CLI cases to r

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984016#comment-13984016 ] Jing Zhao commented on HDFS-5147: - [~yunsh], you need to specify specific NN URI in the -fs

[jira] [Commented] (HDFS-6165) "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty directory

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984008#comment-13984008 ] Hadoop QA commented on HDFS-6165: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5147) Certain dfsadmin commands such as safemode do not interact with the active namenode in ha setup

2014-04-28 Thread Sanghyun Yun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983998#comment-13983998 ] Sanghyun Yun commented on HDFS-5147: hdfs dfsadmin -safemode enter This command's resu

[jira] [Commented] (HDFS-6165) "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty directory

2014-04-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983980#comment-13983980 ] Yongjun Zhang commented on HDFS-6165: - Hi, Thanks a lot for your earlier comments, and

[jira] [Updated] (HDFS-6165) "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty directory

2014-04-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6165: Attachment: HDFS-6165.005.patch > "hdfs dfs -rm -r" and "hdfs -rmdir" commands can't remove empty di

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983964#comment-13983964 ] Hadoop QA commented on HDFS-6289: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983960#comment-13983960 ] Tsz Wo Nicholas Sze commented on HDFS-5168: --- DNSToSwitchMapping is a \@Public \@E

[jira] [Updated] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5168: -- Component/s: namenode > BlockPlacementPolicy does not work for cross node group dependen

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983926#comment-13983926 ] Hadoop QA commented on HDFS-2882: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983920#comment-13983920 ] Hadoop QA commented on HDFS-2882: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-4211) failed volume causes DataNode#getVolumeInfo NPEs on multi-BP DN

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4211. --- Resolution: Duplicate Resolving this as a duplicate of HDFS-2882. > failed volume cau

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983870#comment-13983870 ] Tsz Wo Nicholas Sze commented on HDFS-2882: --- Vinay, the patch cannot be applied a

[jira] [Updated] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6295: -- Attachment: hdfs-6295-1.patch Patch attached. This adds a new DN state "decommissioning", and lets users

[jira] [Updated] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6295: -- Status: Patch Available (was: Open) > Add "decommissioning" state and node state filtering to dfsadmin

[jira] [Created] (HDFS-6295) Add "decommissioning" state and node state filtering to dfsadmin

2014-04-28 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6295: - Summary: Add "decommissioning" state and node state filtering to dfsadmin Key: HDFS-6295 URL: https://issues.apache.org/jira/browse/HDFS-6295 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6289: - Attachment: HDFS-6289.patch You're right, should probably take care of this separately. I only inc

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983835#comment-13983835 ] Arpit Agarwal commented on HDFS-5851: - I scheduled a Google+ hangout for 4/30 3-4pm PDT

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983825#comment-13983825 ] Todd Lipcon commented on HDFS-6289: --- Is there any test you could write to show that bug?

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983805#comment-13983805 ] Aaron T. Myers commented on HDFS-6289: -- Thanks for the review, Todd. bq. Maybe you sh

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983802#comment-13983802 ] Todd Lipcon commented on HDFS-6289: --- {code} +// TODO(atm): This should be s/store

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983734#comment-13983734 ] Suresh Srinivas commented on HDFS-6293: --- OfflineImageViewer just dumps the fsimage in

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983692#comment-13983692 ] Hadoop QA commented on HDFS-6294: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-28 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983679#comment-13983679 ] Aaron T. Myers commented on HDFS-6289: -- I feel confident that the TestBalancerWithNode

[jira] [Comment Edited] (HDFS-5851) Support memory as a storage medium

2014-04-28 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981608#comment-13981608 ] Sanjay Radia edited comment on HDFS-5851 at 4/28/14 10:23 PM: --

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983547#comment-13983547 ] Hadoop QA commented on HDFS-6287: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983511#comment-13983511 ] Juan Yu commented on HDFS-6288: --- cool, thanks. > DFSInputStream Pread doesn't update Rea

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983508#comment-13983508 ] Hudson commented on HDFS-6288: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5581 (See [https:

[jira] [Updated] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6288: -- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983459#comment-13983459 ] Hadoop QA commented on HDFS-6288: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983413#comment-13983413 ] Charles Lamb commented on HDFS-6258: Yi, Probably the easiest thing to do is for you t

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983412#comment-13983412 ] Kihwal Lee commented on HDFS-6293: -- bq. This is by design. I understand that it has merits

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983362#comment-13983362 ] Kihwal Lee commented on HDFS-6293: -- [~va...@rededc.com.br]: Thanks for sharing your experi

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983361#comment-13983361 ] Haohui Mai commented on HDFS-6293: -- bq. Another issue is the complete change of format/con

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983334#comment-13983334 ] Colin Patrick McCabe commented on HDFS-6294: bq. There's a test for this in HAD

[jira] [Updated] (HDFS-6252) Namenode old webUI should be deprecated

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6252: Target Version/s: 3.0.0 > Namenode old webUI should be deprecated > ---

[jira] [Commented] (HDFS-6252) Namenode old webUI should be deprecated

2014-04-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983314#comment-13983314 ] Jing Zhao commented on HDFS-6252: - The current patch looks good to me. The failed tests sho

[jira] [Updated] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6287: --- Attachment: HDFS-6287.004.patch Looks like on older glibc versions like the one our je

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Status: Patch Available (was: Open) > Use INode IDs to avoid conflicts when a file op

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: HDFS-6294.001.patch > Use INode IDs to avoid conflicts when a file open fo

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: (was: HDFS-6294.001.patch) > Use INode IDs to avoid conflicts when a f

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983287#comment-13983287 ] Hadoop QA commented on HDFS-6287: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983288#comment-13983288 ] Marcelo Vanzin commented on HDFS-6293: -- Hi Kihwal, We have developed some code intern

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983286#comment-13983286 ] Steve Loughran commented on HDFS-6294: -- There's a test for this in HADOOP-9361 which a

[jira] [Commented] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983282#comment-13983282 ] Colin Patrick McCabe commented on HDFS-6294: One reason why this comes up is be

[jira] [Updated] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6294: --- Attachment: HDFS-6294.001.patch > Use INode IDs to avoid conflicts when a file open fo

[jira] [Created] (HDFS-6294) Use INode IDs to avoid conflicts when a file open for write is renamed

2014-04-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-6294: -- Summary: Use INode IDs to avoid conflicts when a file open for write is renamed Key: HDFS-6294 URL: https://issues.apache.org/jira/browse/HDFS-6294 Projec

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983265#comment-13983265 ] Daryn Sharp commented on HDFS-6269: --- +1 Looks good to me. > NameNode Audit Log should di

[jira] [Commented] (HDFS-1309) FileSystem.rename will fail silently

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983259#comment-13983259 ] Colin Patrick McCabe commented on HDFS-1309: Is this still an issue in branch 2

[jira] [Updated] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6287: --- Attachment: HDFS-6287.003.patch Here's a version that tries to compile with SSE intrin

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983215#comment-13983215 ] Andrew Wang commented on HDFS-6288: --- I think Juan's new patch handles this case, so I'm +

[jira] [Updated] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu updated HDFS-6288: -- Attachment: HDFS-6288.002.patch Fix unit test "testPreadLocalFS" > DFSInputStream Pread doesn't update ReadStat

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983206#comment-13983206 ] Colin Patrick McCabe commented on HDFS-6288: Oops, there is a test failure that

[jira] [Commented] (HDFS-6288) DFSInputStream Pread doesn't update ReadStatistics

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983198#comment-13983198 ] Colin Patrick McCabe commented on HDFS-6288: +1. Thanks, Juan. > DFSInputStre

[jira] [Commented] (HDFS-6287) Add vecsum test of libhdfs read access times

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983196#comment-13983196 ] Colin Patrick McCabe commented on HDFS-6287: OK, time to implement auto-detecti

[jira] [Commented] (HDFS-6286) adding a timeout setting for local read io

2014-04-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983194#comment-13983194 ] Colin Patrick McCabe commented on HDFS-6286: It seems like enabling hedged read

[jira] [Resolved] (HDFS-4793) uploading file larger than the spaceQuota limit should not create 0 byte file

2014-04-28 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4793. --- Resolution: Duplicate Duplicate HDFS-172. > uploading file larger than the spaceQuota

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983131#comment-13983131 ] Kihwal Lee commented on HDFS-6293: -- The 2.4.0 pb-fsimage does contain tokens, but OIV does

[jira] [Comment Edited] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983105#comment-13983105 ] Kihwal Lee edited comment on HDFS-6293 at 4/28/14 3:33 PM: --- Attac

[jira] [Updated] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6293: - Attachment: Heap Histogram.html Attaching heap histogram of OIV. The max heap was set to 2GB to make it go

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983095#comment-13983095 ] Kihwal Lee commented on HDFS-6293: -- Outputting in the new XML format is fast and consumes

[jira] [Commented] (HDFS-6176) Remove assignments to method arguments

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983066#comment-13983066 ] Charles Lamb commented on HDFS-6176: Hi Suresh, Thanks. I've been tied up with other t

[jira] [Created] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-04-28 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6293: Summary: Issues with OIV processing PB-based fsimages Key: HDFS-6293 URL: https://issues.apache.org/jira/browse/HDFS-6293 Project: Hadoop HDFS Issue Type: Bug Af

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983031#comment-13983031 ] Eric Payne commented on HDFS-6269: -- The patch for this JIRA did not cause the unit test fa

[jira] [Commented] (HDFS-6218) Audit log should use true client IP for proxied webhdfs operations

2014-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983030#comment-13983030 ] Hudson commented on HDFS-6218: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5579 (See [https:

[jira] [Commented] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983024#comment-13983024 ] Kihwal Lee commented on HDFS-6269: -- The test failure is due to HDFS-6250. > NameNode Audi

[jira] [Updated] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6269: - Target Version/s: 2.5.0 (was: 2.4.1) > NameNode Audit Log should differentiate between webHDFS open and H

[jira] [Updated] (HDFS-6218) Audit log should use true client IP for proxied webhdfs operations

2014-04-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6218: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983007#comment-13983007 ] Charles Lamb commented on HDFS-6258: Hi Yi, Here are a few minor things that I picked

[jira] [Commented] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982933#comment-13982933 ] Hadoop QA commented on HDFS-5168: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6261) Add document for enabling node group layer in HDFS

2014-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982798#comment-13982798 ] Hadoop QA commented on HDFS-6261: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5168) BlockPlacementPolicy does not work for cross node group dependencies

2014-04-28 Thread Nikola Vujic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikola Vujic updated HDFS-5168: --- Attachment: HDFS-5168.patch attaching original patch again. > BlockPlacementPolicy does not work for