[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240733#comment-14240733 ] Vinayakumar B commented on HDFS-7456: - Both findbugs and testfailures are not related.

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240729#comment-14240729 ] Vinayakumar B commented on HDFS-7430: - Haven't gone through full. But checked the itera

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240727#comment-14240727 ] Hadoop QA commented on HDFS-7456: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7426) Change nntop JMX format to be a JSON blob

2014-12-09 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240725#comment-14240725 ] Maysam Yabandeh commented on HDFS-7426: --- bq. Can we put the catch inside the for loop

[jira] [Commented] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240698#comment-14240698 ] Hadoop QA commented on HDFS-7430: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7463: - Attachment: HDFS-7463.008.patch > Simplify FSNamesystem#getBlockLocationsUpdateTimes >

[jira] [Commented] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240653#comment-14240653 ] Hadoop QA commented on HDFS-7503: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240651#comment-14240651 ] Hudson commented on HDFS-7502: -- FAILURE: Integrated in Hadoop-trunk-Commit #6688 (See [https:

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240644#comment-14240644 ] Brandon Li commented on HDFS-7502: -- Thank you, [~wheat9]. > Fix findbugs warning in hdfs-

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7502: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240632#comment-14240632 ] Hadoop QA commented on HDFS-7463: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7504) directory size is shown as 0B when browsing directory

2014-12-09 Thread Wang Peipei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240621#comment-14240621 ] Wang Peipei commented on HDFS-7504: --- Then, can I suppose that HDFS does not calculate th

[jira] [Resolved] (HDFS-7504) directory size is shown as 0B when browsing directory

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7504. -- Resolution: Not a Problem Resolving as not a problem. The behavior is by design. HDFS does not calculate

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240609#comment-14240609 ] Haohui Mai commented on HDFS-7502: -- +1 > Fix findbugs warning in hdfs-nfs project > -

[jira] [Created] (HDFS-7504) directory size is shown as 0B when browsing directory

2014-12-09 Thread Wang Peipei (JIRA)
Wang Peipei created HDFS-7504: - Summary: directory size is shown as 0B when browsing directory Key: HDFS-7504 URL: https://issues.apache.org/jira/browse/HDFS-7504 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7481) Add ACL indicator to the "Permission Denied" exception.

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240582#comment-14240582 ] Hudson commented on HDFS-7481: -- FAILURE: Integrated in Hadoop-trunk-Commit #6687 (See [https:

[jira] [Updated] (HDFS-7481) Add ACL indicator to the "Permission Denied" exception.

2014-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7481: Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Com

[jira] [Commented] (HDFS-7488) HDFS Windows CIFS Gateway

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240572#comment-14240572 ] Colin Patrick McCabe commented on HDFS-7488: Yeah, webDAV is a nice solution fo

[jira] [Commented] (HDFS-7481) Add ACL indicator to the "Permission Denied" exception.

2014-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240569#comment-14240569 ] Vinayakumar B commented on HDFS-7481: - Thank you [~cnauroth] for the review. > Add ACL

[jira] [Updated] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7456: Attachment: HDFS-7456-005.patch Fixed Test > De-duplicate AclFeature instances with same AclEntries

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240513#comment-14240513 ] Hadoop QA commented on HDFS-7449: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7430) Refactor the BlockScanner to use O(1) memory and use multiple threads

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7430: --- Attachment: HDFS-7430.005.patch Rebasing on trunk > Refactor the BlockScanner to use O

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240475#comment-14240475 ] Hadoop QA commented on HDFS-7502: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7449: - Attachment: HDFS-7449.005.patch > Add metrics to NFS gateway > -- > >

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7503: Attachment: HDFS-7503.trunk.02.patch Thanks for the review Suresh. bq. One concern I had was if this

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-09 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240452#comment-14240452 ] Jesse Yates commented on HDFS-6440: --- bq. What is the procedure for adding or replacing NN

[jira] [Commented] (HDFS-7488) HDFS Windows CIFS Gateway

2014-12-09 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240442#comment-14240442 ] Andrew Purtell commented on HDFS-7488: -- bq. Andrew, thanks very much for the WebDav so

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7502: Assignee: Brandon Li (was: Chris Nauroth) > Fix findbugs warning in hdfs-nfs project > -

[jira] [Assigned] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-7502: --- Assignee: Chris Nauroth (was: Brandon Li) > Fix findbugs warning in hdfs-nfs project > --

[jira] [Commented] (HDFS-7475) Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic

2014-12-09 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240425#comment-14240425 ] Xiaoyu Yao commented on HDFS-7475: -- Thanks Arpit for the review. countPendingLazyPersistTa

[jira] [Commented] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240400#comment-14240400 ] Suresh Srinivas commented on HDFS-7503: --- One concern I had was if this information is

[jira] [Commented] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240394#comment-14240394 ] Arpit Agarwal commented on HDFS-7503: - Hi [~sureshms], sure. The fix is pretty trivial.

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7503: Description: If a large directory is deleted and namenode is immediately restarted, there are a lot

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240391#comment-14240391 ] Yongjun Zhang commented on HDFS-6833: - (sorry please ignore last one, submitted from wr

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240384#comment-14240384 ] Yongjun Zhang commented on HDFS-6833: - HI [~sinchii], Thanks for working on the new re

[jira] [Comment Edited] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240380#comment-14240380 ] Suresh Srinivas edited comment on HDFS-7503 at 12/10/14 12:24 AM: ---

[jira] [Commented] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240380#comment-14240380 ] Suresh Srinivas commented on HDFS-7503: --- [~arpitagarwal], can you please describe the

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240366#comment-14240366 ] Lei (Eddy) Xu commented on HDFS-6440: - [~jesse_yates] Thanks for working on this cool f

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240354#comment-14240354 ] Hadoop QA commented on HDFS-7502: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240353#comment-14240353 ] Hadoop QA commented on HDFS-7503: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240325#comment-14240325 ] Hadoop QA commented on HDFS-7502: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7475) Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240322#comment-14240322 ] Arpit Agarwal commented on HDFS-7475: - Hi Xiaoyu, I think {{countPendingLazyPersistTask

[jira] [Commented] (HDFS-7426) Change nntop JMX format to be a JSON blob

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240287#comment-14240287 ] Colin Patrick McCabe commented on HDFS-7426: Good idea. JSON will give you mor

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7503: Attachment: HDFS-7503.trunk.01.patch > Namenode restart after large deletions can cause slow processR

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7503: Status: Patch Available (was: Open) > Namenode restart after large deletions can cause slow processR

[jira] [Updated] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7503: Attachment: HDFS-7503.branch-1.patch > Namenode restart after large deletions can cause slow processR

[jira] [Assigned] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2014-12-09 Thread Gautam Gopalakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautam Gopalakrishnan reassigned HDFS-7501: --- Assignee: Gautam Gopalakrishnan (was: Stephen Chu) > TransactionsSinceLastChe

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Attachment: (was: HDFS-7502.001.patch) > Fix findbugs warning in hdfs-nfs project > ---

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Attachment: HDFS-7502.002.patch > Fix findbugs warning in hdfs-nfs project > --

[jira] [Commented] (HDFS-7467) Provide storage tier information for a directory via fsck

2014-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240268#comment-14240268 ] Benoy Antony commented on HDFS-7467: Could I please get a feedback on this whether it m

[jira] [Commented] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240263#comment-14240263 ] Haohui Mai commented on HDFS-7502: -- we're moving towards findbugs 3.0.0 which generates 14

[jira] [Commented] (HDFS-7466) Allow different values for dfs.datanode.balance.max.concurrent.moves per datanode

2014-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240262#comment-14240262 ] Benoy Antony commented on HDFS-7466: Could I please get some feedback on this jira ?

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Status: Patch Available (was: Open) > Fix findbugs warning in hdfs-nfs project > -

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Attachment: HDFS-7502.001.patch > Fix findbugs warning in hdfs-nfs project > --

[jira] [Created] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

2014-12-09 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7503: --- Summary: Namenode restart after large deletions can cause slow processReport (due to logging) Key: HDFS-7503 URL: https://issues.apache.org/jira/browse/HDFS-7503 Projec

[jira] [Assigned] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2014-12-09 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu reassigned HDFS-7501: - Assignee: Stephen Chu > TransactionsSinceLastCheckpoint can be negative on SBNs >

[jira] [Resolved] (HDFS-7500) Disambiguate hadoop-common/FileSystemShell with hadoop-hdfs/HDFSCommandsGuide

2014-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-7500. Resolution: Duplicate I'm going to fix this as part of HADOOP-10908 . > Disambiguate hadoop-

[jira] [Commented] (HDFS-7460) Rewrite httpfs to use new shell framework

2014-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240233#comment-14240233 ] Allen Wittenauer commented on HDFS-7460: Setting HADOOP-10788 as a blocker since it

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Description: Found the warning when building HDFS-7449 patch: https://builds.apache.org/job/PreCommit-HDFS

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240224#comment-14240224 ] Brandon Li commented on HDFS-7449: -- The findbugs warnings are not introduced by this patch

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Component/s: nfs > Fix findbugs warning in hdfs-nfs project > > >

[jira] [Updated] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7502: - Attachment: FindBugs Report.html Uploaded the findbugs warning report. > Fix findbugs warning in hdfs-nfs

[jira] [Created] (HDFS-7502) Fix findbugs warning in hdfs-nfs project

2014-12-09 Thread Brandon Li (JIRA)
Brandon Li created HDFS-7502: Summary: Fix findbugs warning in hdfs-nfs project Key: HDFS-7502 URL: https://issues.apache.org/jira/browse/HDFS-7502 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7501) TransactionsSinceLastCheckpoint can be negative on SBNs

2014-12-09 Thread Harsh J (JIRA)
Harsh J created HDFS-7501: - Summary: TransactionsSinceLastCheckpoint can be negative on SBNs Key: HDFS-7501 URL: https://issues.apache.org/jira/browse/HDFS-7501 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-6652) RecoverLease cannot succeed and file cannot be closed under high load

2014-12-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-6652: --- Assignee: Yongjun Zhang > RecoverLease cannot succeed and file cannot be closed under high loa

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240190#comment-14240190 ] Hadoop QA commented on HDFS-7449: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240189#comment-14240189 ] Colin Patrick McCabe commented on HDFS-5574: Thanks for your patience. I'll tr

[jira] [Updated] (HDFS-7461) Reduce impact of laggards on Mover

2014-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7461: --- Attachment: (was: continuousmovement.pdf) > Reduce impact of laggards on Mover > --

[jira] [Updated] (HDFS-7461) Reduce impact of laggards on Mover

2014-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7461: --- Attachment: continuousmovement.pdf > Reduce impact of laggards on Mover > -

[jira] [Updated] (HDFS-7461) Reduce impact of laggards on Mover

2014-12-09 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7461: --- Attachment: continuousmovement.pdf Attaching a brief design document to explain the problem, solution a

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240148#comment-14240148 ] Hadoop QA commented on HDFS-7456: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240135#comment-14240135 ] Brandon Li commented on HDFS-7449: -- Uploaded a new patch to use nanoseconds. > Add metric

[jira] [Updated] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7449: - Attachment: HDFS-7449.004.patch > Add metrics to NFS gateway > -- > >

[jira] [Commented] (HDFS-7500) Disambiguate hadoop-common/FileSystemShell with hadoop-hdfs/HDFSCommandsGuide

2014-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240129#comment-14240129 ] Allen Wittenauer commented on HDFS-7500: It looks like maybe the only problem is ac

[jira] [Commented] (HDFS-7500) Disambiguate hadoop-common/FileSystemShell with hadoop-hdfs/HDFSCommandsGuide

2014-12-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240127#comment-14240127 ] Allen Wittenauer commented on HDFS-7500: A proposal for a plan of action: a) Pull

[jira] [Created] (HDFS-7500) Disambiguate hadoop-common/FileSystemShell with hadoop-hdfs/HDFSCommandsGuide

2014-12-09 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7500: -- Summary: Disambiguate hadoop-common/FileSystemShell with hadoop-hdfs/HDFSCommandsGuide Key: HDFS-7500 URL: https://issues.apache.org/jira/browse/HDFS-7500 Project

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240082#comment-14240082 ] Hadoop QA commented on HDFS-7456: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7463: - Attachment: HDFS-7463.007.patch > Simplify FSNamesystem#getBlockLocationsUpdateTimes >

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240057#comment-14240057 ] Brandon Li commented on HDFS-7449: -- Just noticed that I was using ms instead of ns. Will u

[jira] [Commented] (HDFS-5578) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240010#comment-14240010 ] Hadoop QA commented on HDFS-5578: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239997#comment-14239997 ] Hadoop QA commented on HDFS-7463: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7481) Add ACL indicator to the "Permission Denied" exception.

2014-12-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7481: Hadoop Flags: Reviewed +1 for the patch. Thanks, [~vinayrpet]! bq. -1 tests included. The patch doe

[jira] [Updated] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7463: - Attachment: HDFS-7463.006.patch > Simplify FSNamesystem#getBlockLocationsUpdateTimes >

[jira] [Commented] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239932#comment-14239932 ] Hudson commented on HDFS-7498: -- FAILURE: Integrated in Hadoop-trunk-Commit #6679 (See [https:

[jira] [Commented] (HDFS-5578) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239931#comment-14239931 ] Haohui Mai commented on HDFS-5578: -- [~apurtell], I rebased your patch on the latest trunk.

[jira] [Updated] (HDFS-5578) [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5578: - Attachment: HDFS-5578.000.patch > [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comm

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239922#comment-14239922 ] Hadoop QA commented on HDFS-5574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239907#comment-14239907 ] Haohui Mai commented on HDFS-7498: -- +1 > Simplify the logic in INodesInPath > ---

[jira] [Commented] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239896#comment-14239896 ] Jing Zhao commented on HDFS-7498: - Thanks for the review, Haohui! bq. Is it accidental? N

[jira] [Commented] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239894#comment-14239894 ] Haohui Mai commented on HDFS-7498: -- The patch looks good. {code} - iip.setINode(pos

[jira] [Commented] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239881#comment-14239881 ] Jing Zhao commented on HDFS-7463: - The patch looks good to me. Some comments: # {{resolvePa

[jira] [Assigned] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2014-12-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-7489: Assignee: Noah Lorang > Incorrect locking in FsVolumeList#checkDirs can hang datanodes > ---

[jira] [Commented] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2014-12-09 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239854#comment-14239854 ] Noah Lorang commented on HDFS-7489: --- My pleasure. Thanks for getting this upstream so qui

[jira] [Updated] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Resolution: Fixed Fix Version/s: 2.6.1 Target Version/s: 2.6.1

[jira] [Commented] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239844#comment-14239844 ] Colin Patrick McCabe commented on HDFS-7489: Ah. The findbugs version was bump

[jira] [Updated] (HDFS-7489) Incorrect locking in FsVolumeList#checkDirs can hang datanodes

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Summary: Incorrect locking in FsVolumeList#checkDirs can hang datanodes (was: Slow FsV

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239835#comment-14239835 ] Colin Patrick McCabe commented on HDFS-7489: Test failures are bogus. I ran Te

[jira] [Comment Edited] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239814#comment-14239814 ] Brandon Li edited comment on HDFS-7449 at 12/9/14 6:47 PM: --- The f

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-09 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239814#comment-14239814 ] Brandon Li commented on HDFS-7449: -- The findbugs warning seems to be a findbugs+JAVA7 prob

  1   2   >