[jira] [Updated] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7481: Attachment: HDFS-7481-001.patch Attaching the patch. Please review. Add ACL indicator to the

[jira] [Updated] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7481: Status: Patch Available (was: Open) Add ACL indicator to the Permission Denied exception.

[jira] [Commented] (HDFS-6522) DN will try to append to non-existent replica if the datanode has out-dated block

2014-12-08 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237664#comment-14237664 ] Masatake Iwasaki commented on HDFS-6522: Is this fixed by HDFS-5438? DN will try

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: HDFS-7349-002.patch Updated the patch as said earlier. Please review Support DFS

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: HDFS-7349-002.patch Support DFS command for the EC encoding

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: (was: HDFS-7349-002.patch) Support DFS command for the EC encoding

[jira] [Commented] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237699#comment-14237699 ] Hadoop QA commented on HDFS-7481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: (was: HDFS-7349-002.patch) Support DFS command for the EC encoding

[jira] [Updated] (HDFS-7349) Support DFS command for the EC encoding

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7349: Attachment: HDFS-7349-002.patch Support DFS command for the EC encoding

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237730#comment-14237730 ] Hadoop QA commented on HDFS-7456: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6311) TestLargeBlock#testLargeBlockSize : File /tmp/TestLargeBlock/2147484160.dat could only be replicated to 0 nodes instead of minReplication (=1)

2014-12-08 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Reix updated HDFS-6311: Affects Version/s: 2.4.1 TestLargeBlock#testLargeBlockSize : File /tmp/TestLargeBlock/2147484160.dat

[jira] [Commented] (HDFS-6311) TestLargeBlock#testLargeBlockSize : File /tmp/TestLargeBlock/2147484160.dat could only be replicated to 0 nodes instead of minReplication (=1)

2014-12-08 Thread Tony Reix (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237735#comment-14237735 ] Tony Reix commented on HDFS-6311: - I'm still having issue with this test, now with Hadoop

[jira] [Created] (HDFS-7487) NPE in MetricsSourceAdapter

2014-12-08 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-7487: -- Summary: NPE in MetricsSourceAdapter Key: HDFS-7487 URL: https://issues.apache.org/jira/browse/HDFS-7487 Project: Hadoop HDFS Issue Type: Bug

[jira] [Assigned] (HDFS-7487) NPE in MetricsSourceAdapter

2014-12-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7487: -- Assignee: Brahma Reddy Battula NPE in MetricsSourceAdapter

[jira] [Commented] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237875#comment-14237875 ] Hadoop QA commented on HDFS-7481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7487) NPE in MetricsSourceAdapter

2014-12-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7487: --- Attachment: HDFS-7487.patch NPE in MetricsSourceAdapter ---

[jira] [Updated] (HDFS-7487) NPE in MetricsSourceAdapter

2014-12-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7487: --- Affects Version/s: 2.4.1 2.6.0 2.5.1

[jira] [Updated] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2014-12-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7452: --- Priority: Trivial (was: Major) Can we skip getCorruptFiles() call for standby

[jira] [Commented] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2014-12-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238030#comment-14238030 ] Brahma Reddy Battula commented on HDFS-7452: Hi [~vinayrpet] Thanks for taking

[jira] [Created] (HDFS-7488) HDFS Windows CIFS Gateway

2014-12-08 Thread Hari Sekhon (JIRA)
Hari Sekhon created HDFS-7488: - Summary: HDFS Windows CIFS Gateway Key: HDFS-7488 URL: https://issues.apache.org/jira/browse/HDFS-7488 Project: Hadoop HDFS Issue Type: New Feature Affects

[jira] [Created] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
Noah Lorang created HDFS-7489: - Summary: Slow FsVolumeList checkDirs can hang datanodes Key: HDFS-7489 URL: https://issues.apache.org/jira/browse/HDFS-7489 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noah Lorang updated HDFS-7489: -- Attachment: HDFS-7489-v1.patch Slow FsVolumeList checkDirs can hang datanodes

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

2014-12-08 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238143#comment-14238143 ] Lohit Vijayarenu commented on HDFS-7281: Hi [~mingma], These changes look good.

[jira] [Commented] (HDFS-7475) Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministic

2014-12-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238153#comment-14238153 ] Xiaoyu Yao commented on HDFS-7475: -- Thanks [~wheat9] for reviewing the patch. Agree that

[jira] [Commented] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238182#comment-14238182 ] Hadoop QA commented on HDFS-7481: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7384) 'getfacl' command and 'getAclStatus' output should be in sync

2014-12-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238210#comment-14238210 ] Hudson commented on HDFS-7384: -- FAILURE: Integrated in Hadoop-trunk-Commit #6669 (See

[jira] [Updated] (HDFS-7384) 'getfacl' command and 'getAclStatus' output should be in sync

2014-12-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7384: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7384) 'getfacl' command and 'getAclStatus' output should be in sync

2014-12-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7384: Component/s: namenode 'getfacl' command and 'getAclStatus' output should be in sync

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noah Lorang updated HDFS-7489: -- Status: Patch Available (was: Open) Slow FsVolumeList checkDirs can hang datanodes

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238238#comment-14238238 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7473) Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid

2014-12-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7473: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7473) Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid

2014-12-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238291#comment-14238291 ] Hudson commented on HDFS-7473: -- FAILURE: Integrated in Hadoop-trunk-Commit #6670 (See

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2014-12-08 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238299#comment-14238299 ] Jesse Yates commented on HDFS-6440: --- So, what can I do to help push this along? I'm happy

[jira] [Commented] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238305#comment-14238305 ] Chris Nauroth commented on HDFS-7481: - Hi, Vinay. Thank you for picking this up.

[jira] [Commented] (HDFS-7441) More accurate detection for slow node in HDFS write pipeline

2014-12-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238306#comment-14238306 ] Ming Ma commented on HDFS-7441: --- Without this we use the following work around: * Piggyback

[jira] [Commented] (HDFS-7486) Consolidate XAttr-related implementation into a single class

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238344#comment-14238344 ] Jing Zhao commented on HDFS-7486: - The patch looks good to me. +1 One minor is that with

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238341#comment-14238341 ] Lei (Eddy) Xu commented on HDFS-7489: - Hi, [~nlorang]. This is a very good observation

[jira] [Updated] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2014-12-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7400: -- Attachment: HDFS-7400.patch Thanks, [~ste...@apache.org], [~cmccabe] and [~aw] for the additional suggestions

[jira] [Updated] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2014-12-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7400: -- Assignee: Ming Ma Status: Patch Available (was: Open) More reliable namenode health check to detect

[jira] [Commented] (HDFS-7400) More reliable namenode health check to detect OS/HW issues

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238388#comment-14238388 ] Hadoop QA commented on HDFS-7400: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7456) De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode

2014-12-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238394#comment-14238394 ] Chris Nauroth commented on HDFS-7456: - Thank you for the patch, Vinay. Here are a few

[jira] [Created] (HDFS-7490) HDFS tests OOM on Java7+

2014-12-08 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-7490: Summary: HDFS tests OOM on Java7+ Key: HDFS-7490 URL: https://issues.apache.org/jira/browse/HDFS-7490 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7486) Consolidate XAttr-related implementation into a single class

2014-12-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238397#comment-14238397 ] Hudson commented on HDFS-7486: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6671 (See

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238416#comment-14238416 ] Colin Patrick McCabe commented on HDFS-7489: Thanks for looking at this,

[jira] [Updated] (HDFS-7490) HDFS tests OOM on Java7+

2014-12-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-7490: - Attachment: HADOOP-11363-001.patch HDFS tests OOM on Java7+

[jira] [Updated] (HDFS-7490) HDFS tests OOM on Java7+

2014-12-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-7490: - Status: Patch Available (was: Open) HDFS tests OOM on Java7+

[jira] [Commented] (HDFS-7490) HDFS tests OOM on Java7+

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238418#comment-14238418 ] Hadoop QA commented on HDFS-7490: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noah Lorang updated HDFS-7489: -- Attachment: HDFS-7489-v2.patch Slow FsVolumeList checkDirs can hang datanodes

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238472#comment-14238472 ] Noah Lorang commented on HDFS-7489: --- Thanks [~eddyxu] and [~cmccabe]. If I'm not

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Noah Lorang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Noah Lorang updated HDFS-7489: -- Attachment: (was: HDFS-7489-v2.patch) Slow FsVolumeList checkDirs can hang datanodes

[jira] [Created] (HDFS-7491) Add incremental blockreport latency to DN metrics

2014-12-08 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7491: - Summary: Add incremental blockreport latency to DN metrics Key: HDFS-7491 URL: https://issues.apache.org/jira/browse/HDFS-7491 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238481#comment-14238481 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7491) Add incremental blockreport latency to DN metrics

2014-12-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7491: -- Attachment: HDFS-7491.patch Here is the patch to add IBR latency to DataNodeMetrics. Add incremental

[jira] [Updated] (HDFS-7486) Consolidate XAttr-related implementation into a single class

2014-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7486: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238515#comment-14238515 ] Colin Patrick McCabe commented on HDFS-7489: Noah, this fix solves the current

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Priority: Critical (was: Major) Slow FsVolumeList checkDirs can hang datanodes

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238517#comment-14238517 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7488) HDFS Windows CIFS Gateway

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238554#comment-14238554 ] Colin Patrick McCabe commented on HDFS-7488: CIFS is a very complex protocol,

[jira] [Created] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

2014-12-08 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7492: -- Summary: If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads Key: HDFS-7492

[jira] [Commented] (HDFS-7492) If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238565#comment-14238565 ] Colin Patrick McCabe commented on HDFS-7492: I think a Guava cache could be

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Attachment: HDFS-7489-v2.patch-with-minjdk6 It seems like we are still hitting

[jira] [Created] (HDFS-7493) removedDst should be checked against null in finally block of FSDirRenameOp#unprotectedRenameTo()

2014-12-08 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7493: Summary: removedDst should be checked against null in finally block of FSDirRenameOp#unprotectedRenameTo() Key: HDFS-7493 URL: https://issues.apache.org/jira/browse/HDFS-7493

[jira] [Created] (HDFS-7494) Checking of closed in DFSInputStream#pread() should be protected by synchronization

2014-12-08 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7494: Summary: Checking of closed in DFSInputStream#pread() should be protected by synchronization Key: HDFS-7494 URL: https://issues.apache.org/jira/browse/HDFS-7494 Project: Hadoop HDFS

[jira] [Created] (HDFS-7495) Lock inversion in DFSInputStream#getBlockAt()

2014-12-08 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7495: Summary: Lock inversion in DFSInputStream#getBlockAt() Key: HDFS-7495 URL: https://issues.apache.org/jira/browse/HDFS-7495 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7495) Lock inversion in DFSInputStream#getBlockAt()

2014-12-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238590#comment-14238590 ] Ted Yu commented on HDFS-7495: -- Here is one path where lock on this is not obtained first:

[jira] [Updated] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-08 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7463: - Attachment: HDFS-7463.005.patch Simplify FSNamesystem#getBlockLocationsUpdateTimes

[jira] [Commented] (HDFS-5894) Refactor a private internal class DataTransferEncryptor.SaslParticipant

2014-12-08 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238603#comment-14238603 ] Harsh J commented on HDFS-5894: --- The failed test isn't related to the changes. Refactor a

[jira] [Created] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode

2014-12-08 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7496: -- Summary: Fix FsVolume removal race conditions on the DataNode Key: HDFS-7496 URL: https://issues.apache.org/jira/browse/HDFS-7496 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238622#comment-14238622 ] Hadoop QA commented on HDFS-7463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238621#comment-14238621 ] Colin Patrick McCabe commented on HDFS-7496: So, FsVolume removal can happen

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238623#comment-14238623 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Attachment: HDFS-7489-v2.patch-with-minjdk6-2 Slow FsVolumeList checkDirs can hang

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238635#comment-14238635 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7067) ClassCastException while using a key created by keytool to create encryption zone.

2014-12-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7067: --- Attachment: HDFS-7067.001.patch hdfs7067.keystore This won't pass in jenkins because

[jira] [Updated] (HDFS-7067) ClassCastException while using a key created by keytool to create encryption zone.

2014-12-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7067: --- Fix Version/s: (was: 2.7.0) Target Version/s: 2.7.0 (was: 2.6.0) Status:

[jira] [Commented] (HDFS-7067) ClassCastException while using a key created by keytool to create encryption zone.

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238702#comment-14238702 ] Hadoop QA commented on HDFS-7067: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7449) Add metrics to NFS gateway

2014-12-08 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7449: - Status: Patch Available (was: Open) Add metrics to NFS gateway --

[jira] [Updated] (HDFS-7449) Add metrics to NFS gateway

2014-12-08 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7449: - Attachment: HDFS-7449.001.patch Add metrics to NFS gateway --

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238722#comment-14238722 ] Hadoop QA commented on HDFS-7449: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Attachment: (was: HDFS-7489-v2.patch-with-minjdk6) Slow FsVolumeList checkDirs

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Attachment: HDFS-7489-v2.patch.1 Slow FsVolumeList checkDirs can hang datanodes

[jira] [Updated] (HDFS-7449) Add metrics to NFS gateway

2014-12-08 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7449: - Attachment: HDFS-7449.002.patch Add metrics to NFS gateway --

[jira] [Updated] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7489: --- Attachment: (was: HDFS-7489-v2.patch-with-minjdk6-2) Slow FsVolumeList checkDirs

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238735#comment-14238735 ] Colin Patrick McCabe commented on HDFS-7489: It looks like HADOOP-10530 broke

[jira] [Updated] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7496: --- Assignee: Lei (Eddy) Xu (was: Colin Patrick McCabe) Fix FsVolume removal race

[jira] [Commented] (HDFS-7449) Add metrics to NFS gateway

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238782#comment-14238782 ] Hadoop QA commented on HDFS-7449: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7496) Fix FsVolume removal race conditions on the DataNode

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238806#comment-14238806 ] Colin Patrick McCabe commented on HDFS-7496: Eddy and I talked offline about

[jira] [Commented] (HDFS-7445) Implement packet memory pool in output stream in libhdfs3

2014-12-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238836#comment-14238836 ] Colin Patrick McCabe commented on HDFS-7445: I don't have a strong preference,

[jira] [Commented] (HDFS-7488) HDFS Windows CIFS Gateway

2014-12-08 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238891#comment-14238891 ] Andrew Purtell commented on HDFS-7488: -- A while back using Apache Jackrabbit I

[jira] [Commented] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238908#comment-14238908 ] Vinayakumar B commented on HDFS-7481: - oh ok got it, will update it soon Add ACL

[jira] [Commented] (HDFS-7489) Slow FsVolumeList checkDirs can hang datanodes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238933#comment-14238933 ] Hadoop QA commented on HDFS-7489: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7463) Simplify FSNamesystem#getBlockLocationsUpdateTimes

2014-12-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238934#comment-14238934 ] Hadoop QA commented on HDFS-7463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7497) Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui

2014-12-08 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-7497: --- Summary: Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webui Key: HDFS-7497 URL: https://issues.apache.org/jira/browse/HDFS-7497

[jira] [Updated] (HDFS-7481) Add ACL indicator to the Permission Denied exception.

2014-12-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7481: Attachment: HDFS-7481-002.patch Updated. Add ACL indicator to the Permission Denied exception.

[jira] [Created] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-7498: --- Summary: Simplify the logic in INodesInPath Key: HDFS-7498 URL: https://issues.apache.org/jira/browse/HDFS-7498 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Attachment: HDFS-7498.000.patch Initial patch. Simplify the logic in INodesInPath

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Attachment: (was: HDFS-7498.000.patch) Simplify the logic in INodesInPath

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Component/s: namenode Simplify the logic in INodesInPath --

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Target Version/s: 2.7.0 Status: Patch Available (was: Open) Simplify the logic in

[jira] [Updated] (HDFS-7498) Simplify the logic in INodesInPath

2014-12-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7498: Attachment: HDFS-7498.000.patch Simplify the logic in INodesInPath --

  1   2   >