[jira] [Updated] (HDFS-6405) Test Crypto streams in HDFS

2014-07-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6405: - Attachment: HDFS-6405.5.patch [~andrew.wang], thanks for your good comments. I update the patch for them. Test

[jira] [Commented] (HDFS-6671) Archival Storage: Consider block storage policy in replicaiton

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063210#comment-14063210 ] Vinayakumar B commented on HDFS-6671: - patch looks better. One small suggestion, It

[jira] [Updated] (HDFS-6114) Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6114: Attachment: HDFS-6114.patch Attached the updated patch 1. Used TreeSet for newBlockInfoSet 2.

[jira] [Updated] (HDFS-6655) Add 'header banner' to 'explorer.html' also in Namenode UI

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6655: Summary: Add 'header banner' to 'explorer.html' also in Namenode UI (was: Add 'header-bar' to

[jira] [Commented] (HDFS-6655) Add 'header banner' to 'explorer.html' also in Namenode UI

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063243#comment-14063243 ] Vinayakumar B commented on HDFS-6655: - Hi [~wheat9], can you review this patch? Thanks

[jira] [Updated] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6247: Attachment: HDFS-6247.patch Attaching the rebased patch. Please review. Avoid timeouts for

[jira] [Updated] (HDFS-5503) Datanode#checkDiskError also should check for ClosedChannelException

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-5503: Resolution: Duplicate Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-4223) Browsing filesystem from specific datanode in live nodes page also should include delegation token in the url

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-4223: Resolution: Won't Fix Target Version/s: 2.0.3-alpha, 3.0.0 (was: 3.0.0, 2.0.3-alpha)

[jira] [Updated] (HDFS-3744) Decommissioned nodes are included in cluster after switch which is not expected

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-3744: Resolution: Duplicate Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-5624) Add HDFS tests for ACLs in combination with viewfs.

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063269#comment-14063269 ] Hadoop QA commented on HDFS-5624: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.1.patch Update patch to support exclude nodes in WebHDFS. bestNode shouldn't

[jira] [Commented] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063283#comment-14063283 ] Hadoop QA commented on HDFS-6478: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6455) NFS: Exception should be added in NFS log for invalid separator in allowed.hosts

2014-07-16 Thread Abhiraj Butala (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhiraj Butala updated HDFS-6455: - Attachment: HDFS-6455.002.patch Thanks [~brandonli], I rebased the patch and addressed the

[jira] [Commented] (HDFS-2639) A client may fail during block recovery even if its request to recover a block succeeds

2014-07-16 Thread chen,di (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063312#comment-14063312 ] chen,di commented on HDFS-2639: --- hi, you guys have fixed this isuue or not ? in which issue

[jira] [Commented] (HDFS-6455) NFS: Exception should be added in NFS log for invalid separator in allowed.hosts

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063317#comment-14063317 ] Hadoop QA commented on HDFS-6455: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6114) Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063341#comment-14063341 ] Hadoop QA commented on HDFS-6114: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6456) NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063364#comment-14063364 ] Hudson commented on HDFS-6456: -- FAILURE: Integrated in Hadoop-Yarn-trunk #614 (See

[jira] [Commented] (HDFS-5809) BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063360#comment-14063360 ] Hudson commented on HDFS-5809: -- FAILURE: Integrated in Hadoop-Yarn-trunk #614 (See

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063377#comment-14063377 ] Hadoop QA commented on HDFS-6247: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-6693: --- Summary: TestDFSAdminWithHA fails on windows Key: HDFS-6693 URL: https://issues.apache.org/jira/browse/HDFS-6693 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6693: Attachment: HDFS-6693.patch Attached the patch. Please review TestDFSAdminWithHA fails on windows

[jira] [Updated] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6693: Status: Patch Available (was: Open) TestDFSAdminWithHA fails on windows

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063403#comment-14063403 ] Uma Maheswara Rao G commented on HDFS-6693: --- +1 pending jenkins

[jira] [Commented] (HDFS-5809) BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063472#comment-14063472 ] Hudson commented on HDFS-5809: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1833 (See

[jira] [Commented] (HDFS-6456) NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063477#comment-14063477 ] Hudson commented on HDFS-6456: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1833 (See

[jira] [Updated] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6422: --- Status: Patch Available (was: In Progress) getfattr in CLI doesn't throw exception or return non-0

[jira] [Commented] (HDFS-5809) BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063501#comment-14063501 ] Hudson commented on HDFS-5809: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1806 (See

[jira] [Commented] (HDFS-6456) NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063506#comment-14063506 ] Hudson commented on HDFS-6456: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1806 (See

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063526#comment-14063526 ] Yongjun Zhang commented on HDFS-6693: - Thanks [~vinayrpet] for the solution. I also

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063534#comment-14063534 ] Hadoop QA commented on HDFS-6693: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063536#comment-14063536 ] Yongjun Zhang commented on HDFS-6693: - The failure I reported in HDFS-6683 is on linux

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063549#comment-14063549 ] Yongjun Zhang commented on HDFS-6693: - Just saw the jenkins test finished, this test

[jira] [Created] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-07-16 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-6694: --- Summary: TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms Key: HDFS-6694 URL: https://issues.apache.org/jira/browse/HDFS-6694

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063592#comment-14063592 ] Yongjun Zhang commented on HDFS-6694: - Listed some selected test failures below, though

[jira] [Commented] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063595#comment-14063595 ] Yongjun Zhang commented on HDFS-6693: - The other test failure

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063603#comment-14063603 ] Yongjun Zhang commented on HDFS-6588: - Filed HDFS-6694 for

[jira] [Updated] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-07-16 Thread Danilo Vunjak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danilo Vunjak updated HDFS-6597: Attachment: HDFS-6597.05.patch Add a new option to NN upgrade to terminate the process after

[jira] [Commented] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-07-16 Thread Danilo Vunjak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063658#comment-14063658 ] Danilo Vunjak commented on HDFS-6597: - Hi [~cnauroth], I did changes as you suggest.

[jira] [Commented] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063682#comment-14063682 ] Hadoop QA commented on HDFS-6422: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5624) Add HDFS tests for ACLs in combination with viewfs.

2014-07-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5624: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063692#comment-14063692 ] Charles Lamb commented on HDFS-6422: The failures appear to be unrelated. I have run

[jira] [Commented] (HDFS-5624) Add HDFS tests for ACLs in combination with viewfs.

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063696#comment-14063696 ] Hudson commented on HDFS-5624: -- FAILURE: Integrated in Hadoop-trunk-Commit #5892 (See

[jira] [Commented] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-07-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063714#comment-14063714 ] Chris Nauroth commented on HDFS-6597: - Thanks, Danilo. This is looking good. Just 2

[jira] [Commented] (HDFS-6655) Add 'header banner' to 'explorer.html' also in Namenode UI

2014-07-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063781#comment-14063781 ] Haohui Mai commented on HDFS-6655: -- Looks good to me. +1 Add 'header banner' to

[jira] [Commented] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063820#comment-14063820 ] Jing Zhao commented on HDFS-6478: - The patch looks pretty good to me. One comment is that

[jira] [Commented] (HDFS-6114) Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063837#comment-14063837 ] Colin Patrick McCabe commented on HDFS-6114: {code} // add new blocks to scan

[jira] [Commented] (HDFS-6689) NFS: can't access file under directory with 711 access right as other user

2014-07-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063843#comment-14063843 ] Jing Zhao commented on HDFS-6689: - +1. Thanks for the fix [~brandonli]! NFS: can't access

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063850#comment-14063850 ] Andrew Wang commented on HDFS-6690: --- Oops, we should wait for Jenkins first :)

[jira] [Updated] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6690: -- Attachment: hdfs-6690.002.patch Okay, switched it out to a Map. Will commit this shortly, thanks

[jira] [Created] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2014-07-16 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-6695: -- Summary: Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts Key: HDFS-6695 URL:

[jira] [Commented] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063879#comment-14063879 ] Colin Patrick McCabe commented on HDFS-6695: There are some docs here:

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6616: -- Status: Patch Available (was: Open) bestNode shouldn't always return the first

[jira] [Commented] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063883#comment-14063883 ] Andrew Wang commented on HDFS-6422: --- Hey Charles, the TestWebHDFSXAttr test failures are

[jira] [Commented] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063889#comment-14063889 ] Hadoop QA commented on HDFS-6597: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063892#comment-14063892 ] Colin Patrick McCabe commented on HDFS-6450: Yeah... if the first read, done

[jira] [Updated] (HDFS-6689) NFS doesn't return correct lookup access for direcories

2014-07-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6689: - Summary: NFS doesn't return correct lookup access for direcories (was: NFS: can't access file under

[jira] [Commented] (HDFS-6689) NFS doesn't return correct lookup access for direcories

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063906#comment-14063906 ] Hudson commented on HDFS-6689: -- FAILURE: Integrated in Hadoop-trunk-Commit #5893 (See

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063913#comment-14063913 ] Colin Patrick McCabe commented on HDFS-6658: bq. What you suggesting (if I

[jira] [Resolved] (HDFS-6405) Test Crypto streams in HDFS

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6405. --- Resolution: Fixed +1 thanks Yi, I committed this to the branch. Test Crypto streams in HDFS

[jira] [Commented] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063934#comment-14063934 ] Andrew Wang commented on HDFS-6546: --- We had a request from Hive for this feature. For a

[jira] [Commented] (HDFS-6509) distcp vs Data At Rest Encryption

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063947#comment-14063947 ] Andrew Wang commented on HDFS-6509: --- Hi Yi, thanks for looking over the doc. Some points

[jira] [Created] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6696: Summary: Name node cannot start if the path of a file under construction contains .snapshot Key: HDFS-6696 URL: https://issues.apache.org/jira/browse/HDFS-6696 Project:

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063972#comment-14063972 ] Colin Patrick McCabe commented on HDFS-6690: Looks good overall. Can we have

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063973#comment-14063973 ] Colin Patrick McCabe commented on HDFS-6588: bq. Rerunning the failed tests

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063977#comment-14063977 ] Andrew Wang commented on HDFS-6696: --- Thanks for finding this Kihwal, lemme take a look.

[jira] [Assigned] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6696: - Assignee: Andrew Wang Name node cannot start if the path of a file under construction contains

[jira] [Updated] (HDFS-6689) NFS doesn't return correct lookup access for directories

2014-07-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6689: - Fix Version/s: 2.6.0 NFS doesn't return correct lookup access for directories

[jira] [Updated] (HDFS-6689) NFS doesn't return correct lookup access for directories

2014-07-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6689: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) NFS

[jira] [Updated] (HDFS-6689) NFS doesn't return correct lookup access for directories

2014-07-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6689: - Summary: NFS doesn't return correct lookup access for directories (was: NFS doesn't return correct

[jira] [Commented] (HDFS-6689) NFS doesn't return correct lookup access for directories

2014-07-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063988#comment-14063988 ] Brandon Li commented on HDFS-6689: -- Thank you, Jing, for the review. I've committed the

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063983#comment-14063983 ] Andrew Wang commented on HDFS-6690: --- I think throwing down FSDirectory lock asserts in

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-07-16 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064095#comment-14064095 ] Nathan Roberts commented on HDFS-6658: -- {quote} I guess my argument is that (in the

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064092#comment-14064092 ] Hadoop QA commented on HDFS-6690: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6422: -- Priority: Blocker (was: Major) I looked into this more with [~clamb] and there's a compatibility

[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064150#comment-14064150 ] Hadoop QA commented on HDFS-6616: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6690: -- Attachment: hdfs-6690.003.patch I chatted with Colin a bit offline, and we agreed that adding some docs

[jira] [Comment Edited] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064180#comment-14064180 ] Kihwal Lee edited comment on HDFS-6696 at 7/16/14 9:56 PM: --- Here

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064180#comment-14064180 ] Kihwal Lee commented on HDFS-6696: -- {panel} java.io.FileNotFoundException: File does not

[jira] [Updated] (HDFS-6693) TestDFSAdminWithHA fails on windows

2014-07-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6693: Component/s: tools test Target Version/s: 3.0.0, 2.5.0 Hadoop

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064206#comment-14064206 ] Andrew Wang commented on HDFS-6696: --- Poking around on JIRA, snapshots were added in

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064219#comment-14064219 ] Colin Patrick McCabe commented on HDFS-6690: +1, assuming jenkins failures are

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-07-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064241#comment-14064241 ] Colin Patrick McCabe commented on HDFS-6658: bq. I'm not totally convinced of

[jira] [Created] (HDFS-6697) Make NN lease soft and hard limits configurable

2014-07-16 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6697: - Summary: Make NN lease soft and hard limits configurable Key: HDFS-6697 URL: https://issues.apache.org/jira/browse/HDFS-6697 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6422: --- Attachment: HDFS-6422.005.patch I'm submitting this .005 patch for a jenkins run. Some notes: This

[jira] [Updated] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6478: -- Attachment: HDFS-6478-4.patch Thanks, Jing. The updated patch removed

[jira] [Commented] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2014-07-16 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064291#comment-14064291 ] Andrew Purtell commented on HDFS-6695: -- bq. If it uses the underlying asynchronous

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064331#comment-14064331 ] Andrew Wang commented on HDFS-6696: --- Hey [~kihwal], what Hadoop version were you starting

[jira] [Updated] (HDFS-2538) option to disable fsck dots

2014-07-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2538: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thank your for

[jira] [Updated] (HDFS-2538) option to disable fsck dots

2014-07-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2538: --- Fix Version/s: 3.0.0 option to disable fsck dots

[jira] [Assigned] (HDFS-6683) TestDFSAdminWithHA.testSaveNamespace failed with Timed out waiting for Mini HDFS Cluster to start

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-6683: --- Assignee: Yongjun Zhang TestDFSAdminWithHA.testSaveNamespace failed with Timed out waiting

[jira] [Resolved] (HDFS-6683) TestDFSAdminWithHA.testSaveNamespace failed with Timed out waiting for Mini HDFS Cluster to start

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-6683. - Resolution: Duplicate TestDFSAdminWithHA.testSaveNamespace failed with Timed out waiting for

[jira] [Commented] (HDFS-2538) option to disable fsck dots

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064398#comment-14064398 ] Hudson commented on HDFS-2538: -- FAILURE: Integrated in Hadoop-trunk-Commit #5895 (See

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064403#comment-14064403 ] Hadoop QA commented on HDFS-6690: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6626) Node is marked decommissioned if it becomes dead when it is being decommissioned

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064408#comment-14064408 ] Andrew Wang commented on HDFS-6626: --- Hi Ming, I think the main goal of decommissioning

[jira] [Updated] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6690: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-07-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064426#comment-14064426 ] Yongjun Zhang commented on HDFS-6588: - Thanks [~cmccabe]. In the same comment I

[jira] [Commented] (HDFS-6690) Deduplicate xattr names in memory

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064436#comment-14064436 ] Hudson commented on HDFS-6690: -- FAILURE: Integrated in Hadoop-trunk-Commit #5896 (See

[jira] [Commented] (HDFS-6509) distcp vs Data At Rest Encryption

2014-07-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064447#comment-14064447 ] Yi Liu commented on HDFS-6509: -- Thanks [~andrew.wang] for clarification, that makes sense to

[jira] [Commented] (HDFS-6422) getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064463#comment-14064463 ] Hadoop QA commented on HDFS-6422: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6114) Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr

2014-07-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6114: Attachment: HDFS-6114.patch Updated patch with above comments. Please review Block Scan log

  1   2   >