[jira] [Commented] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118004#comment-14118004 ] Yi Liu commented on HDFS-6886: -- TestOfflineEditsViewer is successful with {{editsStored}}, oth

[jira] [Commented] (HDFS-6980) TestWebHdfsFileSystemContract fails in trunk

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118028#comment-14118028 ] Hadoop QA commented on HDFS-6980: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2014-09-02 Thread LINTE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118080#comment-14118080 ] LINTE commented on HDFS-6962: - Any update on this issue ? > ACLs inheritance conflict with uma

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118149#comment-14118149 ] Yi Liu commented on HDFS-6951: -- Thanks [~clamb], looks good to me, just one comment: yes, thi

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118156#comment-14118156 ] Yi Liu commented on HDFS-6705: -- Hi [~clamb] and [~andrew.wang], could this xattr be something

[jira] [Assigned] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-09-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reassigned HDFS-2975: - Assignee: Uma Maheswara Rao G (was: Yi Liu) > Rename with overwrite flag true can

[jira] [Commented] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-09-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118283#comment-14118283 ] Uma Maheswara Rao G commented on HDFS-2975: --- Yi, Thanks a lot for the explanatio

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6951: --- Attachment: HDFS-6951.004.patch [~hitliuyi], [~andrew.wang], The .004 patch adds an unprotectedAddEncr

[jira] [Commented] (HDFS-6867) For DFSOutputStream, do pipeline recovery for a single block in the background

2014-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118352#comment-14118352 ] Zhe Zhang commented on HDFS-6867: - [~cmccabe] Could you help review the patch? In the patch

[jira] [Updated] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-09-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2975: -- Assignee: Yi Liu (was: Uma Maheswara Rao G) > Rename with overwrite flag true can make N

[jira] [Commented] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

2014-09-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118393#comment-14118393 ] Yongjun Zhang commented on HDFS-4257: - Hi [~szetszwo], thanks for the rev, it looks goo

[jira] [Commented] (HDFS-5114) getMaxNodesPerRack() in BlockPlacementPolicyDefault does not take decommissioning nodes into account.

2014-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118394#comment-14118394 ] Zhe Zhang commented on HDFS-5114: - [~kihwal] Since this was created a year ago, do you happ

[jira] [Commented] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-09-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118413#comment-14118413 ] Vinayakumar B commented on HDFS-2975: - Thanks a lot for the patch [~hitliuyi], +1 from

[jira] [Commented] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118432#comment-14118432 ] Vinayakumar B commented on HDFS-6886: - bq. this.overwrite = Boolean.parseBoolean(

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6831: Assignee: Xiaoyu Yao > Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help' >

[jira] [Updated] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6848: Assignee: Xiaoyu Yao > Lack of synchronization on access to datanodeUuid in DataStorage#format() > -

[jira] [Updated] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated HDFS-6942: - Attachment: HDFS-6942-02.patch Adding fix from [~ajisakaa]. Thanks for finding it. > Fix typos in log mes

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118488#comment-14118488 ] Hadoop QA commented on HDFS-6951: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6954) With crypto, no native lib systems are too verbose

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118489#comment-14118489 ] Hadoop QA commented on HDFS-6954: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6831: Assignee: Xiaoyu Yao (was: Xiaoyu Yao) > Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -h

[jira] [Updated] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6848: Assignee: Xiaoyu Yao (was: Xiaoyu Yao) > Lack of synchronization on access to datanodeUuid in DataSt

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118513#comment-14118513 ] Colin Patrick McCabe commented on HDFS-6482: Yeah, it would be great to have th

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118554#comment-14118554 ] Arpit Agarwal commented on HDFS-6482: - That is the known issue, yes. > Use block ID-ba

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118615#comment-14118615 ] Hadoop QA commented on HDFS-6942: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118657#comment-14118657 ] Colin Patrick McCabe commented on HDFS-6930: bq. Eviction is done when we have

[jira] [Commented] (HDFS-6974) MiniHDFScluster breaks if there is an out of date hadoop.lib on the lib path

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118668#comment-14118668 ] Colin Patrick McCabe commented on HDFS-6974: Is this really any different than

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118670#comment-14118670 ] Ray Chiang commented on HDFS-6942: -- RE: TestRenameWithSnapshots test. Works fine in my tr

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6951: --- Attachment: (was: HDFS-6951.004.patch) > Saving namespace and restarting NameNode will remove exist

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6951: --- Attachment: HDFS-6951.004.patch Resubmitting the exact same HDFS-6951.004.patch to see if the weird tes

[jira] [Created] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-02 Thread Maysam Yabandeh (JIRA)
Maysam Yabandeh created HDFS-6982: - Summary: nntop: top­-like tool for name node users Key: HDFS-6982 URL: https://issues.apache.org/jira/browse/HDFS-6982 Project: Hadoop HDFS Issue Type: New

[jira] [Updated] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-02 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maysam Yabandeh updated HDFS-6982: -- Attachment: nntop-design-v1.pdf A design doc that also shows how the tool looks like in action is

[jira] [Created] (HDFS-6983) TestBalancer#testExitZeroOnSuccess fails intermittently

2014-09-02 Thread Mit Desai (JIRA)
Mit Desai created HDFS-6983: --- Summary: TestBalancer#testExitZeroOnSuccess fails intermittently Key: HDFS-6983 URL: https://issues.apache.org/jira/browse/HDFS-6983 Project: Hadoop HDFS Issue Type: B

[jira] [Created] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2014-09-02 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-6984: -- Summary: In Hadoop 3, make FileStatus no longer a Writable Key: HDFS-6984 URL: https://issues.apache.org/jira/browse/HDFS-6984 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6634) inotify in HDFS

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6634: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Committ

[jira] [Updated] (HDFS-6954) With crypto, no native lib systems are too verbose

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6954: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Committ

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6984: --- Status: Patch Available (was: Open) > In Hadoop 3, make FileStatus no longer a Writabl

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6984: --- Attachment: HDFS-6984.001.patch > In Hadoop 3, make FileStatus no longer a Writable > -

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118784#comment-14118784 ] Colin Patrick McCabe commented on HDFS-6984: I don't anticipate any maintenance

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-02 Thread Philip Zeyliger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118786#comment-14118786 ] Philip Zeyliger commented on HDFS-6982: --- Looks neat! Since you're proposing this for

[jira] [Commented] (HDFS-6921) Add LazyPersist flag to FileStatus

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118798#comment-14118798 ] Colin Patrick McCabe commented on HDFS-6921: Interesting discussion. I don't t

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus no longer a Writable

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118807#comment-14118807 ] Hadoop QA commented on HDFS-6984: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118813#comment-14118813 ] Colin Patrick McCabe commented on HDFS-6634: Great work, James! > inotify in H

[jira] [Commented] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118827#comment-14118827 ] Colin Patrick McCabe commented on HDFS-4257: Yongjun, I'm going to file a follo

[jira] [Created] (HDFS-6985) Add final keywords, documentation, etc. to ReplaceDatanodeOnFailure

2014-09-02 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-6985: -- Summary: Add final keywords, documentation, etc. to ReplaceDatanodeOnFailure Key: HDFS-6985 URL: https://issues.apache.org/jira/browse/HDFS-6985 Project:

[jira] [Updated] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4257: --- Resolution: Fixed Fix Version/s: 2.6.0 Target Version/s: 2.6.0

[jira] [Created] (HDFS-6986) DistributedFileSystem must get deletagiontokens from configured KeyProvider

2014-09-02 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HDFS-6986: Summary: DistributedFileSystem must get deletagiontokens from configured KeyProvider Key: HDFS-6986 URL: https://issues.apache.org/jira/browse/HDFS-6986 Proje

[jira] [Created] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-02 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6987: - Summary: Move CipherSuite xattr information up to the encryption zone root Key: HDFS-6987 URL: https://issues.apache.org/jira/browse/HDFS-6987 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6986) DistributedFileSystem must get delegation tokens from configured KeyProvider

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6986: -- Summary: DistributedFileSystem must get delegation tokens from configured KeyProvider (was: DistributedF

[jira] [Assigned] (HDFS-6971) Bounded staleness of EDEK caches on the NN

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6971: - Assignee: Zhe Zhang (was: Andrew Wang) > Bounded staleness of EDEK caches on the NN > ---

[jira] [Updated] (HDFS-6986) DistributedFileSystem must get delegation tokens from configured KeyProvider

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6986: -- Assignee: Zhe Zhang > DistributedFileSystem must get delegation tokens from configured KeyProvider >

[jira] [Commented] (HDFS-6987) Move CipherSuite xattr information up to the encryption zone root

2014-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118884#comment-14118884 ] Andrew Wang commented on HDFS-6987: --- It'd be good to also protobuf the EZ root xattr as p

[jira] [Updated] (HDFS-6985) Add final keywords, documentation, etc. to ReplaceDatanodeOnFailure

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6985: --- Description: * use final qualifier and variable names consistently in {{ReplaceDatanod

[jira] [Updated] (HDFS-6985) Add final keywords, documentation, etc. to ReplaceDatanodeOnFailure

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6985: --- Attachment: HDFS-6985.001.patch I changed it so that all implementations of {{ReplaceD

[jira] [Commented] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118895#comment-14118895 ] Colin Patrick McCabe commented on HDFS-4257: Yongjun, check out HDFS-6985 where

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118897#comment-14118897 ] Haohui Mai commented on HDFS-6942: -- +1. I'll commit it shortly. > Fix typos in log messag

[jira] [Commented] (HDFS-6986) DistributedFileSystem must get delegation tokens from configured KeyProvider

2014-09-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118902#comment-14118902 ] Alejandro Abdelnur commented on HDFS-6986: -- The changes in {{DistributedFileSystem

[jira] [Commented] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118915#comment-14118915 ] Jing Zhao commented on HDFS-6886: - The patch looks pretty good to me. Besides the comment f

[jira] [Commented] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118932#comment-14118932 ] Xiaoyu Yao commented on HDFS-6930: -- +1 Can you check if capacity > 0? It can be 0 when th

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118936#comment-14118936 ] Hadoop QA commented on HDFS-6951: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6977) Delete all copies when a block is deleted from the block space

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6977: Attachment: HDFS-6977.02.patch Slight update to remove one call to {{Block.metaToBlockFile}}. > Dele

[jira] [Updated] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6942: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-4257) The ReplaceDatanodeOnFailure policies could have a forgiving option

2014-09-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118949#comment-14118949 ] Yongjun Zhang commented on HDFS-4257: - Thanks Colin, for reviewing and following-up. H

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118963#comment-14118963 ] Colin Patrick McCabe commented on HDFS-6956: daemonlog is about log4j, this is

[jira] [Commented] (HDFS-6982) nntop: top­-like tool for name node users

2014-09-02 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118971#comment-14118971 ] Maysam Yabandeh commented on HDFS-6982: --- Thanks [~philip]. I agree with you. I actual

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-09-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118996#comment-14118996 ] Ray Chiang commented on HDFS-6942: -- Thanks for the commit! Glad to get this first batch o

[jira] [Updated] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-02 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6966: -- Attachment: HDFS-6966.2.patch Adding new patch with more tests. In the most recent patch we: * Add HA t

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6705: --- Attachment: HDFS-6705.002.patch Submitting for a test run. > Create an XAttr that disallows the HDFS

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119015#comment-14119015 ] Charles Lamb commented on HDFS-6951: org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemCo

[jira] [Commented] (HDFS-6959) make user home directory customizable

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119033#comment-14119033 ] Colin Patrick McCabe commented on HDFS-6959: bq. In that case, would you please

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119041#comment-14119041 ] Colin Patrick McCabe commented on HDFS-6658: I didn't realize the patches were

[jira] [Commented] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119097#comment-14119097 ] Yi Liu commented on HDFS-6951: -- Thanks [~clamb], It's OK for me. +1 (non-binding). > Saving

[jira] [Commented] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119105#comment-14119105 ] Yi Liu commented on HDFS-6886: -- Thanks [~vinayrpet] and [~jingzhao] for review, I will update

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-09-02 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119104#comment-14119104 ] James Thomas commented on HDFS-6634: Thanks guys > inotify in HDFS > --- >

[jira] [Commented] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119111#comment-14119111 ] Yi Liu commented on HDFS-2975: -- Thanks [~umamaheswararao] and [~vinayrpet] for the review. >

[jira] [Commented] (HDFS-6036) Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119140#comment-14119140 ] Colin Patrick McCabe commented on HDFS-6036: bq. The slf4j style uses {} as a t

[jira] [Updated] (HDFS-6036) Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long

2014-09-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6036: --- Attachment: HDFS-6036.002.patch > Forcibly timeout misbehaving DFSClients that try to d

[jira] [Updated] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6886: - Attachment: (was: editsStored) > Use single editlog record for creating file + overwrite. > ---

[jira] [Updated] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-09-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6886: - Attachment: editsStored HDFS-6886.004.patch [~vinayrpet] and [~jingzhao], I update the patch for al

[jira] [Commented] (HDFS-6036) Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119203#comment-14119203 ] Hadoop QA commented on HDFS-6036: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119202#comment-14119202 ] Hadoop QA commented on HDFS-6966: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6966) Add additional unit tests for encryption zones

2014-09-02 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119216#comment-14119216 ] Stephen Chu commented on HDFS-6966: --- TestPipelinesFailover is unrelated to this patch. >

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119232#comment-14119232 ] Hadoop QA commented on HDFS-6705: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Work started] (HDFS-6981) DN upgrade with layout version change should not use trash

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6981 started by Arpit Agarwal. --- > DN upgrade with layout version change should not use trash > -

[jira] [Assigned] (HDFS-6981) DN upgrade with layout version change should not use trash

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6981: --- Assignee: Arpit Agarwal > DN upgrade with layout version change should not use trash > ---

[jira] [Created] (HDFS-6988) Make RAM disk eviction thresholds configurable

2014-09-02 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6988: --- Summary: Make RAM disk eviction thresholds configurable Key: HDFS-6988 URL: https://issues.apache.org/jira/browse/HDFS-6988 Project: Hadoop HDFS Issue Type: Su

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: HDFS-6930.02.patch Thanks for the reviews. Colin, I filed HDFS-6988 to make the threshol

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Attachment: (was: HDFS-6930.02.patch) > Add Additional unit tests for HDFS-6581 > ---

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Attachment: HDFS-6930.02.patch > Add Additional unit tests for HDFS-6581 > --

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Attachment: (was: HDFS-6950.1.patch) > Add Additional unit tests for HDFS-6581 >

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: (was: HDFS-6930.02.patch) > Improve replica eviction from RAM disk >

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: (was: HDFS-6930.02.patch) > Improve replica eviction from RAM disk >

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: HDFS-6930.02.patch > Improve replica eviction from RAM disk > ---

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Attachment: HDFS-6950.1.patch Reattaching patch I deleted mistakenly. Sorry about that. > Add Additi

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: (was: HDFS-6950.1.patch) > Improve replica eviction from RAM disk > -

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: HDFS-6950.1.patch > Improve replica eviction from RAM disk >

[jira] [Updated] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6930: Attachment: HDFS-6930.02.patch > Improve replica eviction from RAM disk > ---

[jira] [Assigned] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-6950: Assignee: Xiaoyu Yao (was: Xiaoyu Yao) > Add Additional unit tests for HDFS-6581 >

[jira] [Work started] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6950 started by Xiaoyu Yao. > Add Additional unit tests for HDFS-6581 > --- > >

[jira] [Commented] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119338#comment-14119338 ] Arpit Agarwal commented on HDFS-6950: - Thanks for adding these test cases [~xyao]! Few

[jira] [Updated] (HDFS-6959) make user home directory customizable

2014-09-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6959: Attachment: HDFS-6959.001.patch > make user home directory customizable > ---

  1   2   >