[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103523#comment-14103523 ] Jing Zhao commented on HDFS-3689: - Thanks for the comments, [~cutting]! Do you think it is

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103527#comment-14103527 ] Uma Maheswara Rao G commented on HDFS-6871: --- Nice catch Yi! Thanks a lot for wor

[jira] [Updated] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.001.patch Update the patch a little bit to demonstrate #3: the support in DFSOutputStr

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103543#comment-14103543 ] Vinayakumar B commented on HDFS-6871: - [~umamaheswararao] and me discussed. This could

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-20 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103557#comment-14103557 ] Zesheng Wu commented on HDFS-6827: -- I gone through your patch of HADOOP-10251. {code} priv

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103571#comment-14103571 ] Yi Liu commented on HDFS-6871: -- Thanks [~umamaheswararao] and [~vinayrpet], I get your point.

[jira] [Commented] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103573#comment-14103573 ] Hadoop QA commented on HDFS-6878: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103581#comment-14103581 ] Hadoop QA commented on HDFS-6134: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6871: - Attachment: HDFS-6871.003.patch The new patch extracts {{removeBlocks(…)}} outside the lock and after the logSync

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103599#comment-14103599 ] Vinayakumar B commented on HDFS-6870: - patch looks good. +1 > Blocks and INodes could

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103621#comment-14103621 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6885) Fix wrong use of BytesWritable in FSEditLogOp#RenameOp

2014-08-20 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6885: Summary: Fix wrong use of BytesWritable in FSEditLogOp#RenameOp Key: HDFS-6885 URL: https://issues.apache.org/jira/browse/HDFS-6885 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6885) Fix wrong use of BytesWritable in FSEditLogOp#RenameOp

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6885: - Description: After readField using BytesWritable, the data length should be {{writable.getLength()}}, instead of

[jira] [Updated] (HDFS-6885) Fix wrong use of BytesWritable in FSEditLogOp#RenameOp

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6885: - Status: Patch Available (was: Open) > Fix wrong use of BytesWritable in FSEditLogOp#RenameOp > --

[jira] [Updated] (HDFS-6885) Fix wrong use of BytesWritable in FSEditLogOp#RenameOp

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6885: - Attachment: HDFS-6885.001.patch > Fix wrong use of BytesWritable in FSEditLogOp#RenameOp > ---

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103633#comment-14103633 ] Yi Liu commented on HDFS-6870: -- Thanks [~vinayrpet] for review. It seems there is some issue o

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103640#comment-14103640 ] Vinayakumar B commented on HDFS-6870: - I have just triggered jenkins. Please wait somet

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-08-20 Thread Nie Gus (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103647#comment-14103647 ] Nie Gus commented on HDFS-6293: --- Here is one user case to process OIV output, we export the f

[jira] [Updated] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-08-20 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated HDFS-6833: - Attachment: HDFS-6833-6-2.patch Hi [~yzhangal], Thank you for your comment. I think that

[jira] [Commented] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103703#comment-14103703 ] Hadoop QA commented on HDFS-6832: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103743#comment-14103743 ] Hadoop QA commented on HDFS-6871: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6886) Use single editlog record for creating file + overwrite.

2014-08-20 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6886: Summary: Use single editlog record for creating file + overwrite. Key: HDFS-6886 URL: https://issues.apache.org/jira/browse/HDFS-6886 Project: Hadoop HDFS Issue Type: Improv

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-08-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103861#comment-14103861 ] Kihwal Lee commented on HDFS-6293: -- [~fnie] Please see the release note. This is availabl

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103909#comment-14103909 ] Kihwal Lee commented on HDFS-3689: -- We also need to think about file checksum. I think we

[jira] [Commented] (HDFS-6868) portmap and nfs3 are documented as hadoop commands instead of hdfs

2014-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103913#comment-14103913 ] Hudson commented on HDFS-6868: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #652 (See [https://b

[jira] [Created] (HDFS-6887) beeter performance

2014-08-20 Thread ilovehadoop (JIRA)
ilovehadoop created HDFS-6887: - Summary: beeter performance Key: HDFS-6887 URL: https://issues.apache.org/jira/browse/HDFS-6887 Project: Hadoop HDFS Issue Type: Wish Components: qjm

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103930#comment-14103930 ] Andrey Stepachev commented on HDFS-3689: May it is more convent to implement sparse

[jira] [Updated] (HDFS-6779) [post-HADOOP-9902] hdfs version subcommand is missing

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6779: --- Component/s: scripts > [post-HADOOP-9902] hdfs version subcommand is missing > ---

[jira] [Commented] (HDFS-6887) beeter performance

2014-08-20 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103971#comment-14103971 ] Chen He commented on HDFS-6887: --- Hi [~ilovehadoop], I am not sure why you open this JIRA and

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103984#comment-14103984 ] Daryn Sharp commented on HDFS-6871: --- My only concern which I don't have cycles to investi

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104004#comment-14104004 ] Hadoop QA commented on HDFS-6870: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6888) Remove audit logging of getFIleInfo()

2014-08-20 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6888: Summary: Remove audit logging of getFIleInfo() Key: HDFS-6888 URL: https://issues.apache.org/jira/browse/HDFS-6888 Project: Hadoop HDFS Issue Type: Bug R

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104114#comment-14104114 ] Hadoop QA commented on HDFS-6871: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5151) Add test case for commitBlockSynchronization with invalid Storage

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5151: Assignee: (was: Arpit Agarwal) > Add test case for commitBlockSynchronization with invalid Stora

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Attachment: HDFS-6758.02.patch Good idea Nicholas. It simplifies the patch quite a bit. Updated patc

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFS-6826v6.patch uploading v6 patch: * add snapshot lifecycle methods and wi

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-08-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104191#comment-14104191 ] Hadoop QA commented on HDFS-6833: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104215#comment-14104215 ] Arpit Agarwal commented on HDFS-6878: - So additional DNs with different storage configu

[jira] [Updated] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6878: Attachment: HDFS-6878.02.patch > Change MiniDFSCluster to support StorageType configuration for indi

[jira] [Commented] (HDFS-6868) portmap and nfs3 are documented as hadoop commands instead of hdfs

2014-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104223#comment-14104223 ] Hudson commented on HDFS-6868: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1843 (See [https://

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104228#comment-14104228 ] Jing Zhao commented on HDFS-6870: - Thanks for the fix, [~hitliuyi]! +1. I will commit it sh

[jira] [Created] (HDFS-6889) Provide an iterator-based listing API for FileSystem

2014-08-20 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6889: Summary: Provide an iterator-based listing API for FileSystem Key: HDFS-6889 URL: https://issues.apache.org/jira/browse/HDFS-6889 Project: Hadoop HDFS Issue Type: Im

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104243#comment-14104243 ] Todd Lipcon commented on HDFS-3689: --- Nice idea, Andrey. Jing, can you explain more what t

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-20 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104268#comment-14104268 ] Giridharan Kesavan commented on HDFS-6694: -- [~yzhangal] {noformat} jenkins@asf904:

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104266#comment-14104266 ] Andrew Wang commented on HDFS-6134: --- These tests all passed locally for me, so I'm going

[jira] [Updated] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6870: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-6878) Change MiniDFSCluster to support StorageType configuration for individual directories

2014-08-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6878: Attachment: HDFS-6878.03.patch Add builder.setStorageTypes overload to take 2D array also. > Change

[jira] [Commented] (HDFS-5135) Umbrella JIRA for NFS end to end unit test frameworks

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104281#comment-14104281 ] Brandon Li commented on HDFS-5135: -- [~zhz], sorry for the late reply. For option1, we don'

[jira] [Created] (HDFS-6890) NFS readdirplus doesn't return dotdot attributes

2014-08-20 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6890: Summary: NFS readdirplus doesn't return dotdot attributes Key: HDFS-6890 URL: https://issues.apache.org/jira/browse/HDFS-6890 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6872) Fix TestOptionsParser

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6872: -- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-6134) > Fix TestOptionsParser >

[jira] [Commented] (HDFS-6870) Blocks and INodes could leak for Rename with overwrite flag

2014-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104328#comment-14104328 ] Hudson commented on HDFS-6870: -- FAILURE: Integrated in Hadoop-trunk-Commit #6089 (See [https:

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104330#comment-14104330 ] Hudson commented on HDFS-6134: -- FAILURE: Integrated in Hadoop-trunk-Commit #6089 (See [https:

[jira] [Assigned] (HDFS-6890) NFS readdirplus doesn't return dotdot attributes

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-6890: Assignee: Brandon Li > NFS readdirplus doesn't return dotdot attributes > --

[jira] [Updated] (HDFS-6890) NFS readdirplus doesn't return dotdot attributes

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6890: - Attachment: HDFS-6890.001.patch > NFS readdirplus doesn't return dotdot attributes > -

[jira] [Updated] (HDFS-6890) NFS readdirplus doesn't return dotdot attributes

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6890: - Status: Patch Available (was: Open) > NFS readdirplus doesn't return dotdot attributes >

[jira] [Created] (HDFS-6891) Follow-on work for transparent data at rest encryption

2014-08-20 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6891: - Summary: Follow-on work for transparent data at rest encryption Key: HDFS-6891 URL: https://issues.apache.org/jira/browse/HDFS-6891 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6851: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Flush EncryptionZoneWithId and add an id field to Encryption

[jira] [Updated] (HDFS-6843) Create FSDataInputStream & FSDataOutputStream isEncrypted() method

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6843: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Create FSDataInputStream & FSDataOutputStream isEncrypted()

[jira] [Updated] (HDFS-6824) Additional user documentation for HDFS encryption.

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6824: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Additional user documentation for HDFS encryption. > ---

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6705: -- Target Version/s: (was: fs-encryption (HADOOP-10150 and HDFS-6134)) > Create an XAttr that disallows t

[jira] [Updated] (HDFS-6668) Add and expose KeyProvider-related metrics on NameNode

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6668: -- Affects Version/s: (was: fs-encryption (HADOOP-10150 and HDFS-6134)) 3.0.0 >

[jira] [Updated] (HDFS-6668) Add and expose KeyProvider-related metrics on NameNode

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6668: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Add and expose KeyProvider-related metrics on NameNode > ---

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6705: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Create an XAttr that disallows the HDFS admin from accessing

[jira] [Updated] (HDFS-6815) Verify that alternate access methods work properly with Data at Rest Encryption

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6815: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Verify that alternate access methods work properly with Data

[jira] [Updated] (HDFS-6668) Add and expose KeyProvider-related metrics on NameNode

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6668: -- Target Version/s: (was: fs-encryption (HADOOP-10150 and HDFS-6134)) > Add and expose KeyProvider-relat

[jira] [Updated] (HDFS-6815) Verify that alternate access methods work properly with Data at Rest Encryption

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6815: -- Affects Version/s: (was: fs-encryption (HADOOP-10150 and HDFS-6134)) 3.0.0 >

[jira] [Updated] (HDFS-6555) Specify file encryption attributes at create time

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6555: -- Parent Issue: HDFS-6891 (was: HDFS-6134) > Specify file encryption attributes at create time >

[jira] [Updated] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6705: -- Affects Version/s: 3.0.0 > Create an XAttr that disallows the HDFS admin from accessing a file > ---

[jira] [Updated] (HDFS-6555) Specify file encryption attributes at create time

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6555: -- Affects Version/s: (was: fs-encryption (HADOOP-10150 and HDFS-6134)) 3.0.0 >

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

2014-08-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6134: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) I've m

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104363#comment-14104363 ] Doug Cutting commented on HDFS-3689: +1 for sparse files. They could provide the same

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104400#comment-14104400 ] Andrey Stepachev commented on HDFS-3689: [~cutting] I mentioned flag just as one of

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104402#comment-14104402 ] Suresh Srinivas commented on HDFS-3689: --- [~cutting], the applications still need to b

[jira] [Created] (HDFS-6892) Add XDR packaging method for each NFS/Mount request

2014-08-20 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6892: Summary: Add XDR packaging method for each NFS/Mount request Key: HDFS-6892 URL: https://issues.apache.org/jira/browse/HDFS-6892 Project: Hadoop HDFS Issue Type: Sub

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104411#comment-14104411 ] Jing Zhao commented on HDFS-3689: - The sparse file idea sounds good to me. Let me see if I

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Labels: encr (was: ) > crypto subcommand is not sorted properly in hdfs's hadoop_usage >

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Labels: (was: encr) > crypto subcommand is not sorted properly in hdfs's hadoop_usage >

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Component/s: scripts > crypto subcommand is not sorted properly in hdfs's hadoop_usage > -

[jira] [Created] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-6893: -- Summary: crypto subcommand is not sorted properly in hdfs's hadoop_usage Key: HDFS-6893 URL: https://issues.apache.org/jira/browse/HDFS-6893 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Description: crypto subcommand should be after classpath/before datanode, not after zkfc, in t

[jira] [Updated] (HDFS-6892) Add XDR packaging method for each NFS/Mount request

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6892: - Description: The method can be used for unit tests. Most request implements this by overriding RequestWith

[jira] [Created] (HDFS-6895) Add XDR parser method for each Mount response

2014-08-20 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6895: Summary: Add XDR parser method for each Mount response Key: HDFS-6895 URL: https://issues.apache.org/jira/browse/HDFS-6895 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Summary: Add XDR parser method for each NFS response (was: Add XDR parser method for each NFS/Mount respo

[jira] [Created] (HDFS-6894) Add XDR parser method for each NFS/Mount response

2014-08-20 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6894: Summary: Add XDR parser method for each NFS/Mount response Key: HDFS-6894 URL: https://issues.apache.org/jira/browse/HDFS-6894 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Created] (HDFS-6896) Add XDR packaging method for each Mount request

2014-08-20 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6896: Summary: Add XDR packaging method for each Mount request Key: HDFS-6896 URL: https://issues.apache.org/jira/browse/HDFS-6896 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Updated] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6892: - Description: The method can be used for unit tests. Most request implements this by overriding RequestWith

[jira] [Updated] (HDFS-6896) Add XDR packaging method for each Mount request

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6896: - Description: Need utility to create MNT requests. > Add XDR packaging method for each Mount request >

[jira] [Updated] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6892: - Summary: Add XDR packaging method for each NFS request (was: Add XDR packaging method for each NFS/Mount

[jira] [Updated] (HDFS-6893) crypto subcommand is not sorted properly in hdfs's hadoop_usage

2014-08-20 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6893: --- Labels: newbie (was: ) > crypto subcommand is not sorted properly in hdfs's hadoop_usage > --

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104458#comment-14104458 ] Colin Patrick McCabe commented on HDFS-6871: OK, so if I understand [~daryn] an

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104472#comment-14104472 ] Gopal V commented on HDFS-3689: --- The sparse file idea was thrown around a while back, jokingl

[jira] [Resolved] (HDFS-3988) HttpFS can't do GETDELEGATIONTOKEN without a prior authenticated request

2014-08-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved HDFS-3988. -- Resolution: Done HADOOP-10771 took care of this. > HttpFS can't do GETDELEGATIONTOKEN w

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104482#comment-14104482 ] Suresh Srinivas commented on HDFS-3689: --- I also like the idea of sparse files. But I

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104501#comment-14104501 ] Yongjun Zhang commented on HDFS-6694: - Thanks [~gkesavan], but my bad, I intended to sa

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104506#comment-14104506 ] Jing Zhao commented on HDFS-3689: - Another question with the sparse file is that when we co

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-20 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104514#comment-14104514 ] Giridharan Kesavan commented on HDFS-6694: -- {noformat} jenkins@asf904:~$ ulimit -a

[jira] [Updated] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-08-20 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6799: --- Assignee: mehdi amini (was: Benoy Antony) > The invalidate method in SimulatedFSDataset.java failed t

[jira] [Updated] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-08-20 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6799: --- Assignee: Benoy Antony > The invalidate method in SimulatedFSDataset.java failed to remove > (invalid

[jira] [Updated] (HDFS-6799) The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.

2014-08-20 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6799: --- Assignee: (was: mehdi amini) > The invalidate method in SimulatedFSDataset.java failed to remove

[jira] [Commented] (HDFS-6871) Improve NameNode performance when creating file

2014-08-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104523#comment-14104523 ] Jing Zhao commented on HDFS-6871: - bq. If we're going to deal with this case correctly, is

  1   2   >