[jira] [Updated] (HDFS-6865) Byte array native checksumming on client side (HDFS changes)

2014-08-26 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6865: --- Attachment: HDFS-6865.6.patch [~tlipcon], thanks for the review. Made all of your suggested changes ex

[jira] [Commented] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111930#comment-14111930 ] Jing Zhao commented on HDFS-6944: - Actually it will be better to move the retry logic out f

[jira] [Commented] (HDFS-6945) ExcessBlocks metric may not be decremented if there are no over replicated blocks

2014-08-26 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111920#comment-14111920 ] Akira AJISAKA commented on HDFS-6945: - I propose to add the function to remove the bloc

[jira] [Commented] (HDFS-6945) ExcessBlocks metric may not be decremented if there are no over replicated blocks

2014-08-26 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111913#comment-14111913 ] Akira AJISAKA commented on HDFS-6945: - The number of excess blocks is incremented but n

[jira] [Updated] (HDFS-6779) hdfs version subcommand is missing

2014-08-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6779: --- Summary: hdfs version subcommand is missing (was: [post-HADOOP-9902] hdfs version subcommand

[jira] [Commented] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111795#comment-14111795 ] Jing Zhao commented on HDFS-6944: - The patch depends on HDFS-6899 (to be merged from trunk)

[jira] [Updated] (HDFS-6944) Archival Storage: add a test framework for testing different migration scenarios

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6944: Attachment: HDFS-6944.001.patch Update the patch: # Now for a pendingMove, a target may be scheduled to the

[jira] [Commented] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111766#comment-14111766 ] Hadoop QA commented on HDFS-6727: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Assigned] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reassigned HDFS-6951: -- Assignee: Charles Lamb > Saving namespace and restarting NameNode will remove existing encryptio

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6951: -- Description: Currently, when users save namespace and restart the NameNode, pre-existing encryption zon

[jira] [Created] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-6951: - Summary: Saving namespace and restarting NameNode will remove existing encryption zones Key: HDFS-6951 URL: https://issues.apache.org/jira/browse/HDFS-6951 Project: Hadoop

[jira] [Updated] (HDFS-6951) Saving namespace and restarting NameNode will remove existing encryption zones

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6951: -- Attachment: HDFS-6951-testrepo.patch > Saving namespace and restarting NameNode will remove existing enc

[jira] [Commented] (HDFS-6705) Create an XAttr that disallows the HDFS admin from accessing a file

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111707#comment-14111707 ] Yi Liu commented on HDFS-6705: -- if the super user is the owner, then it can't access the file?

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-08-26 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111655#comment-14111655 ] Sanjay Radia commented on HDFS-6469: My thoughts: * I do believe that Paxos based NN wo

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111653#comment-14111653 ] Hadoop QA commented on HDFS-6808: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111637#comment-14111637 ] Jing Zhao commented on HDFS-6911: - +1 for the latest patch. > Archival Storage: check if a

[jira] [Commented] (HDFS-6634) inotify in HDFS

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111634#comment-14111634 ] Colin Patrick McCabe commented on HDFS-6634: The new design doc looks really go

[jira] [Commented] (HDFS-6920) Archival Storage: check the storage type of delNodeHintStorage when deleting a replica

2014-08-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111612#comment-14111612 ] Jing Zhao commented on HDFS-6920: - The patch looks good to me. +1 Can we also have a unit

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111578#comment-14111578 ] Alejandro Abdelnur commented on HDFS-6776: -- IMO, enabling to work with an unpatche

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111571#comment-14111571 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

2014-08-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111564#comment-14111564 ] Jitendra Nath Pandey commented on HDFS-6929: +1 > NN periodically unlinks lazy

[jira] [Commented] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111551#comment-14111551 ] Tsz Wo Nicholas Sze commented on HDFS-6911: --- > ... , maybe a more efficient way h

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111530#comment-14111530 ] Yongjun Zhang commented on HDFS-6776: - I'd like to emphasize that with the latest patch

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Assignee: Xiaoyu Yao > Add Additional unit tests for HDFS-6581 > ---

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6950: Issue Type: Sub-task (was: Bug) Parent: HDFS-6581 > Add Additional unit tests for HDFS-6581

[jira] [Created] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6950: Summary: Add Additional unit tests for HDFS-6581 Key: HDFS-6950 URL: https://issues.apache.org/jira/browse/HDFS-6950 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.003.patch The unit test was relying on the file position being 0

[jira] [Updated] (HDFS-6891) Follow-on work for transparent data at rest encryption

2014-08-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6891: -- Component/s: encryption > Follow-on work for transparent data at rest encryption > -

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Environment: (was: This can be an abstract method in NFS3Response to force the subclasses to implement

[jira] [Updated] (HDFS-6894) Add XDR parser method for each NFS response

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6894: - Description: This can be an abstract method in NFS3Response to force the subclasses to implement. > Add X

[jira] [Updated] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6727: Attachment: HDFS-6727.combo.patch Update a combo patch against trunk. > Refresh data volumes on Dat

[jira] [Updated] (HDFS-6727) Refresh data volumes on DataNode based on configuration changes

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6727: Target Version/s: 3.0.0, 2.6.0 (was: 2.6.0) Affects Version/s: 2.5.0 Status: Pat

[jira] [Assigned] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu reassigned HDFS-6946: - Assignee: Stephen Chu > TestBalancerWithSaslDataTransfer fails in trunk >

[jira] [Commented] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111455#comment-14111455 ] Stephen Chu commented on HDFS-6946: --- Similar to HDFS-5803, where TestBalancer#TIMEOUT was

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Affects Version/s: (was: 2.4.1) 2.5.0 Status: Patch Availab

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Attachment: HDFS-6808.000.patch Update patch to add command line supports. > Add command line optio

[jira] [Updated] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-08-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6808: Attachment: HDFS-6808.000.combo.patch > Add command line option to ask DataNode reload configuration

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111370#comment-14111370 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6949) Add NFS-ACL protocol support

2014-08-26 Thread Brandon Li (JIRA)
Brandon Li created HDFS-6949: Summary: Add NFS-ACL protocol support Key: HDFS-6949 URL: https://issues.apache.org/jira/browse/HDFS-6949 Project: Hadoop HDFS Issue Type: New Feature Comp

[jira] [Updated] (HDFS-6911) Archival Storage: check if a block is already scheduled in Mover

2014-08-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6911: -- Attachment: h6911_20140827.patch h6911_20140827.patch: adds a new test for ScheduleSameB

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.002.patch > SharedFileDescriptorFactory should not allocate spar

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111299#comment-14111299 ] Hadoop QA commented on HDFS-6892: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111284#comment-14111284 ] Colin Patrick McCabe commented on HDFS-6912: bq. Hey Colin. Did you verify that

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: HDFS-6851.000.patch Redo the .000 patch. The last one didn't include the two deleted files

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: (was: HDFS-6851.000.patch) > Flush EncryptionZoneWithId and add an id field to Encrypt

[jira] [Updated] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6929: Attachment: HDFS-6929.02.patch Updated patch to allow turning off the scrubber, document the option.

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111231#comment-14111231 ] Brandon Li commented on HDFS-6892: -- Uploaded a new patch to address Haohui's comments. >

[jira] [Updated] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6892: - Attachment: HDFS-6892.004.patch > Add XDR packaging method for each NFS request >

[jira] [Updated] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6928: Attachment: HDFS-6928.02.patch Rebased patch. > 'hdfs put' command should accept lazyPersist flag f

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1495#comment-1495 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6948) DN rejects blocks if it has older UC block

2014-08-26 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6948: - Summary: DN rejects blocks if it has older UC block Key: HDFS-6948 URL: https://issues.apache.org/jira/browse/HDFS-6948 Project: Hadoop HDFS Issue Type: Bug Af

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1418#comment-1418 ] Hadoop QA commented on HDFS-6912: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1407#comment-1407 ] Todd Lipcon commented on HDFS-6912: --- Hey Colin. Did you verify that tmpfs supports falloc

[jira] [Updated] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6925: Attachment: HDFS-6925.02.patch Thanks for reviewing [~jnp]! Updated patch to remove unnecessary edi

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1402#comment-1402 ] Haohui Mai commented on HDFS-6892: -- Looks good to me. I think there are multiple places th

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111091#comment-14111091 ] Yongjun Zhang commented on HDFS-6694: - Thanks for the info [~arpitagarwal]. > TestPip

[jira] [Updated] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6923: Attachment: HDFS-6923.02.patch Rebased patch. > Propagate LazyPersist flag to DNs via DataTransferP

[jira] [Commented] (HDFS-6865) Byte array native checksumming on client side (HDFS changes)

2014-08-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111085#comment-14111085 ] Todd Lipcon commented on HDFS-6865: --- Thanks for doing the diligence on the performance te

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111072#comment-14111072 ] Arpit Agarwal commented on HDFS-6898: - Yes it may be helpful to have reservation for tm

[jira] [Updated] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6922: Attachment: HDFS-6922.02.patch Thanks for reviewing Vinayakumar. Good catch on #1. I updated the pat

[jira] [Commented] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111064#comment-14111064 ] Hadoop QA commented on HDFS-6851: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6947) Enhance HAR integration with encryption zones

2014-08-26 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6947: - Summary: Enhance HAR integration with encryption zones Key: HDFS-6947 URL: https://issues.apache.org/jira/browse/HDFS-6947 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Commented] (HDFS-6892) Add XDR packaging method for each NFS request

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111058#comment-14111058 ] Hadoop QA commented on HDFS-6892: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111039#comment-14111039 ] Hadoop QA commented on HDFS-6606: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Attachment: HDFS-6851.000.patch Posting .000 patch for a testpatch run. > Flush EncryptionZoneWithId

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Description: SharedFileDescriptor factory should not allocate sparse files. Sparse fi

[jira] [Updated] (HDFS-6851) Flush EncryptionZoneWithId and add an id field to EncryptionZone

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6851: --- Target Version/s: 3.0.0 (was: fs-encryption (HADOOP-10150 and HDFS-6134)) Affects Version/s:

[jira] [Commented] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111035#comment-14111035 ] Colin Patrick McCabe commented on HDFS-6902: +1. thanks > FileWriter should b

[jira] [Updated] (HDFS-6912) SharedFileDescriptorFactory should not allocate sparse files

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Summary: SharedFileDescriptorFactory should not allocate sparse files (was: HDFS Shor

[jira] [Updated] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Attachment: HDFS-6912.001.patch > HDFS Short-circuit read implementation throws SIGBUS

[jira] [Updated] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6912: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) > HDFS Short

[jira] [Commented] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111022#comment-14111022 ] Colin Patrick McCabe commented on HDFS-6912: bq. Colin Patrick McCabe: this is

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111006#comment-14111006 ] Arpit Agarwal commented on HDFS-6694: - The repo is not open for commits. > TestPipelin

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110970#comment-14110970 ] Yongjun Zhang commented on HDFS-6694: - Hi Arpit, thanks for your earlier review, would

[jira] [Commented] (HDFS-6773) MiniDFSCluster should skip edit log fsync by default

2014-08-26 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110953#comment-14110953 ] Stephen Chu commented on HDFS-6773: --- The above two test failures aren't related to this p

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110949#comment-14110949 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110950#comment-14110950 ] Hadoop QA commented on HDFS-6776: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-6826: - Attachment: HDFS-6826v7.4.patch Test failure pass locally, scanning the test output does n

[jira] [Commented] (HDFS-6942) Fix typos in log messages

2014-08-26 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110933#comment-14110933 ] Ray Chiang commented on HDFS-6942: -- Both unit tests failures are unrelated and both tests

[jira] [Commented] (HDFS-6908) incorrect snapshot directory diff generated by snapshot deletion

2014-08-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110927#comment-14110927 ] Juan Yu commented on HDFS-6908: --- [~jingzhao]] Thanks for reviewing patch and the discussion.

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110805#comment-14110805 ] Yongjun Zhang commented on HDFS-6776: - BTW, I'd like to restrict the solution of the ji

[jira] [Commented] (HDFS-6938) Cleanup javac warnings in FSNamesystem.java

2014-08-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110798#comment-14110798 ] Charles Lamb commented on HDFS-6938: Since the diffs are only fixing unused imports and

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Fix Version/s: (was: 3.0.0) Target Version/s: 2.6.0 (was: 3.0.0) Affects Version/s: (was: 3.0

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Attachment: HDFS-6606.001.patch > Optimize HDFS Encrypted Transport performance >

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110758#comment-14110758 ] Yongjun Zhang commented on HDFS-6776: - Uploaded patch 009. This version passes real "nu

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Summary: distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webh

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work via webhdfs

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.009.patch > distcp from insecure cluster (source) to secure cluster (destinati

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: (was: HDFS-6776.009.patch) > distcp from insecure cluster (source) to secure cluster

[jira] [Updated] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

2014-08-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6776: Attachment: HDFS-6776.009.patch > distcp from insecure cluster (source) to secure cluster (destinati

[jira] [Moved] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu moved HBASE-11824 to HDFS-6946: -- Key: HDFS-6946 (was: HBASE-11824) Project: Hadoop HDFS (was: HBase) > TestBala

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Attachment: OptimizeHdfsEncryptedTransportperformance.pdf Attach a brief design for this optimization. Our goals

[jira] [Updated] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-08-26 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6606: - Description: In HDFS-3637, [~atm] added support for encrypting the DataTransferProtocol, it was a great work. It

[jira] [Updated] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Resolution: Duplicate Status: Resolved (was: Patch Available) Duplicate of HADOOP-10251. > Both

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110645#comment-14110645 ] Zesheng Wu commented on HDFS-6827: -- [~vinayrpet], I verified your patch of HADOOP-10251 on

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110632#comment-14110632 ] Vinayakumar B commented on HDFS-6898: - Do you think this reservation should be done for

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110563#comment-14110563 ] Hadoop QA commented on HDFS-6898: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110554#comment-14110554 ] Hadoop QA commented on HDFS-6898: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2014-08-26 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6832: Target Version/s: 2.6.0 (was: 2.5.0) > Fix the usage of 'hdfs namenode' command > -

[jira] [Created] (HDFS-6945) ExcessBlocks metric may not be decremented if there are no over replicated blocks

2014-08-26 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-6945: --- Summary: ExcessBlocks metric may not be decremented if there are no over replicated blocks Key: HDFS-6945 URL: https://issues.apache.org/jira/browse/HDFS-6945 Project:

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110474#comment-14110474 ] Hadoop QA commented on HDFS-6826: - {color:red}-1 overall{color}. Here are the results of t

  1   2   >