[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653164#comment-14653164 ] kanaka kumar avvaru commented on HDFS-8829: --- Hi [~He Tianyi], similar configurati

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653156#comment-14653156 ] Hadoop QA commented on HDFS-8838: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653161#comment-14653161 ] Zhe Zhang commented on HDFS-8833: - Thanks Andrew for the suggestion. I think {{*-on-create}

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653155#comment-14653155 ] Rakesh R commented on HDFS-8220: Thanks [~szetszwo], [~walter.k.su]. Attached another patch

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653150#comment-14653150 ] Ajith S commented on HDFS-8693: --- Hi [~john.jian.fang] and [~kihwal] Agreed, need to fix refr

[jira] [Assigned] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reassigned HDFS-8693: - Assignee: Ajith S > refreshNamenodes does not support adding a new standby to a running DN > -

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285-10.patch > Erasure Coding: StripedDataStreamer fails to handle the blocklocatio

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Status: Patch Available (was: Open) > Tolerate datanode failures in DFSStripedOutputStream when the data len

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Attachment: h8838_20150731-HDFS-7285.patch LGTM. +1. Upload the same patch for [~szetszwo] to trigger Jenkins

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653147#comment-14653147 ] Ajith S commented on HDFS-8693: --- Hi [~kihwal] I tested with federated HA cluster when adding

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653136#comment-14653136 ] Li Bo commented on HDFS-8838: - hi, [~walter.k.su] and [~szetszwo], could you help me review the

[jira] [Assigned] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-8853: -- Assignee: Rakesh R > Erasure Coding: Provide ECSchema validation when creating ECZone >

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8853: --- Assignee: J.Andreina (was: Rakesh R) > Erasure Coding: Provide ECSchema validation when creating ECZone >

[jira] [Created] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

Rakesh R created HDFS-8853: -- Summary: Erasure Coding: Provide ECSchema validation when creating ECZone Key: HDFS-8853 URL: https://issues.apache.org/jira/browse/HDFS-8853 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Attachment: HDFS-8704-HDFS-7285-005.patch > Erasure Coding: client fails to write large file when one datanode fails

[jira] [Commented] (HDFS-8663) sys cpu usage high on namenode server

[ https://issues.apache.org/jira/browse/HDFS-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653114#comment-14653114 ] tangjunjie commented on HDFS-8663: -- For HDFS, the mapping of users to groups is performed

[jira] [Updated] (HDFS-8852) HDFS architecture documentation of version 2.x is outdated about append write support

[ https://issues.apache.org/jira/browse/HDFS-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Dai Thanh updated HDFS-8852: - Summary: HDFS architecture documentation of version 2.x is outdated about append write support (wa

[jira] [Created] (HDFS-8852) Documentation of Hadoop 2.x is outdated about append write support

Hong Dai Thanh created HDFS-8852: Summary: Documentation of Hadoop 2.x is outdated about append write support Key: HDFS-8852 URL: https://issues.apache.org/jira/browse/HDFS-8852 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653076#comment-14653076 ] Hadoop QA commented on HDFS-8850: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Fukudome updated HDFS-8827: -- Attachment: HDFS-8827.1.patch Thanks for the comment, [~zhz]! I attached an initial patch which a

[jira] [Commented] (HDFS-8851) datanode fails to start due to a bad disk

[ https://issues.apache.org/jira/browse/HDFS-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653056#comment-14653056 ] Wang Hao commented on HDFS-8851: There is a IOException when read VERSION because of the di

[jira] [Commented] (HDFS-8851) datanode fails to start due to a bad disk

[ https://issues.apache.org/jira/browse/HDFS-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653048#comment-14653048 ] Wang Hao commented on HDFS-8851: 15/08/04 12:01:24 INFO common.Storage: Analyzing storage

[jira] [Created] (HDFS-8851) datanode fails to start due to a bad disk

Wang Hao created HDFS-8851: -- Summary: datanode fails to start due to a bad disk Key: HDFS-8851 URL: https://issues.apache.org/jira/browse/HDFS-8851 Project: Hadoop HDFS Issue Type: Bug Com

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Attachment: HDFS-8704-HDFS-7285-004.patch > Erasure Coding: client fails to write large file when one datanode fails

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Status: Patch Available (was: Open) > Erasure Coding: client fails to write large file when one datanode fails > ---

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653034#comment-14653034 ] Walter Su commented on HDFS-8220: - When I ran tests, I ran into some NPEs. Could you add {{

[jira] [Commented] (HDFS-8808) dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby

[ https://issues.apache.org/jira/browse/HDFS-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653015#comment-14653015 ] Ajith S commented on HDFS-8808: --- Hi [~ggop] Why not bootstrap the standby without that prope

[jira] [Commented] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652995#comment-14652995 ] Hadoop QA commented on HDFS-488: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-488: -- Tags: (was: MoveToLocal) > Implement moveToLocal HDFS command > ---

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-488: -- Target Version/s: (was: 2.7.1) > Implement moveToLocal HDFS command > -

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-488: -- Priority: Minor (was: Major) Hadoop Flags: (was: Reviewed) Fix Version/s: (was

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652970#comment-14652970 ] Allen Wittenauer commented on HDFS-8849: This is one of those times where I feel th

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Capo updated HDFS-488: - Attachment: HDFS-488.patch > Implement moveToLocal HDFS command > --- > >

[jira] [Updated] (HDFS-488) Implement moveToLocal HDFS command

[ https://issues.apache.org/jira/browse/HDFS-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Capo updated HDFS-488: - Hadoop Flags: Reviewed Fix Version/s: 2.7.1 Affects Version/s: 2.7.1 Target Version/s:

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652932#comment-14652932 ] Yi Liu commented on HDFS-8850: -- Yes, you are right. +1 pending Jenkins. > VolumeScanner thre

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8850: --- Status: Patch Available (was: Open) > VolumeScanner thread exits with exception if the

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8850: --- Attachment: HDFS-8850.001.patch > VolumeScanner thread exits with exception if there is

[jira] [Created] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

Colin Patrick McCabe created HDFS-8850: -- Summary: VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks Key: HDFS-8850 URL: https://issues.apache.or

[jira] [Resolved] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8804. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 I've committed this to the fe

[jira] [Commented] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652808#comment-14652808 ] Tsz Wo Nicholas Sze commented on HDFS-8804: --- +1 the new patch looks good. > Eras

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652789#comment-14652789 ] Jing Zhao commented on HDFS-8828: - Thanks for the explanation, Yufei! Yes, you're right tha

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652736#comment-14652736 ] Yufei Gu commented on HDFS-8828: Hi Jing Zhao, Thank you for reviewing the code. We change

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652728#comment-14652728 ] Hadoop QA commented on HDFS-8828: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652698#comment-14652698 ] Duo Zhang commented on HDFS-7966: - I do not have enough machines to test the scenario... Wh

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652695#comment-14652695 ] Zhe Zhang commented on HDFS-8849: - Thanks Allen for the advice. I think we can report the *

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652684#comment-14652684 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- Not yet. Should be able to try it o

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652657#comment-14652657 ] Andrew Wang commented on HDFS-7966: --- Agree there potentially are performance advantages,

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652645#comment-14652645 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652639#comment-14652639 ] Hadoop QA commented on HDFS-8823: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8761) Windows HDFS daemon - datanode.DirectoryScanner: Error compiling report (...) XXX is not a prefix of YYY

[ https://issues.apache.org/jira/browse/HDFS-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652581#comment-14652581 ] Chris Nauroth commented on HDFS-8761: - [~odelalleau], glad to hear this helped! bq. I

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652579#comment-14652579 ] Haohui Mai commented on HDFS-7966: -- bq. What's the upside of this new implementation? Pe

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652559#comment-14652559 ] Jing Zhao commented on HDFS-8828: - Thanks for working on this, Yufei! One quick comment is

[jira] [Commented] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652549#comment-14652549 ] Andrew Wang commented on HDFS-7966: --- I guess my question here is similar to what [~stack]

[jira] [Commented] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652536#comment-14652536 ] Zhe Zhang commented on HDFS-8804: - Thanks Jing for the work! The patch looks good to me. Th

[jira] [Commented] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652534#comment-14652534 ] Andrew Wang commented on HDFS-8747: --- >From our side, we have some customers using encrypt

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652525#comment-14652525 ] Yufei Gu commented on HDFS-8828: Hi Yongjun, Thank you very much for detailed code review

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Attachment: HDFS-8828.003.patch > Utilize Snapshot diff report to build copy list in distcp > -

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652515#comment-14652515 ] Zhe Zhang commented on HDFS-8846: - Thanks Ming for the feedback! I was planning to only ad

[jira] [Updated] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8804: Attachment: HDFS-8804.001.patch Thanks Nicholas for the review! Update the patch to address the comments. I d

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652471#comment-14652471 ] Allen Wittenauer commented on HDFS-8849: bq.A replication factor of 1 indicates the

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652451#comment-14652451 ] Zhe Zhang commented on HDFS-8849: - I guess the motivation is the same as HDFS-7165. A repli

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652439#comment-14652439 ] Allen Wittenauer commented on HDFS-8849: I'm not sure what benefit that number prov

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652430#comment-14652430 ] Tsz Wo Nicholas Sze commented on HDFS-8220: --- Some minor comment: {code}

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652427#comment-14652427 ] Zhe Zhang commented on HDFS-8849: - Thanks for the input Allen. I guess there's still a smal

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652421#comment-14652421 ] Allen Wittenauer commented on HDFS-8849: That's pretty much covered already. fsck

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7916: -- Labels: (was: 2.6.1-candidate) > 'reportBadBlocks' from datanodes to standby No

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7314: -- Labels: 2.6.1-candidate 2.7.2-candidate BB2015-05-TBR (was: BB2015-05-TBR) > Whe

[jira] [Updated] (HDFS-7182) JMX metrics aren't accessible when NN is busy

[ https://issues.apache.org/jira/browse/HDFS-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7182: -- Labels: 2.6.1-candidate (was: ) > JMX metrics aren't accessible when NN is busy

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652403#comment-14652403 ] Tsz Wo Nicholas Sze commented on HDFS-8838: --- [~walter.k.su], thanks for showing a

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8480: -- Labels: 2.6.1-candidate (was: ) > Fix performance and timeout issues in HDFS-792

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7916: -- Labels: 2.6.1-candidate (was: ) > 'reportBadBlocks' from datanodes to standby No

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7929: -- Labels: 2.6.1-candidate (was: ) > inotify unable fetch pre-upgrade edit log segm

[jira] [Updated] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7894: -- Labels: 2.6.1-candidate (was: ) > Rolling upgrade readiness is not updated in jm

[jira] [Updated] (HDFS-7446) HDFS inotify should have the ability to determine what txid it has read up to

[ https://issues.apache.org/jira/browse/HDFS-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7446: -- Labels: 2.6.1-candidate (was: ) > HDFS inotify should have the ability to determ

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8046: -- Labels: 2.6.1-candidate 2.7.2-candidate (was: 2.6.1-candidate) > Allow better co

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8046: -- Labels: 2.6.1-candidate (was: ) > Allow better control of getContentSummary > --

[jira] [Created] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

Zhe Zhang created HDFS-8849: --- Summary: fsck should report number of missing blocks with replication factor 1 Key: HDFS-8849 URL: https://issues.apache.org/jira/browse/HDFS-8849 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652325#comment-14652325 ] Zhe Zhang commented on HDFS-8499: - [~szetszwo] I wonder if you've had a chance to work on r

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: HDFS-8823.001.patch > Move replication factor into individual blocks >

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652228#comment-14652228 ] Rakesh R commented on HDFS-8220: bq. I saw if ( numOfDNs >= NUM_DATA_BLOCKS && numOfDNs < G

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285-09.patch > Erasure Coding: StripedDataStreamer fails to handle the blocklocatio

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: (was: HDFS-8220-HDFS-7285-09.patch) > Erasure Coding: StripedDataStreamer fails to handle the b

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285-09.patch > Erasure Coding: StripedDataStreamer fails to handle the blocklocatio

[jira] [Updated] (HDFS-8848) Support OAuth2 in libwebhdfs

[ https://issues.apache.org/jira/browse/HDFS-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneeth P updated HDFS-8848: Issue Type: New Feature (was: Improvement) > Support OAuth2 in libwebhdfs > > >

[jira] [Created] (HDFS-8848) Support OAuth2 in libwebhdfs

Puneeth P created HDFS-8848: --- Summary: Support OAuth2 in libwebhdfs Key: HDFS-8848 URL: https://issues.apache.org/jira/browse/HDFS-8848 Project: Hadoop HDFS Issue Type: Improvement Compon

[jira] [Commented] (HDFS-8841) Catch throwable return null

[ https://issues.apache.org/jira/browse/HDFS-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651694#comment-14651694 ] Jagadesh Kiran N commented on HDFS-8841: I failed to see the chance of Error(like C

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651638#comment-14651638 ] Jagadesh Kiran N commented on HDFS-8784: Pre-Patch failure is not related to the ch

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651595#comment-14651595 ] Hadoop QA commented on HDFS-8784: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651561#comment-14651561 ] Hadoop QA commented on HDFS-7601: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651555#comment-14651555 ] Li Bo commented on HDFS-8838: - The number of datanodes is set to 9 in the unit test. Due to the

[jira] [Updated] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-7601: --- Attachment: 0001-for-hdfs-7601.patch > Operations(e.g. balance) failed due to deficient configuration parsing >

[jira] [Updated] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-7601: --- Attachment: (was: 0001-for-hdfs-7601.patch) > Operations(e.g. balance) failed due to deficient configuratio

[jira] [Commented] (HDFS-8839) Erasure Coding: client occasionally gets less block locations when some datanodes fail

[ https://issues.apache.org/jira/browse/HDFS-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651524#comment-14651524 ] Walter Su commented on HDFS-8839: - bq. Otherwise, the client writing can't go on. Yes, it h