[jira] [Commented] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650182#comment-14650182 ] Hudson commented on HDFS-8847: -- FAILURE: Integrated in Hadoop-trunk-Commit #8254 (See [https:

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650166#comment-14650166 ] Ming Ma commented on HDFS-8846: --- 2.5 should be fine. Although people still use 2.3 or 2.4, th

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650156#comment-14650156 ] Ming Ma commented on HDFS-8480: --- Make sense. It is easier to check in an edit log with an old

[jira] [Reopened] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reopened HDFS-8847: - > change TestHDFSContractAppend to not override testRenameFileBeingAppended > method. > --

[jira] [Resolved] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved HDFS-8847. - Resolution: Fixed > change TestHDFSContractAppend to not override testRenameFileBeingAppended > method. >

[jira] [Resolved] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved HDFS-8847. - Resolution: Fixed Hadoop Flags: Reviewed > change TestHDFSContractAppend to not override testRenameFi

[jira] [Commented] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650152#comment-14650152 ] zhihai xu commented on HDFS-8847: - The patch from HADOOP-12268 (https://issues.apache.org/

[jira] [Updated] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated HDFS-8847: Fix Version/s: 2.8.0 > change TestHDFSContractAppend to not override testRenameFileBeingAppended > method. >

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Attachment: HDFS-8828.002.patch > Utilize Snapshot diff report to build copy list in distcp > -

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650141#comment-14650141 ] He Tianyi commented on HDFS-8829: - Hi kanaka kumar avvaru, I've applied the improvement to

[jira] [Created] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

zhihai xu created HDFS-8847: --- Summary: change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Key: HDFS-8847 URL: https://issues.apache.org/jira/browse/HDFS-8847 Project: Hadoop H

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Attachment: HDFS-8155-1.patch First patch for review. We've been testing a version of this code for a fe

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650094#comment-14650094 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-8155: - Assignee: Jakob Homan (was: Kai Zheng) > Support OAuth2 in WebHDFS > - >

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650080#comment-14650080 ] Hadoop QA commented on HDFS-8828: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650073#comment-14650073 ] Haohui Mai commented on HDFS-8823: -- This jira is focus on replication factor. I suggest op

[jira] [Comment Edited] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650070#comment-14650070 ] Yi Liu edited comment on HDFS-6682 at 8/1/15 12:32 AM: --- Thanks Allen,

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650070#comment-14650070 ] Yi Liu commented on HDFS-6682: -- Thanks Allen, Andrew and Akira for the discussion. Our origin

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650045#comment-14650045 ] Hudson commented on HDFS-6860: -- FAILURE: Integrated in Hadoop-trunk-Commit #8253 (See [https:

[jira] [Commented] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650017#comment-14650017 ] Tsz Wo Nicholas Sze commented on HDFS-8804: --- Some comments on the patch: - Should

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650013#comment-14650013 ] Zhe Zhang commented on HDFS-8823: - Thanks Haohui for the pointers; they are very helpful.

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650001#comment-14650001 ] Hadoop QA commented on HDFS-8845: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649980#comment-14649980 ] Zhe Zhang commented on HDFS-8827: - Thanks for identifying the problem Fukudome-san! I took

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8486: --- Labels: 2.6.1-candidate (was: ) > DN startup may cause severe data loss >

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-7980: --- Labels: 2.6.1-candidate (was: ) > Incremental BlockReport will dramatically slow down the startup of

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649970#comment-14649970 ] Xiaoyu Yao commented on HDFS-6860: -- Jenkins results: * No unit test added because this is

[jira] [Updated] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8245: --- Labels: 2.6.1-candidate BB2015-05-TBR (was: BB2015-05-TBR) > Standby namenode doesn't process DELETED_

[jira] [Updated] (HDFS-8404) Pending block replication can get stuck using older genstamp

[ https://issues.apache.org/jira/browse/HDFS-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8404: --- Labels: 2.6.1-candidate (was: ) > Pending block replication can get stuck using older genstamp > -

[jira] [Commented] (HDFS-8399) Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649968#comment-14649968 ] Zhe Zhang commented on HDFS-8399: - Thanks for the work Rakesh! The added test looks a clea

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649960#comment-14649960 ] Hadoop QA commented on HDFS-6860: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-3443: -- Labels: 2.6.1-candidate (was: ) > Fix NPE when namenode transition to active during startup by adding >

[jira] [Updated] (HDFS-4882) Prevent the Namenode's LeaseManager from looping forever in checkLeases

[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-4882: -- Labels: 2.6.1-candidate (was: ) > Prevent the Namenode's LeaseManager from looping forever in checkLease

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649952#comment-14649952 ] Haohui Mai commented on HDFS-8344: -- After looking through the code, instead of retrying fo

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649948#comment-14649948 ] Zhe Zhang commented on HDFS-8220: - Quickly glanced through the current code; it doesn't see

[jira] [Resolved] (HDFS-8839) Erasure Coding: client occasionally gets less block locations when some datanodes fail

[ https://issues.apache.org/jira/browse/HDFS-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8839. - Resolution: Duplicate Thanks Bo for identifying this. I think this is a duplicate of HDFS-8220. > Erasure

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649929#comment-14649929 ] Zhe Zhang commented on HDFS-8550: - [~rakeshr] I wonder if the issue is still valid with HDF

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649923#comment-14649923 ] Zhe Zhang commented on HDFS-8846: - [~mingma] [~cmccabe] Let me know if the below looks a re

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649924#comment-14649924 ] Colin Patrick McCabe commented on HDFS-8480: Thanks, [~zhz]. > Fix performance

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649916#comment-14649916 ] Andrew Wang commented on HDFS-6682: --- Cool, thanks Allen. Maybe we file a new JIRA for thi

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649906#comment-14649906 ] Andrew Wang commented on HDFS-8835: --- There is a lot of past precedent for doing refactors

[jira] [Commented] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649905#comment-14649905 ] Xiaoyu Yao commented on HDFS-8747: -- bq. This is maybe viable for scratch, but not for tras

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649876#comment-14649876 ] Allen Wittenauer commented on HDFS-6682: We have no insight into how old a given re

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649875#comment-14649875 ] Zhe Zhang commented on HDFS-8480: - Thanks for the discussion Ming and Colin! I created HDF

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: h8838_20150731.patch > Tolerate datanode failures in DFSStripedOutputStream w

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: (was: h8838_20150731.patch) > Tolerate datanode failures in DFSStripedOut

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: h8838_20150731.patch h8838_20150731.patch: adds more tests and prints out all

[jira] [Created] (HDFS-8846) Create edit log files with old layout version for upgrade testing

Zhe Zhang created HDFS-8846: --- Summary: Create edit log files with old layout version for upgrade testing Key: HDFS-8846 URL: https://issues.apache.org/jira/browse/HDFS-8846 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649840#comment-14649840 ] Tsz Wo Nicholas Sze commented on HDFS-8835: --- > HDFS-8487 (as well as HDFS-8653, H

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649834#comment-14649834 ] Zhe Zhang commented on HDFS-8835: - Thanks for sharing the feedback [~szetszwo]. HDFS-8487

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649825#comment-14649825 ] Andrew Wang commented on HDFS-6682: --- Wondering if there's a lighterweight metric we could

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7587: -- Attachment: HDFS-7587-branch-2.6.patch For the 2.6.1 release effort, the backport isn't straightforward due to d

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649808#comment-14649808 ] Chang Li commented on HDFS-8845: Hi [~eddyxu], thanks for comments. It's intentionally do

[jira] [Commented] (HDFS-8653) Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo

[ https://issues.apache.org/jira/browse/HDFS-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649807#comment-14649807 ] Zhe Zhang commented on HDFS-8653: - [~szetszwo] Majority of this patch is just code cleanup,

[jira] [Commented] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649805#comment-14649805 ] Andrew Wang commented on HDFS-8747: --- bq. Encryption zone as a security concept should be

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Status: Patch Available (was: Open) Submitted patch rev 001. > Utilize Snapshot diff report to build copy lis

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649788#comment-14649788 ] Tsz Wo Nicholas Sze commented on HDFS-8838: --- Thanks Li for taking a look 1. We do

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649748#comment-14649748 ] Lei (Eddy) Xu commented on HDFS-8845: - Hi, [~lichangleo], after HDFS-6482, finalizedDir

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649747#comment-14649747 ] Arpit Agarwal commented on HDFS-6860: - +1 pending Jenkins thanks for taking over this [

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Description: DiskChecker should not traverse entire tree because it's causing heavy disk load on checkDiskError

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Attachment: HDFS-6860.01.patch Update the patch based on feedback. Delta from v00: Keep the block report p

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Status: Patch Available (was: Open) > DiskChecker should not traverse entire tree > --

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Attachment: HDFS-8845.patch > DiskChecker should not traverse entire tree > ---

[jira] [Created] (HDFS-8845) DiskChecker should not traverse entire tree

Chang Li created HDFS-8845: -- Summary: DiskChecker should not traverse entire tree Key: HDFS-8845 URL: https://issues.apache.org/jira/browse/HDFS-8845 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649697#comment-14649697 ] Arpit Agarwal commented on HDFS-6860: - Thanks I meant INFO. Apologize for not catching

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649686#comment-14649686 ] Xiaoyu Yao commented on HDFS-6860: -- Thanks [~arpitagarwal] for the review. Do you mean kee

[jira] [Updated] (HDFS-8202) Improve end to end striping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8202: --- Summary: Improve end to end striping file test to add erasure recovering test (was: Improve en

[jira] [Resolved] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8202. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Target Version/s:

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649670#comment-14649670 ] Arpit Agarwal commented on HDFS-6860: - Thanks [~xyao], we should probably leave the "Pr

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Attachment: HDFS-6860.00.patch The original patch does not apply after switching to slf4j with HDFS-7112. I

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649618#comment-14649618 ] Andrew Wang commented on HDFS-8833: --- Supporting reencode-on-rename is difficult, and IMO

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649566#comment-14649566 ] Tsz Wo Nicholas Sze commented on HDFS-8833: --- {code} ... Under the scope of this J

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649514#comment-14649514 ] Zhe Zhang commented on HDFS-8784: - Thanks Jagadesh for working on this! Looks like a clean

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649510#comment-14649510 ] Hadoop QA commented on HDFS-8784: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Summary: Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones (was: E

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649499#comment-14649499 ] Haohui Mai commented on HDFS-6407: -- The v10 patch allows sorting based on the status and t

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649490#comment-14649490 ] Akira AJISAKA commented on HDFS-7916: - If HDFS-7704 is backported to a branch, this iss

[jira] [Commented] (HDFS-8747) Provide Better "Scratch Space" and "Soft Delete" Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649486#comment-14649486 ] Xiaoyu Yao commented on HDFS-8747: -- Thanks [~andrew.wang] for reviewing. bq. Have you th

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8840: - Resolution: Not A Problem Status: Resolved (was: Patch Available) Thanks [~jagadesh.kiran] for wor

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649380#comment-14649380 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649379#comment-14649379 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649362#comment-14649362 ] Hadoop QA commented on HDFS-8840: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649275#comment-14649275 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See [https://

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649274#comment-14649274 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See [https://

[jira] [Commented] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649245#comment-14649245 ] songwanging commented on HDFS-8840: --- Great, the patch looks good to me. It should be acce

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649229#comment-14649229 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See [htt

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649222#comment-14649222 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See [htt

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649223#comment-14649223 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See [htt

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649230#comment-14649230 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See [htt

[jira] [Commented] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649205#comment-14649205 ] Gururaj Shetty commented on HDFS-8802: -- The test failure {{org.apache.hadoop.hdfs.Te

[jira] [Updated] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8784: --- Status: Patch Available (was: Open) > BlockInfo#numNodes should be numStorages > -

[jira] [Updated] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8784: --- Attachment: HDFS-8784-00.patch Attached the patch .please review > BlockInfo#numNodes should b

[jira] [Created] (HDFS-8844) TestHDFSCLI does not cleanup the test directory

Akira AJISAKA created HDFS-8844: --- Summary: TestHDFSCLI does not cleanup the test directory Key: HDFS-8844 URL: https://issues.apache.org/jira/browse/HDFS-8844 Project: Hadoop HDFS Issue Type: B

[jira] [Commented] (HDFS-8792) Improve BlockManager#postponedMisreplicatedBlocks and BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649183#comment-14649183 ] Yi Liu commented on HDFS-8792: -- The test failure is not related. > Improve BlockManager#postp

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8840: --- Status: Patch Available (was: Open) > Inconsistent log level practice > --

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8840: --- Attachment: HDFS-8840-00.patch Uploaded the patch please review > Inconsistent log level pract

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649130#comment-14649130 ] Hudson commented on HDFS-8821: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See [https://

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649131#comment-14649131 ] Hudson commented on HDFS-7192: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See [https://

[jira] [Commented] (HDFS-8821) Explain message "Operation category X is not supported in state standby"

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649055#comment-14649055 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #273 (See [htt

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649056#comment-14649056 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #273 (See [htt

  1   2   >