[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Attachment: HDFS-8828.002.patch Utilize Snapshot diff report to build copy list in distcp

[jira] [Resolved] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved HDFS-8847. - Resolution: Fixed change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[jira] [Reopened] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reopened HDFS-8847: - change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650156#comment-14650156 ] Ming Ma commented on HDFS-8480: --- Make sense. It is easier to check in an edit log with an

[jira] [Commented] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650152#comment-14650152 ] zhihai xu commented on HDFS-8847: - The patch from HADOOP-12268

[jira] [Resolved] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved HDFS-8847. - Resolution: Fixed Hadoop Flags: Reviewed change TestHDFSContractAppend to not override

[jira] [Updated] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[ https://issues.apache.org/jira/browse/HDFS-8847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated HDFS-8847: Fix Version/s: 2.8.0 change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650166#comment-14650166 ] Ming Ma commented on HDFS-8846: --- 2.5 should be fine. Although people still use 2.3 or 2.4,

[jira] [Comment Edited] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650070#comment-14650070 ] Yi Liu edited comment on HDFS-6682 at 8/1/15 12:32 AM: --- Thanks Allen,

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650080#comment-14650080 ] Hadoop QA commented on HDFS-8828: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8155: -- Attachment: HDFS-8155-1.patch First patch for review. We've been testing a version of this code for a

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650045#comment-14650045 ] Hudson commented on HDFS-6860: -- FAILURE: Integrated in Hadoop-trunk-Commit #8253 (See

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650070#comment-14650070 ] Yi Liu commented on HDFS-6682: -- Thanks Allen, Andrew and Akira for the discussion. Our

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650073#comment-14650073 ] Haohui Mai commented on HDFS-8823: -- This jira is focus on replication factor. I suggest

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650094#comment-14650094 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Assigned] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-8155: - Assignee: Jakob Homan (was: Kai Zheng) Support OAuth2 in WebHDFS -

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8840: --- Status: Patch Available (was: Open) Inconsistent log level practice

[jira] [Commented] (HDFS-8821) Explain message Operation category X is not supported in state standby

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649222#comment-14649222 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See

[jira] [Commented] (HDFS-8821) Explain message Operation category X is not supported in state standby

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649229#comment-14649229 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See

[jira] [Commented] (HDFS-8792) Improve BlockManager#postponedMisreplicatedBlocks and BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649183#comment-14649183 ] Yi Liu commented on HDFS-8792: -- The test failure is not related. Improve

[jira] [Commented] (HDFS-8821) Explain message Operation category X is not supported in state standby

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649274#comment-14649274 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See

[jira] [Created] (HDFS-8844) TestHDFSCLI does not cleanup the test directory

Akira AJISAKA created HDFS-8844: --- Summary: TestHDFSCLI does not cleanup the test directory Key: HDFS-8844 URL: https://issues.apache.org/jira/browse/HDFS-8844 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8840: --- Attachment: HDFS-8840-00.patch Uploaded the patch please review Inconsistent log level

[jira] [Updated] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8784: --- Attachment: HDFS-8784-00.patch Attached the patch .please review BlockInfo#numNodes should

[jira] [Commented] (HDFS-8802) dfs.checksum.type is not described in hdfs-default.xml

[ https://issues.apache.org/jira/browse/HDFS-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649205#comment-14649205 ] Gururaj Shetty commented on HDFS-8802: -- The test failure

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649230#comment-14649230 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649223#comment-14649223 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See

[jira] [Updated] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8784: --- Status: Patch Available (was: Open) BlockInfo#numNodes should be numStorages

[jira] [Commented] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649245#comment-14649245 ] songwanging commented on HDFS-8840: --- Great, the patch looks good to me. It should be

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649275#comment-14649275 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649380#comment-14649380 ] Hudson commented on HDFS-7192: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649362#comment-14649362 ] Hadoop QA commented on HDFS-8840: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8821) Explain message Operation category X is not supported in state standby

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649379#comment-14649379 ] Hudson commented on HDFS-8821: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Updated] (HDFS-8840) Inconsistent log level practice

[ https://issues.apache.org/jira/browse/HDFS-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8840: - Resolution: Not A Problem Status: Resolved (was: Patch Available) Thanks [~jagadesh.kiran] for

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649618#comment-14649618 ] Andrew Wang commented on HDFS-8833: --- Supporting reencode-on-rename is difficult, and IMO

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649514#comment-14649514 ] Zhe Zhang commented on HDFS-8784: - Thanks Jagadesh for working on this! Looks like a clean

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649486#comment-14649486 ] Xiaoyu Yao commented on HDFS-8747: -- Thanks [~andrew.wang] for reviewing. bq. Have you

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Attachment: HDFS-6860.00.patch The original patch does not apply after switching to slf4j with HDFS-7112.

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649490#comment-14649490 ] Akira AJISAKA commented on HDFS-7916: - If HDFS-7704 is backported to a branch, this

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Summary: Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones (was:

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649566#comment-14649566 ] Tsz Wo Nicholas Sze commented on HDFS-8833: --- {code} ... Under the scope of this

[jira] [Commented] (HDFS-8653) Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo

[ https://issues.apache.org/jira/browse/HDFS-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649807#comment-14649807 ] Zhe Zhang commented on HDFS-8653: - [~szetszwo] Majority of this patch is just code cleanup,

[jira] [Updated] (HDFS-8202) Improve end to end striping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-8202: --- Summary: Improve end to end striping file test to add erasure recovering test (was: Improve

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649686#comment-14649686 ] Xiaoyu Yao commented on HDFS-6860: -- Thanks [~arpitagarwal] for the review. Do you mean

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Attachment: HDFS-8845.patch DiskChecker should not traverse entire tree

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Status: Patch Available (was: Open) DiskChecker should not traverse entire tree

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649747#comment-14649747 ] Arpit Agarwal commented on HDFS-6860: - +1 pending Jenkins thanks for taking over this

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649670#comment-14649670 ] Arpit Agarwal commented on HDFS-6860: - Thanks [~xyao], we should probably leave the

[jira] [Resolved] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8202. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Target

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated HDFS-8845: --- Description: DiskChecker should not traverse entire tree because it's causing heavy disk load on

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Attachment: HDFS-6860.01.patch Update the patch based on feedback. Delta from v00: Keep the block report

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649748#comment-14649748 ] Lei (Eddy) Xu commented on HDFS-8845: - Hi, [~lichangleo], after HDFS-6482, finalizedDir

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649788#comment-14649788 ] Tsz Wo Nicholas Sze commented on HDFS-8838: --- Thanks Li for taking a look 1. We

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649805#comment-14649805 ] Andrew Wang commented on HDFS-8747: --- bq. Encryption zone as a security concept should be

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649825#comment-14649825 ] Andrew Wang commented on HDFS-6682: --- Wondering if there's a lighterweight metric we could

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649697#comment-14649697 ] Arpit Agarwal commented on HDFS-6860: - Thanks I meant INFO. Apologize for not catching

[jira] [Updated] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated HDFS-8828: --- Status: Patch Available (was: Open) Submitted patch rev 001. Utilize Snapshot diff report to build copy

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649808#comment-14649808 ] Chang Li commented on HDFS-8845: Hi [~eddyxu], thanks for comments. It's intentionally

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7587: -- Attachment: HDFS-7587-branch-2.6.patch For the 2.6.1 release effort, the backport isn't straightforward due to

[jira] [Created] (HDFS-8845) DiskChecker should not traverse entire tree

Chang Li created HDFS-8845: -- Summary: DiskChecker should not traverse entire tree Key: HDFS-8845 URL: https://issues.apache.org/jira/browse/HDFS-8845 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: h8838_20150731.patch h8838_20150731.patch: adds more tests and prints out

[jira] [Created] (HDFS-8846) Create edit log files with old layout version for upgrade testing

Zhe Zhang created HDFS-8846: --- Summary: Create edit log files with old layout version for upgrade testing Key: HDFS-8846 URL: https://issues.apache.org/jira/browse/HDFS-8846 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649905#comment-14649905 ] Xiaoyu Yao commented on HDFS-8747: -- bq. This is maybe viable for scratch, but not for

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649929#comment-14649929 ] Zhe Zhang commented on HDFS-8550: - [~rakeshr] I wonder if the issue is still valid with

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649952#comment-14649952 ] Haohui Mai commented on HDFS-8344: -- After looking through the code, instead of retrying

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649499#comment-14649499 ] Haohui Mai commented on HDFS-6407: -- The v10 patch allows sorting based on the status and

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649510#comment-14649510 ] Hadoop QA commented on HDFS-8784: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649876#comment-14649876 ] Allen Wittenauer commented on HDFS-6682: We have no insight into how old a given

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649948#comment-14649948 ] Zhe Zhang commented on HDFS-8220: - Quickly glanced through the current code; it doesn't

[jira] [Updated] (HDFS-4882) Prevent the Namenode's LeaseManager from looping forever in checkLeases

[ https://issues.apache.org/jira/browse/HDFS-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-4882: -- Labels: 2.6.1-candidate (was: ) Prevent the Namenode's LeaseManager from looping forever in

[jira] [Updated] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-3443: -- Labels: 2.6.1-candidate (was: ) Fix NPE when namenode transition to active during startup by adding

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649834#comment-14649834 ] Zhe Zhang commented on HDFS-8835: - Thanks for sharing the feedback [~szetszwo]. HDFS-8487

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649840#comment-14649840 ] Tsz Wo Nicholas Sze commented on HDFS-8835: --- HDFS-8487 (as well as HDFS-8653,

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: (was: h8838_20150731.patch) Tolerate datanode failures in

[jira] [Commented] (HDFS-8835) Convert BlockInfoUnderConstruction as an interface

[ https://issues.apache.org/jira/browse/HDFS-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649906#comment-14649906 ] Andrew Wang commented on HDFS-8835: --- There is a lot of past precedent for doing refactors

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649960#comment-14649960 ] Hadoop QA commented on HDFS-6860: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648802#comment-14648802 ] Li Bo commented on HDFS-8838: - hi, Nicholas I think you can commit your patch first and I will

[jira] [Created] (HDFS-8840) Inconsistent log level practice

songwanging created HDFS-8840: - Summary: Inconsistent log level practice Key: HDFS-8840 URL: https://issues.apache.org/jira/browse/HDFS-8840 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-8842) Catch throwable

songwanging created HDFS-8842: - Summary: Catch throwable Key: HDFS-8842 URL: https://issues.apache.org/jira/browse/HDFS-8842 Project: Hadoop HDFS Issue Type: Bug Reporter:

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648840#comment-14648840 ] Akira AJISAKA commented on HDFS-6682: - bq. We have many ways to know about namenode

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size with INodeFile and eliminate EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648858#comment-14648858 ] Zhe Zhang commented on HDFS-8833: - Thanks for the discussions guys! [~walter.k.su] Good

[jira] [Created] (HDFS-8841) Catch throwable return null

songwanging created HDFS-8841: - Summary: Catch throwable return null Key: HDFS-8841 URL: https://issues.apache.org/jira/browse/HDFS-8841 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648825#comment-14648825 ] Jagadesh Kiran N commented on HDFS-8784: Hi [~kanaka] as discussed iam assigning

[jira] [Commented] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

[ https://issues.apache.org/jira/browse/HDFS-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649131#comment-14649131 ] Hudson commented on HDFS-7192: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See

[jira] [Commented] (HDFS-8821) Explain message Operation category X is not supported in state standby

[ https://issues.apache.org/jira/browse/HDFS-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649130#comment-14649130 ] Hudson commented on HDFS-8821: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See

[jira] [Created] (HDFS-8847) change TestHDFSContractAppend to not override testRenameFileBeingAppended method.

zhihai xu created HDFS-8847: --- Summary: change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Key: HDFS-8847 URL: https://issues.apache.org/jira/browse/HDFS-8847 Project: Hadoop

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650141#comment-14650141 ] He Tianyi commented on HDFS-8829: - Hi kanaka kumar avvaru, I've applied the improvement to

[jira] [Updated] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8245: --- Labels: 2.6.1-candidate BB2015-05-TBR (was: BB2015-05-TBR) Standby namenode doesn't process

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-7980: --- Labels: 2.6.1-candidate (was: ) Incremental BlockReport will dramatically slow down the startup of

[jira] [Commented] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649970#comment-14649970 ] Xiaoyu Yao commented on HDFS-6860: -- Jenkins results: * No unit test added because this is

[jira] [Updated] (HDFS-8404) Pending block replication can get stuck using older genstamp

[ https://issues.apache.org/jira/browse/HDFS-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8404: --- Labels: 2.6.1-candidate (was: ) Pending block replication can get stuck using older genstamp

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650013#comment-14650013 ] Zhe Zhang commented on HDFS-8823: - Thanks Haohui for the pointers; they are very helpful.

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649980#comment-14649980 ] Zhe Zhang commented on HDFS-8827: - Thanks for identifying the problem Fukudome-san! I took

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650001#comment-14650001 ] Hadoop QA commented on HDFS-8845: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8399) Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649968#comment-14649968 ] Zhe Zhang commented on HDFS-8399: - Thanks for the work Rakesh! The added test looks a

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8486: --- Labels: 2.6.1-candidate (was: ) DN startup may cause severe data loss

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650017#comment-14650017 ] Tsz Wo Nicholas Sze commented on HDFS-8804: --- Some comments on the patch: - Should

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: h8838_20150731.patch Tolerate datanode failures in DFSStripedOutputStream

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649875#comment-14649875 ] Zhe Zhang commented on HDFS-8480: - Thanks for the discussion Ming and Colin! I created

  1   2   >