[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653438#comment-14653438 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #277 (See

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653445#comment-14653445 ] Hadoop QA commented on HDFS-8762: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Status: Open (was: Patch Available) Tolerate datanode failures in DFSStripedOutputStream when the data

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Attachment: h8838_20150731.log The Jenkins is broken. I ran the tests locally. Please check the attached

[jira] [Updated] (HDFS-8413) Directories are not listed recursively when fs.defaultFs is viewFs

[ https://issues.apache.org/jira/browse/HDFS-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated HDFS-8413: -- Status: Open (was: Patch Available) Directories are not listed recursively when fs.defaultFs is viewFs

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653709#comment-14653709 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2223 (See

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653161#comment-14653161 ] Zhe Zhang commented on HDFS-8833: - Thanks Andrew for the suggestion. I think

[jira] [Updated] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8704: Attachment: HDFS-8704-HDFS-7285-005.patch Erasure Coding: client fails to write large file when one datanode fails

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Attachment: h8838_20150731-HDFS-7285.patch LGTM. +1. Upload the same patch for [~szetszwo] to trigger

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653164#comment-14653164 ] kanaka kumar avvaru commented on HDFS-8829: --- Hi [~He Tianyi], similar

[jira] [Resolved] (HDFS-8574) When block count for a volume exceeds dfs.blockreport.split.threshold, block report causes exception

[ https://issues.apache.org/jira/browse/HDFS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S resolved HDFS-8574. --- Resolution: Not A Problem When block count for a volume exceeds dfs.blockreport.split.threshold, block

[jira] [Created] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

Rakesh R created HDFS-8853: -- Summary: Erasure Coding: Provide ECSchema validation when creating ECZone Key: HDFS-8853 URL: https://issues.apache.org/jira/browse/HDFS-8853 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653147#comment-14653147 ] Ajith S commented on HDFS-8693: --- Hi [~kihwal] I tested with federated HA cluster when adding

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653156#comment-14653156 ] Hadoop QA commented on HDFS-8838: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653136#comment-14653136 ] Li Bo commented on HDFS-8838: - hi, [~walter.k.su] and [~szetszwo], could you help me review the

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8838: Status: Patch Available (was: Open) Tolerate datanode failures in DFSStripedOutputStream when the data

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285-10.patch Erasure Coding: StripedDataStreamer fails to handle the

[jira] [Assigned] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reassigned HDFS-8693: - Assignee: Ajith S refreshNamenodes does not support adding a new standby to a running DN

[jira] [Commented] (HDFS-8693) refreshNamenodes does not support adding a new standby to a running DN

[ https://issues.apache.org/jira/browse/HDFS-8693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653150#comment-14653150 ] Ajith S commented on HDFS-8693: --- Hi [~john.jian.fang] and [~kihwal] Agreed, need to fix

[jira] [Commented] (HDFS-8574) When block count for a volume exceeds dfs.blockreport.split.threshold, block report causes exception

[ https://issues.apache.org/jira/browse/HDFS-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653196#comment-14653196 ] Ajith S commented on HDFS-8574: --- Closing this issue as per comments When block count for a

[jira] [Commented] (HDFS-8663) sys cpu usage high on namenode server

[ https://issues.apache.org/jira/browse/HDFS-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653114#comment-14653114 ] tangjunjie commented on HDFS-8663: -- For HDFS, the mapping of users to groups is performed

[jira] [Assigned] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-8853: -- Assignee: Rakesh R Erasure Coding: Provide ECSchema validation when creating ECZone

[jira] [Updated] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8853: --- Assignee: J.Andreina (was: Rakesh R) Erasure Coding: Provide ECSchema validation when creating ECZone

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653155#comment-14653155 ] Rakesh R commented on HDFS-8220: Thanks [~szetszwo], [~walter.k.su]. Attached another patch

[jira] [Commented] (HDFS-8851) datanode fails to start due to a bad disk

[ https://issues.apache.org/jira/browse/HDFS-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653205#comment-14653205 ] Wang Hao commented on HDFS-8851: data12 is the bad disk [hadoop@hadoop070 data12]$ ll ls:

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653256#comment-14653256 ] Hadoop QA commented on HDFS-8704: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8854) Erasure coding: Move cellSize inside ECSchema

[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653252#comment-14653252 ] Walter Su commented on HDFS-8854: - In the world of HDFS, cellSize always goes around with

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653299#comment-14653299 ] Li Bo commented on HDFS-8762: - Move this jira from HDFS-8031 to HDFS-7285. Because there're 9

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1465#comment-1465 ] Li Bo commented on HDFS-8762: - hi, [~zhz] The Jenkins test of HDFS-8704 fails, but I can't

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653356#comment-14653356 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8704) Erasure Coding: client fails to write large file when one datanode fails

[ https://issues.apache.org/jira/browse/HDFS-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653392#comment-14653392 ] Hadoop QA commented on HDFS-8704: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653492#comment-14653492 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1007 (See

[jira] [Updated] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8762: Parent Issue: HDFS-7285 (was: HDFS-8031) Erasure Coding: the log of each streamer should show its index

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653635#comment-14653635 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2204 (See

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653756#comment-14653756 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #266 (See

[jira] [Created] (HDFS-8854) Erasure coding: Move cellSize inside ECSchema

Walter Su created HDFS-8854: --- Summary: Erasure coding: Move cellSize inside ECSchema Key: HDFS-8854 URL: https://issues.apache.org/jira/browse/HDFS-8854 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653242#comment-14653242 ] Yi Liu commented on HDFS-8850: -- Test failure is unrelated. Committed to trunk and branch-2.

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653253#comment-14653253 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-trunk-Commit #8259 (See

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8850: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8762: Attachment: HDFS-8762-HDFS-7285-002.patch Erasure Coding: the log of each streamer should show its index

[jira] [Updated] (HDFS-1148) Convert FSDataset to ReadWriteLock

[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-1148: - Attachment: HDFS-1148.001.patch First new path Convert FSDataset to ReadWriteLock

[jira] [Commented] (HDFS-8775) SASL support for data transfer protocol in libhdfspp

[ https://issues.apache.org/jira/browse/HDFS-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653801#comment-14653801 ] James Clampffer commented on HDFS-8775: --- I'm still learning more about the actual

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Attachment: h8838_20150804.patch h8838_20150804.patch: reverts MiniDFSCluster change and

[jira] [Created] (HDFS-8856) Make LeaseManager#countPath O(1)

Arpit Agarwal created HDFS-8856: --- Summary: Make LeaseManager#countPath O(1) Key: HDFS-8856 URL: https://issues.apache.org/jira/browse/HDFS-8856 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8856) Make LeaseManager#countPath O(1)

[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8856: Status: Patch Available (was: Open) Make LeaseManager#countPath O(1)

[jira] [Updated] (HDFS-8856) Make LeaseManager#countPath O(1)

[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8856: Attachment: HDFS-8856.01.patch Also remove redundant call to {{getNumUnderConstructionBlocks}} on

[jira] [Updated] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8838: -- Status: Patch Available (was: Open) Tolerate datanode failures in

[jira] [Updated] (HDFS-8772) fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8772: Attachment: HDFS-8772.04.patch And I'm pretty sure waitFor 3s is enough. TestProcessCorruptBlocks even sleep

[jira] [Commented] (HDFS-7865) NullPointerException in SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654775#comment-14654775 ] Brahma Reddy Battula commented on HDFS-7865: HDFS-7990 had fixed this issue..

[jira] [Commented] (HDFS-8772) fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654669#comment-14654669 ] Brahma Reddy Battula commented on HDFS-8772: Actual testcase may cost 4.4 sec,

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654707#comment-14654707 ] Takuya Fukudome commented on HDFS-8827: --- Could you check surefire-reports log files

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654706#comment-14654706 ] Allen Wittenauer commented on HDFS-8849: bq. If a DN then goes offline that was

[jira] [Updated] (HDFS-1148) Convert FSDataset to ReadWriteLock

[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang updated HDFS-1148: - Status: Patch Available (was: Open) Convert FSDataset to ReadWriteLock

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654360#comment-14654360 ] Chris Trezzo commented on HDFS-8127: Note that this patch uses the checkNNStartup()

[jira] [Commented] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

[ https://issues.apache.org/jira/browse/HDFS-8550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654475#comment-14654475 ] Zhe Zhang commented on HDFS-8550: - Please use this [link |

[jira] [Commented] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654529#comment-14654529 ] Chris Trezzo commented on HDFS-3443: Note: Even though this is listed as a

[jira] [Updated] (HDFS-3443) Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer

[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-3443: Labels: (was: 2.6.1-candidate) Fix NPE when namenode transition to active during startup by

[jira] [Commented] (HDFS-8127) NameNode Failover during HA upgrade can cause DataNode to finalize upgrade

[ https://issues.apache.org/jira/browse/HDFS-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654363#comment-14654363 ] Chris Trezzo commented on HDFS-8127: (for backport to 2.6 branch) NameNode Failover

[jira] [Updated] (HDFS-8399) Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8399: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654426#comment-14654426 ] Nathan Roberts commented on HDFS-8791: -- My preference would be to take a smaller

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654521#comment-14654521 ] Zhe Zhang commented on HDFS-8833: - Please note that HDFS-8854 has been created to tackle

[jira] [Commented] (HDFS-8804) Erasure Coding: use DirectBufferPool in DFSStripedInputStream for buffer allocation

[ https://issues.apache.org/jira/browse/HDFS-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654496#comment-14654496 ] Zhe Zhang commented on HDFS-8804: - Thanks Jing, sounds good to me. I'll try to do a

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654793#comment-14654793 ] Walter Su commented on HDFS-8827: - I saw the NPE and AssertionError. It's not a bug in NN

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654807#comment-14654807 ] Surendra Singh Lilhore commented on HDFS-8815: -- [~vinayrpet] and

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654834#comment-14654834 ] Walter Su commented on HDFS-8827: - DFSTestUtil.createStripedFile(..) is used earlier

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654838#comment-14654838 ] Vinayakumar B commented on HDFS-8815: - Just one nit, {{ private BlockStoragePolicy[]

[jira] [Created] (HDFS-8857) Erasure Coding: Fix ArrayIndexOutOfBoundsException in TestWriteStripedFileWithFailure

Li Bo created HDFS-8857: --- Summary: Erasure Coding: Fix ArrayIndexOutOfBoundsException in TestWriteStripedFileWithFailure Key: HDFS-8857 URL: https://issues.apache.org/jira/browse/HDFS-8857 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8857) Erasure Coding: Fix ArrayIndexOutOfBoundsException in TestWriteStripedFileWithFailure

[ https://issues.apache.org/jira/browse/HDFS-8857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8857: Attachment: HDFS-8857-HDFS-7285-001.patch Erasure Coding: Fix ArrayIndexOutOfBoundsException in

[jira] [Updated] (HDFS-8857) Erasure Coding: Fix ArrayIndexOutOfBoundsException in TestWriteStripedFileWithFailure

[ https://issues.apache.org/jira/browse/HDFS-8857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8857: Status: Patch Available (was: Open) Erasure Coding: Fix ArrayIndexOutOfBoundsException in

[jira] [Updated] (HDFS-8852) HDFS architecture documentation of version 2.x is outdated about append write support

[ https://issues.apache.org/jira/browse/HDFS-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8852: Labels: newbie (was: ) HDFS architecture documentation of version 2.x is outdated about append

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653974#comment-14653974 ] Nathan Roberts commented on HDFS-8791: -- Curious what folks would think about going

[jira] [Updated] (HDFS-7533) Datanode sometimes does not shutdown on receiving upgrade shutdown command

[ https://issues.apache.org/jira/browse/HDFS-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-7533: --- Attachment: HDFS-7533-branch-2.6-v1.patch Attached is a patch for branch 2.6. This was a trivial

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654141#comment-14654141 ] Andrew Wang commented on HDFS-8747: --- Hi Xiaoyu, Regarding snapshots, the idea would be

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653930#comment-14653930 ] Hudson commented on HDFS-8850: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #274 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654107#comment-14654107 ] Bob Hansen commented on HDFS-8855: -- Reproducer script: {code} #!/bin/bash # Check that

[jira] [Created] (HDFS-8855) Webhdfs client leaks active NameNode connections

Bob Hansen created HDFS-8855: Summary: Webhdfs client leaks active NameNode connections Key: HDFS-8855 URL: https://issues.apache.org/jira/browse/HDFS-8855 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8486: Attachment: HDFS-8486-branch-2.6.patch Patch for branch-2.6. Can someone familiar with the original

[jira] [Updated] (HDFS-8486) DN startup may cause severe data loss

[ https://issues.apache.org/jira/browse/HDFS-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8486: Attachment: HDFS-8486-branch-2.6.02.patch DN startup may cause severe data loss

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654086#comment-14654086 ] Xiaoyu Yao commented on HDFS-8747: -- Thanks [~andrew.wang] and [~hitliuyi] for providing

[jira] [Updated] (HDFS-8643) Add snapshot names list to SnapshottableDirectoryStatus

[ https://issues.apache.org/jira/browse/HDFS-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8643: --- Target Version/s: 2.8.0 Add snapshot names list to SnapshottableDirectoryStatus

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8270: --- Attachment: HDFS-8270-branch-2.6-v3.patch Branch 2.6 patch attached. This was a trivial backport from

[jira] [Commented] (HDFS-8844) TestHDFSCLI does not cleanup the test directory

[ https://issues.apache.org/jira/browse/HDFS-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654197#comment-14654197 ] Colin Patrick McCabe commented on HDFS-8844: +1. Thanks, [~iwasakims].

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654210#comment-14654210 ] Bob Hansen commented on HDFS-8696: -- Still seeing some periodic slowdowns. Could be

[jira] [Commented] (HDFS-8829) DataNode sets SO_RCVBUF explicitly is disabling tcp auto-tuning

[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654211#comment-14654211 ] Colin Patrick McCabe commented on HDFS-8829: Why not add a configuration option

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654206#comment-14654206 ] Bob Hansen commented on HDFS-8855: -- Note: to exacerbate the test-case set the environment

[jira] [Updated] (HDFS-8842) Catch throwable

[ https://issues.apache.org/jira/browse/HDFS-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8842: --- Target Version/s: 2.7.1, 2.5.2, 2.5.1, 2.7.0, 2.6.0 (was: 2.6.0, 2.7.0, 2.5.1, 2.5.2,

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654234#comment-14654234 ] Colin Patrick McCabe commented on HDFS-8791: The motivation behind the new

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654263#comment-14654263 ] Jun Yin commented on HDFS-8696: --- good catch, actually we use V3 which Xiaobing sent by email.

[jira] [Commented] (HDFS-8643) Add snapshot names list to SnapshottableDirectoryStatus

[ https://issues.apache.org/jira/browse/HDFS-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654334#comment-14654334 ] Xiaoyu Yao commented on HDFS-8643: -- Thanks [~rakeshr] for adding this. Patch LGTM. +1 One

[jira] [Updated] (HDFS-8844) TestHDFSCLI does not cleanup the test directory

[ https://issues.apache.org/jira/browse/HDFS-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8844: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654152#comment-14654152 ] Jun commented on HDFS-8696: --- Hi Xiaobing, from my test, we got some unexpected result with a

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654168#comment-14654168 ] Bob Hansen commented on HDFS-8696: -- Jun - thanks for posting those. Can you break down

[jira] [Commented] (HDFS-8762) Erasure Coding: the log of each streamer should show its index

[ https://issues.apache.org/jira/browse/HDFS-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654327#comment-14654327 ] Zhe Zhang commented on HDFS-8762: - Thanks Bo for the work and Walter for the comment. # I

[jira] [Commented] (HDFS-8844) TestHDFSCLI does not cleanup the test directory

[ https://issues.apache.org/jira/browse/HDFS-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654226#comment-14654226 ] Hudson commented on HDFS-8844: -- FAILURE: Integrated in Hadoop-trunk-Commit #8260 (See

[jira] [Commented] (HDFS-8772) fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654641#comment-14654641 ] Andrew Wang commented on HDFS-8772: --- LGTM, just one q, should we bump up the waitFor to

[jira] [Commented] (HDFS-8849) fsck should report number of missing blocks with replication factor 1

[ https://issues.apache.org/jira/browse/HDFS-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654647#comment-14654647 ] Aaron T. Myers commented on HDFS-8849: -- Allen, I've seen plenty of users who at some

[jira] [Commented] (HDFS-8838) Tolerate datanode failures in DFSStripedOutputStream when the data length is small

[ https://issues.apache.org/jira/browse/HDFS-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654654#comment-14654654 ] Tsz Wo Nicholas Sze commented on HDFS-8838: --- [~walter.k.su], thanks for running

[jira] [Resolved] (HDFS-7865) NullPointerException in SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-7865. Resolution: Implemented NullPointerException in SimulatedFSDataset

[jira] [Commented] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654509#comment-14654509 ] Zhe Zhang commented on HDFS-8827: - Thanks for adding the test [~tfukudom]. I ran the test

[jira] [Commented] (HDFS-8854) Erasure coding: Move cellSize inside ECSchema

[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654539#comment-14654539 ] Zhe Zhang commented on HDFS-8854: - Thanks Walter for taking this task. I think we need to

  1   2   >