[jira] [Commented] (HDFS-7446) HDFS inotify should have the ability to determine what txid it has read up to

[ https://issues.apache.org/jira/browse/HDFS-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700274#comment-14700274 ] Colin Patrick McCabe commented on HDFS-7446: I would like to see this

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699337#comment-14699337 ] Rakesh R commented on HDFS-8897: Hi [~Alexandre LINTE], Thanks for reporting this. Jira

[jira] [Commented] (HDFS-8713) Convert DatanodeDescriptor to use SLF4J logging

[ https://issues.apache.org/jira/browse/HDFS-8713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699358#comment-14699358 ] Hadoop QA commented on HDFS-8713: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699454#comment-14699454 ] Rakesh R commented on HDFS-8897: I could see hdfs://sandbox appears two times

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8845: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Attachment: HDFS-8833-HDFS-7285-merge.01.patch Updating the patch to: # Remove all references of

[jira] [Commented] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

[ https://issues.apache.org/jira/browse/HDFS-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700478#comment-14700478 ] Hadoop QA commented on HDFS-8908: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8911: --- Status: Patch Available (was: Open) NameNode Metric : Add WAL counters as a JMX metric

[jira] [Updated] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8911: --- Attachment: HDFS-8911.001.patch Adds TotalSyncCount and TotalSyncTimes metrics to NameNodeMetrics

[jira] [Commented] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700522#comment-14700522 ] Hadoop QA commented on HDFS-8278: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700530#comment-14700530 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8862) Improve BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700560#comment-14700560 ] Yi Liu commented on HDFS-8862: -- Thanks [~cmccabe] for the review. Will commit the patch later.

[jira] [Updated] (HDFS-8862) BlockManager#excessReplicateMap should use a HashMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8862: - Summary: BlockManager#excessReplicateMap should use a HashMap (was: Improve BlockManager#excessReplicateMap)

[jira] [Commented] (HDFS-8912) Implement ShrinkableHashMap extends java HashMap and use properly

[ https://issues.apache.org/jira/browse/HDFS-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700620#comment-14700620 ] Yi Liu commented on HDFS-8912: -- Hi [~cmccabe], how do you think about it? Thanks. Implement

[jira] [Commented] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700485#comment-14700485 ] Arpit Agarwal commented on HDFS-8911: - +1 pending Jenkins. NameNode Metric : Add WAL

[jira] [Commented] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700500#comment-14700500 ] Andrew Wang commented on HDFS-8911: --- This is a small correction, but the edit log is

[jira] [Updated] (HDFS-8862) BlockManager#excessReplicateMap should use a HashMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8862: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-8826) Balancer may not move blocks efficiently in some cases

[ https://issues.apache.org/jira/browse/HDFS-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700575#comment-14700575 ] Arpit Agarwal commented on HDFS-8826: - +1 for the patch. The test failures look

[jira] [Updated] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8278: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700457#comment-14700457 ] Jitendra Nath Pandey commented on HDFS-8880: +1 NameNode metrics logging

[jira] [Commented] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700527#comment-14700527 ] Andrew Wang commented on HDFS-8895: --- Quite some flakes but they all passed for me

[jira] [Updated] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8895: -- Resolution: Fixed Fix Version/s: 3.0.0 Release Note: This removes the deprecated

[jira] [Commented] (HDFS-8862) BlockManager#excessReplicateMap should use a HashMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700577#comment-14700577 ] Yi Liu commented on HDFS-8862: -- One more discussion, do you think it's worth to extend java

[jira] [Commented] (HDFS-8826) Balancer may not move blocks efficiently in some cases

[ https://issues.apache.org/jira/browse/HDFS-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700576#comment-14700576 ] Arpit Agarwal commented on HDFS-8826: - Also it may be a good idea to add a separate

[jira] [Commented] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700380#comment-14700380 ] Hadoop QA commented on HDFS-8895: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700454#comment-14700454 ] Zhe Zhang commented on HDFS-8833: - [~jingzhao] [~walter.k.su] [~andrew.wang] Thanks for the

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700456#comment-14700456 ] Zhe Zhang commented on HDFS-8909: - [~jingzhao] I just realized we said {{HDFS-7285-rebase}}

[jira] [Commented] (HDFS-8792) BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory

[ https://issues.apache.org/jira/browse/HDFS-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700543#comment-14700543 ] Yi Liu commented on HDFS-8792: -- Thanks [~cmccabe] for the review and commit!

[jira] [Updated] (HDFS-8912) Implement ShrinkableHashMap extends java HashMap and use properly

[ https://issues.apache.org/jira/browse/HDFS-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8912: - Description: Currently {{LightWeightHashSet}} and {{LightWeightLinkedSet}} are used in hdfs, there are two

[jira] [Commented] (HDFS-8792) BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory

[ https://issues.apache.org/jira/browse/HDFS-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700333#comment-14700333 ] Hudson commented on HDFS-8792: -- FAILURE: Integrated in Hadoop-trunk-Commit #8314 (See

[jira] [Updated] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8845: --- Summary: DiskChecker should not traverse the entire tree (was: DiskChecker should not

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700353#comment-14700353 ] Andrew Wang commented on HDFS-8845: --- Yea sounds good to me too, Colin explained to me

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700556#comment-14700556 ] Walter Su commented on HDFS-8909: - I'm afraid the patch makes the earlier branch commits

[jira] [Commented] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700606#comment-14700606 ] Hudson commented on HDFS-8880: -- FAILURE: Integrated in Hadoop-trunk-Commit #8315 (See

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700604#comment-14700604 ] Hudson commented on HDFS-8845: -- FAILURE: Integrated in Hadoop-trunk-Commit #8315 (See

[jira] [Commented] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700607#comment-14700607 ] Hudson commented on HDFS-8278: -- FAILURE: Integrated in Hadoop-trunk-Commit #8315 (See

[jira] [Commented] (HDFS-8862) BlockManager#excessReplicateMap should use a HashMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700603#comment-14700603 ] Hudson commented on HDFS-8862: -- FAILURE: Integrated in Hadoop-trunk-Commit #8315 (See

[jira] [Commented] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700605#comment-14700605 ] Hudson commented on HDFS-8895: -- FAILURE: Integrated in Hadoop-trunk-Commit #8315 (See

[jira] [Commented] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

[ https://issues.apache.org/jira/browse/HDFS-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700325#comment-14700325 ] Hadoop QA commented on HDFS-8908: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700503#comment-14700503 ] Anu Engineer commented on HDFS-8911: [~andrew.wang] Thanks for letting me know. I will

[jira] [Updated] (HDFS-8911) NameNode Metric : Add Editlog counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8911: --- Summary: NameNode Metric : Add Editlog counters as a JMX metric (was: NameNode Metric : Add WAL

[jira] [Updated] (HDFS-8911) NameNode Metric : Add Editlog counters as a JMX metric

[ https://issues.apache.org/jira/browse/HDFS-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8911: --- Description: Today we log editlog metrics in the log. This JIRA proposes to expose those metrics via

[jira] [Comment Edited] (HDFS-8862) BlockManager#excessReplicateMap should use a HashMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700577#comment-14700577 ] Yi Liu edited comment on HDFS-8862 at 8/18/15 1:39 AM: --- One more

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700610#comment-14700610 ] Walter Su commented on HDFS-8909: - bq. Instead of keeping doing git rebase, maybe we should

[jira] [Created] (HDFS-8912) Implement ShrinkableHashMap extends java HashMap and use properly

Yi Liu created HDFS-8912: Summary: Implement ShrinkableHashMap extends java HashMap and use properly Key: HDFS-8912 URL: https://issues.apache.org/jira/browse/HDFS-8912 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700639#comment-14700639 ] Hadoop QA commented on HDFS-8823: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8862) Improve BlockManager#excessReplicateMap

[ https://issues.apache.org/jira/browse/HDFS-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700352#comment-14700352 ] Colin Patrick McCabe commented on HDFS-8862: I guess the set of datanodes is

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700361#comment-14700361 ] Colin Patrick McCabe commented on HDFS-8846: Hi [~zhz], It seems that you left

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Status: Open (was: Patch Available) createNonRecursive support needed in WebHdfsFileSystem to support

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700589#comment-14700589 ] Jing Zhao commented on HDFS-8909: - Instead of keeping doing git rebase, maybe we should

[jira] [Created] (HDFS-8911) NameNode Metric : Add WAL counters as a JMX metric

Anu Engineer created HDFS-8911: -- Summary: NameNode Metric : Add WAL counters as a JMX metric Key: HDFS-8911 URL: https://issues.apache.org/jira/browse/HDFS-8911 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8846: Attachment: HDFS-8846.01.patch Thanks for the good catch Colin! Updating the patch with the binary diff.

[jira] [Commented] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700481#comment-14700481 ] Jing Zhao commented on HDFS-8909: - I think maybe to save us time from now on we can use git

[jira] [Updated] (HDFS-8909) Erasure coding: update BlockInfoContiguousUC and BlockInfoStripedUC to use BlockUnderConstructionFeature

[ https://issues.apache.org/jira/browse/HDFS-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8909: Attachment: HDFS-8909.000.patch Patch against HDFS-7285-REBASE branch. Erasure coding: update

[jira] [Updated] (HDFS-8880) NameNode metrics logging

[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Target

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Attachment: HDFS-8435.004.patch Fixed javadoc and whitespace complaints. Unfortunately, as we're adding

[jira] [Updated] (HDFS-8435) createNonRecursive support needed in WebHdfsFileSystem to support HBase

[ https://issues.apache.org/jira/browse/HDFS-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8435: -- Status: Patch Available (was: Open) createNonRecursive support needed in WebHdfsFileSystem to support

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Summary: Use ByteBuffer in striping positional read (was: Use ByteBuffer/DirectByteBuffer in striping

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699538#comment-14699538 ] LINTE commented on HDFS-8897: - Thank you for your attention. In fact the balancer seems to look

[jira] [Created] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

Kai Zheng created HDFS-8905: --- Summary: Refactor DFSInputStream#ReaderStrategy Key: HDFS-8905 URL: https://issues.apache.org/jira/browse/HDFS-8905 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699582#comment-14699582 ] Kai Zheng commented on HDFS-8902: - Thanks [~hitliuyi] for the pointer! I didn't notice

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699488#comment-14699488 ] LINTE commented on HDFS-8897: - Hi, Below a part of hdfs-site.xml, namenode HA is used, maybe

[jira] [Created] (HDFS-8904) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping recovery on DataNode side

Kai Zheng created HDFS-8904: --- Summary: Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping recovery on DataNode side Key: HDFS-8904 URL:

[jira] [Updated] (HDFS-8907) Configurable striping read buffer threhold

[ https://issues.apache.org/jira/browse/HDFS-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8907: Description: In striping input stream, positional read merges all the possible strips together, while

[jira] [Created] (HDFS-8907) Configurable striping read buffer threhold

Kai Zheng created HDFS-8907: --- Summary: Configurable striping read buffer threhold Key: HDFS-8907 URL: https://issues.apache.org/jira/browse/HDFS-8907 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Comment Edited] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699579#comment-14699579 ] Yi Liu edited comment on HDFS-8902 at 8/17/15 2:15 PM: --- Kai,

[jira] [Commented] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699602#comment-14699602 ] Kai Zheng commented on HDFS-8902: - Thank you! Yes HDFS-8668 looks great to contain all the

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Description: Native erasure coder prefers to direct ByteBuffer for performance consideration. To prepare for

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8668: - Assignee: Kai Zheng (was: Yi Liu) Erasure Coding: revisit buffer used for encoding and decoding.

[jira] [Commented] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699587#comment-14699587 ] Yi Liu commented on HDFS-8902: -- Sure, I just assigned it to you, thanks for working on it.

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699599#comment-14699599 ] Kai Zheng commented on HDFS-8668: - Thanks [~hitliuyi] for the issue and assigning it to me.

[jira] [Commented] (HDFS-8897) Loadbalancer always exits with : java.io.IOException: Another Balancer is running.. Exiting ...

[ https://issues.apache.org/jira/browse/HDFS-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699513#comment-14699513 ] Rakesh R commented on HDFS-8897: My observation about the case is - Balancer is seeing two

[jira] [Created] (HDFS-8901) Use ByteBuffer/DirectByteBuffer in striping positional read

Kai Zheng created HDFS-8901: --- Summary: Use ByteBuffer/DirectByteBuffer in striping positional read Key: HDFS-8901 URL: https://issues.apache.org/jira/browse/HDFS-8901 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

Kai Zheng created HDFS-8902: --- Summary: Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful) Key: HDFS-8902 URL:

[jira] [Created] (HDFS-8903) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping write

Kai Zheng created HDFS-8903: --- Summary: Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping write Key: HDFS-8903 URL: https://issues.apache.org/jira/browse/HDFS-8903

[jira] [Commented] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699579#comment-14699579 ] Yi Liu commented on HDFS-8902: -- Kai, HDFS-8668 will handle the java bytebuffer and direct

[jira] [Commented] (HDFS-8705) BlockStoragePolicySuite uses equalsIgnoreCase for name lookup, won't work in all locales

[ https://issues.apache.org/jira/browse/HDFS-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699478#comment-14699478 ] Walter Su commented on HDFS-8705: - You can use {{StringUtils.toLowerCase(String)}} instead.

[jira] [Created] (HDFS-8906) Non Authenticated Data node Allowed to Join HDFS

John J. Howard created HDFS-8906: Summary: Non Authenticated Data node Allowed to Join HDFS Key: HDFS-8906 URL: https://issues.apache.org/jira/browse/HDFS-8906 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700751#comment-14700751 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8846) Create edit log files with old layout version for upgrade testing

[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14700746#comment-14700746 ] Hadoop QA commented on HDFS-8846: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8906) Non Authenticated Data node Allowed to Join HDFS

[ https://issues.apache.org/jira/browse/HDFS-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699627#comment-14699627 ] Allen Wittenauer commented on HDFS-8906: Hadoop 0.20.2 had no (real) security

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699664#comment-14699664 ] Yongjun Zhang commented on HDFS-8828: - Hi [~jingzhao], Thanks for the review and good

[jira] [Commented] (HDFS-8713) Convert DatanodeDescriptor to use SLF4J logging

[ https://issues.apache.org/jira/browse/HDFS-8713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699845#comment-14699845 ] Andrew Wang commented on HDFS-8713: --- Thanks for reminding me about this one Yi, I ran the

[jira] [Created] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

Tsz Wo Nicholas Sze created HDFS-8908: - Summary: TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode Key: HDFS-8908 URL: https://issues.apache.org/jira/browse/HDFS-8908

[jira] [Updated] (HDFS-8713) Convert DatanodeDescriptor to use SLF4J logging

[ https://issues.apache.org/jira/browse/HDFS-8713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8713: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-8895) Remove deprecated BlockStorageLocation APIs

[ https://issues.apache.org/jira/browse/HDFS-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699899#comment-14699899 ] Andrew Wang commented on HDFS-8895: --- Kicking a rebuild since Jenkins ate the test output

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699910#comment-14699910 ] Jing Zhao commented on HDFS-8833: - Yes, a conversion tool can be helpful. Erasure coding:

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699916#comment-14699916 ] Zhe Zhang commented on HDFS-7285: - [~vinayrpet] Sure, let's solicit more feedback. Your

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699926#comment-14699926 ] kanaka kumar avvaru commented on HDFS-6955: --- Updated patch for white space errors

[jira] [Updated] (HDFS-6407) Add sorting and pagination in the datanode tab of the NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6407: - Issue Type: Improvement (was: Bug) Add sorting and pagination in the datanode tab of the NN Web UI

[jira] [Updated] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8278: -- Attachment: h8278_20150817.patch h8278_20150817.patch: counts only the storage with

[jira] [Updated] (HDFS-8883) NameNode Metrics : Add FSNameSystem lock Queue Length

[ https://issues.apache.org/jira/browse/HDFS-8883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8883: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

[ https://issues.apache.org/jira/browse/HDFS-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8908: -- Attachment: h8908_20150817.patch TestAppendSnapshotTruncate may fail with IOException:

[jira] [Commented] (HDFS-8801) Convert BlockInfoUnderConstruction as a feature

[ https://issues.apache.org/jira/browse/HDFS-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699936#comment-14699936 ] Haohui Mai commented on HDFS-8801: -- The current approach requires exposing

[jira] [Updated] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

[ https://issues.apache.org/jira/browse/HDFS-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8908: -- Attachment: (was: h8908_20150817.patch) TestAppendSnapshotTruncate may fail with

[jira] [Commented] (HDFS-6407) new namenode UI, lost ability to sort columns in datanode tab

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699893#comment-14699893 ] Benoy Antony commented on HDFS-6407: It will be good to specify the version information

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699906#comment-14699906 ] Zhe Zhang commented on HDFS-7285: - Thanks Walter for the questions. bq. Will you rebase

[jira] [Updated] (HDFS-6407) Add sorting and pagination in the datanode tab of the NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6407: - Summary: Add sorting and pagination in the datanode tab of the NN Web UI (was: new namenode UI, lost

[jira] [Updated] (HDFS-6407) Add sorting and pagination in the datanode tab of the NN Web UI

[ https://issues.apache.org/jira/browse/HDFS-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6407: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8908) TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode

[ https://issues.apache.org/jira/browse/HDFS-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8908: -- Status: Patch Available (was: Open) TestAppendSnapshotTruncate may fail with

  1   2   >