[jira] [Commented] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662306#comment-14662306 ] Tsz Wo Nicholas Sze commented on HDFS-8876: --- Thanks for filing the JIRAs. I

[jira] [Updated] (HDFS-6860) BlockStateChange logs are too noisy

2015-08-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6860: - Attachment: HDFS-6860.branch-2.6.patch Attach a 2.6 patch that includes HDFS-6860 and slf4j changes

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Attachment: HDFS-8865.patch Improve quota initialization performance

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2015-08-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8865: - Status: Patch Available (was: Open) Improve quota initialization performance

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661839#comment-14661839 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #269 (See

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661840#comment-14661840 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #269 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661838#comment-14661838 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #269 (See

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661863#comment-14661863 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #277 (See

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661862#comment-14661862 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #277 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661861#comment-14661861 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #277 (See

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-07 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662327#comment-14662327 ] Nate Edel commented on HDFS-8078: - Separate from the question of a feature branch, here's

[jira] [Commented] (HDFS-8866) Typo in docs: Rumtime - Runtime

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662357#comment-14662357 ] Hudson commented on HDFS-8866: -- FAILURE: Integrated in Hadoop-trunk-Commit #8279 (See

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2015-08-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662585#comment-14662585 ] Xiaoyu Yao commented on HDFS-8865: -- [~kihwal], thanks for working on this improvement work

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661402#comment-14661402 ] Zhe Zhang commented on HDFS-8854: - Thanks for the update Walter! In the interest of time I

[jira] [Updated] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7285: Attachment: Consolidated-20150806.patch We have revisited the {{BlockInfo}} structure and reverted

[jira] [Updated] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Status: Patch Available (was: In Progress) Improve DataNode (ReplicaMap) memory footprint to save about 45%

[jira] [Updated] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8859: - Attachment: HDFS-8859.001.patch Improve DataNode (ReplicaMap) memory footprint to save about 45%

[jira] [Comment Edited] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661499#comment-14661499 ] Yi Liu edited comment on HDFS-8859 at 8/7/15 8:31 AM: --

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661552#comment-14661552 ] Hadoop QA commented on HDFS-8854: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661421#comment-14661421 ] Hadoop QA commented on HDFS-7285: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661499#comment-14661499 ] Yi Liu commented on HDFS-8859: -- {{LightWeightHashGSet}} implemented in patch is a low memory

[jira] [Commented] (HDFS-8643) Add snapshot names list to SnapshottableDirectoryStatus

2015-08-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661490#comment-14661490 ] Rakesh R commented on HDFS-8643: On a second look, I think I understood your comment

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661419#comment-14661419 ] Hadoop QA commented on HDFS-8854: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8772) Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661433#comment-14661433 ] Hadoop QA commented on HDFS-8772: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-07 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8854: Attachment: HDFS-8854-Consolidated-20150806.02.txt Erasure coding: add ECPolicy to replace schema+cellSize

[jira] [Commented] (HDFS-7601) Operations(e.g. balance) failed due to deficient configuration parsing

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661407#comment-14661407 ] Hadoop QA commented on HDFS-7601: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661630#comment-14661630 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #280 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661629#comment-14661629 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #280 (See

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661631#comment-14661631 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #280 (See

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661641#comment-14661641 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1010 (See

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661640#comment-14661640 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1010 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661639#comment-14661639 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1010 (See

[jira] [Commented] (HDFS-8852) HDFS architecture documentation of version 2.x is outdated about append write support

2015-08-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661679#comment-14661679 ] Ajith S commented on HDFS-8852: --- +1 will update accordingly. Thanks [~ajisakaa] HDFS

[jira] [Commented] (HDFS-8854) Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs

2015-08-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661600#comment-14661600 ] Rakesh R commented on HDFS-8854: Nice Work [~walter.k.su]! I've referred

[jira] [Commented] (HDFS-8784) BlockInfo#numNodes should be numStorages

2015-08-07 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661619#comment-14661619 ] Jagadesh Kiran N commented on HDFS-8784: hi [~arpitagarwal] , please review the

[jira] [Commented] (HDFS-8828) Utilize Snapshot diff report to build copy list in distcp

2015-08-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661976#comment-14661976 ] Yongjun Zhang commented on HDFS-8828: - Thanks [~yufeigu] for the new rev and

[jira] [Updated] (HDFS-8872) Reporting of missing blocks is different in fsck and namenode ui/metasave

2015-08-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8872: - Description: Namenode ui and metasave will not report a block as missing if the only replica is

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661914#comment-14661914 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2207 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661888#comment-14661888 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2226 (See

[jira] [Commented] (HDFS-8623) Refactor NameNode handling of invalid, corrupt, and under-recovery blocks

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661890#comment-14661890 ] Hudson commented on HDFS-8623: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2226 (See

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662021#comment-14662021 ] Hadoop QA commented on HDFS-8622: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8873) throttle directoryScanner

2015-08-07 Thread Nathan Roberts (JIRA)
Nathan Roberts created HDFS-8873: Summary: throttle directoryScanner Key: HDFS-8873 URL: https://issues.apache.org/jira/browse/HDFS-8873 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8827) Erasure Coding: Fix NPE when NameNode processes over-replicated striped blocks

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8827: Summary: Erasure Coding: Fix NPE when NameNode processes over-replicated striped blocks (was: Erasure

[jira] [Commented] (HDFS-8827) Erasure Coding: Fix NPE when NameNode processes over-replicated striped blocks

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662143#comment-14662143 ] Jing Zhao commented on HDFS-8827: - +1. I will commit it shortly. Erasure Coding: Fix NPE

[jira] [Updated] (HDFS-8866) Typo in docs: Rumtime - Runtime

2015-08-07 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-8866: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-08-07 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8874: - Summary: Add DN metrics for balancer and other block movement scenarios Key: HDFS-8874 URL: https://issues.apache.org/jira/browse/HDFS-8874 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

2015-08-07 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662136#comment-14662136 ] Surendra Singh Lilhore commented on HDFS-8815: -- Thanks [~vinayrpet] for

[jira] [Work started] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8875 started by Chris Trezzo. -- Optimize the wait time in Balancer for federation scenario

[jira] [Work started] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8876 started by Chris Trezzo. -- Make hard coded parameters used by balancer and other tools configurable

[jira] [Issue Comment Deleted] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8867: - Comment: was deleted (was: [~jinzhao]: daryn has a patch and he will upload on monday.) Enable optimized

[jira] [Commented] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662190#comment-14662190 ] Chris Trezzo commented on HDFS-8876: [~jingzhao] will do! Make hard coded parameters

[jira] [Updated] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8876: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Make hard coded parameters used by

[jira] [Issue Comment Deleted] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8867: Comment: was deleted (was: Cool, thanks!) Enable optimized block reports --

[jira] [Commented] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662231#comment-14662231 ] Chris Trezzo commented on HDFS-8875: [~mingma] Couple of thoughts about this issue: #

[jira] [Commented] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662244#comment-14662244 ] Ming Ma commented on HDFS-8875: --- bq. For the Collections.shuffle(connectors); call: I can see

[jira] [Created] (HDFS-8877) Allow bypassing some minor exceptions while loading editlog

2015-08-07 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8877: --- Summary: Allow bypassing some minor exceptions while loading editlog Key: HDFS-8877 URL: https://issues.apache.org/jira/browse/HDFS-8877 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8874: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Add DN metrics for balancer and

[jira] [Created] (HDFS-8878) An HDFS built-in DistCp

2015-08-07 Thread Linxiao Jin (JIRA)
Linxiao Jin created HDFS-8878: - Summary: An HDFS built-in DistCp Key: HDFS-8878 URL: https://issues.apache.org/jira/browse/HDFS-8878 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662250#comment-14662250 ] Chris Trezzo commented on HDFS-8875: bq. I thought the balancer is going to wait until

[jira] [Commented] (HDFS-8877) Allow bypassing some minor exceptions while loading editlog

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662259#comment-14662259 ] Jing Zhao commented on HDFS-8877: - Maybe a simple way as the first step can be: 1) to

[jira] [Created] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8876: - Summary: Make hard coded parameters used by balancer and other tools configurable Key: HDFS-8876 URL: https://issues.apache.org/jira/browse/HDFS-8876 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8875: --- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Optimize the wait time in Balancer

[jira] [Created] (HDFS-8875) Optimize the wait time in Balancer for federation scenario

2015-08-07 Thread Ming Ma (JIRA)
Ming Ma created HDFS-8875: - Summary: Optimize the wait time in Balancer for federation scenario Key: HDFS-8875 URL: https://issues.apache.org/jira/browse/HDFS-8875 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662198#comment-14662198 ] Rushabh S Shah commented on HDFS-8867: -- [~jingzhao]: Daryn has a patch and he will

[jira] [Updated] (HDFS-8772) Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

2015-08-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8772: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-8805) Archival Storage: getStoragePolicy should not need superuser privilege

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662129#comment-14662129 ] Jing Zhao commented on HDFS-8805: - Thanks for updating the patch, [~brahmareddy]! The new

[jira] [Work started] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8874 started by Chris Trezzo. -- Add DN metrics for balancer and other block movement scenarios

[jira] [Commented] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662169#comment-14662169 ] Jing Zhao commented on HDFS-8867: - Looks like the issue here is that

[jira] [Updated] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-08-07 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu updated HDFS-8750: --- Attachment: HDFS-8750.004.patch FIleSystem does not honor Configuration.getClassLoader() while loading

[jira] [Commented] (HDFS-8775) SASL support for data transfer protocol in libhdfspp

2015-08-07 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662123#comment-14662123 ] Bob Hansen commented on HDFS-8775: -- The lack of comments makes it very hard to verify that

[jira] [Commented] (HDFS-8775) SASL support for data transfer protocol in libhdfspp

2015-08-07 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662141#comment-14662141 ] Bob Hansen commented on HDFS-8775: -- In the tests, we need some negative tests: * How does

[jira] [Commented] (HDFS-8772) Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662178#comment-14662178 ] Hudson commented on HDFS-8772: -- FAILURE: Integrated in Hadoop-trunk-Commit #8278 (See

[jira] [Commented] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662177#comment-14662177 ] Jing Zhao commented on HDFS-8876: - Thanks for reporting the issue, Ming! Maybe we can move

[jira] [Commented] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662180#comment-14662180 ] Jing Zhao commented on HDFS-8867: - Cool, thanks! Enable optimized block reports

[jira] [Commented] (HDFS-8867) Enable optimized block reports

2015-08-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662176#comment-14662176 ] Rushabh S Shah commented on HDFS-8867: -- [~jinzhao]: daryn has a patch and he will

[jira] [Commented] (HDFS-8747) Provide Better Scratch Space and Soft Delete Support for HDFS Encryption Zones

2015-08-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662206#comment-14662206 ] Xiaoyu Yao commented on HDFS-8747: -- bq. Regarding nested encryption zones, one request

[jira] [Updated] (HDFS-8827) Erasure Coding: Fix NPE when NameNode processes over-replicated striped blocks

2015-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8827: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661889#comment-14661889 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2226 (See

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661913#comment-14661913 ] Hudson commented on HDFS-8499: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2207 (See

[jira] [Commented] (HDFS-8856) Make LeaseManager#countPath O(1)

2015-08-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661912#comment-14661912 ] Hudson commented on HDFS-8856: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2207 (See

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662349#comment-14662349 ] Hadoop QA commented on HDFS-8750: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-07 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: Open) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-07 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.11.patch HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-08-07 Thread Nate Edel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) HDFS client gets errors trying to to connect to IPv6 DataNode

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-08-07 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662366#comment-14662366 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- [~zhz], could you describe the git

[jira] [Assigned] (HDFS-8836) Skip newline on empty files with getMerge -nl

2015-08-07 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru reassigned HDFS-8836: - Assignee: kanaka kumar avvaru (was: Jagadesh Kiran N) Skip newline on empty

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewer

2015-08-07 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8622: --- Attachment: HDFS-8622-08.patch Hi [~ajisakaa] ,updated your comments.please review the patch

[jira] [Commented] (HDFS-8859) Improve DataNode (ReplicaMap) memory footprint to save about 45%

2015-08-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661761#comment-14661761 ] Hadoop QA commented on HDFS-8859: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8876) Make hard coded parameters used by balancer and other tools configurable

2015-08-07 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662631#comment-14662631 ] Chris Trezzo commented on HDFS-8876: Thanks [~szetszwo]. I will take a look at

[jira] [Assigned] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-8879: Assignee: Xiaoyu Yao Quota by storage type usage incorrectly initialized upon namenode restart

[jira] [Created] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-07 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8879: Summary: Quota by storage type usage incorrectly initialized upon namenode restart Key: HDFS-8879 URL: https://issues.apache.org/jira/browse/HDFS-8879 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8879: Reporter: Kihwal Lee (was: Xiaoyu Yao) Quota by storage type usage incorrectly initialized upon

[jira] [Created] (HDFS-8880) NameNode should periodically log metrics

2015-08-07 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-8880: --- Summary: NameNode should periodically log metrics Key: HDFS-8880 URL: https://issues.apache.org/jira/browse/HDFS-8880 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8880) NameNode metrics logging

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Summary: NameNode metrics logging (was: NameNode should periodically log metrics to separate

[jira] [Updated] (HDFS-8880) NameNode should periodically log metrics to separate appender

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Summary: NameNode should periodically log metrics to separate appender (was: NameNode should

[jira] [Updated] (HDFS-8880) NameNode should periodically log metrics

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Status: Patch Available (was: Open) NameNode should periodically log metrics

[jira] [Comment Edited] (HDFS-8880) NameNode should periodically log metrics to separate appender

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662651#comment-14662651 ] Arpit Agarwal edited comment on HDFS-8880 at 8/7/15 11:37 PM: --

[jira] [Updated] (HDFS-8880) NameNode should periodically log metrics to separate appender

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Attachment: (was: HDFS-8880.01.patch) NameNode should periodically log metrics to separate

[jira] [Updated] (HDFS-8880) NameNode should periodically log metrics

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Attachment: HDFS-8880.01.patch Patch to log NameNode metrics once every 10 minutes by default to a

[jira] [Updated] (HDFS-8880) NameNode metrics logging

2015-08-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8880: Attachment: namenode-metrics.log Sample log file attached. NameNode metrics logging

  1   2   >