[jira] Issue Comment Edited: (HDFS-1432) HDFS across data centers: HighTide

2010-09-30 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916458#action_12916458 ] dhruba borthakur edited comment on HDFS-1432 at 9/30/10 8:53 AM:

[jira] Commented: (HDFS-1432) HDFS across data centers: HighTide

2010-09-30 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916520#action_12916520 ] Joydeep Sen Sarma commented on HDFS-1432: - who manages the replication in both the

[jira] Commented: (HDFS-1073) Simpler model for Namenode's fs Image and edit Logs

2010-09-30 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916528#action_12916528 ] Ivan Kelly commented on HDFS-1073: -- I've been working on Todds code to bring it up to date

[jira] Commented: (HDFS-1428) HDFS federation : add cluster ID and block pool ID into Name node web UI

2010-09-30 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916560#action_12916560 ] Boris Shkolnik commented on HDFS-1428: -- +1 couple of suggestions: 1. do we want to

[jira] Created: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
Fix test failures - TestPread and TestFileLimit --- Key: HDFS-1433 URL: https://issues.apache.org/jira/browse/HDFS-1433 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0

[jira] Updated: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1433: -- Attachment: HDFS-1433.patch Fix test failures - TestPread and TestFileLimit

[jira] Commented: (HDFS-1428) HDFS federation : add cluster ID and block pool ID into Name node web UI

2010-09-30 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916582#action_12916582 ] Tanping Wang commented on HDFS-1428: Thanks, Boris for the comments. Regarding to 1, I

[jira] Created: (HDFS-1434) Refactor Datanode#startDataNode method

2010-09-30 Thread Suresh Srinivas (JIRA)
Refactor Datanode#startDataNode method -- Key: HDFS-1434 URL: https://issues.apache.org/jira/browse/HDFS-1434 Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects

[jira] Commented: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916601#action_12916601 ] Boris Shkolnik commented on HDFS-1433: -- +1. Fix test failures - TestPread and

[jira] Updated: (HDFS-1434) Refactor Datanode#startDataNode method

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1434: -- Attachment: HDFS-1434.patch Attached patch split the method into smaller methods. Refactor

[jira] Commented: (HDFS-1428) HDFS federation : add cluster ID and block pool ID into Name node web UI

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916610#action_12916610 ] Suresh Srinivas commented on HDFS-1428: --- I think what Boris is suggesting is instead

[jira] Commented: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916614#action_12916614 ] Suresh Srinivas commented on HDFS-1433: --- The removed private constructor was used in

[jira] Commented: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916615#action_12916615 ] Suresh Srinivas commented on HDFS-1433: --- I ran the tests to make sure the above test

[jira] Updated: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1433: -- Hadoop Flags: [Reviewed] Component/s: test I committed the patch. Fix test failures -

[jira] Resolved: (HDFS-1433) Fix test failures - TestPread and TestFileLimit

2010-09-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1433. --- Resolution: Fixed Fix test failures - TestPread and TestFileLimit

[jira] Updated: (HDFS-1300) Decommissioning nodes does not increase replication priority

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-1300: Attachment: HDFS-1300.2.patch Patch agains updated trunk Decommissioning nodes does not increase

[jira] Updated: (HDFS-1300) Decommissioning nodes does not increase replication priority

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-1300: Status: Patch Available (was: Open) Submitting to Hudson again. Decommissioning nodes does not

[jira] Updated: (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2010-09-30 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-1431: - Attachment: HDFS-1431.txt Balancer should work with the logic of BlockPlacementPolicy

[jira] Updated: (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2010-09-30 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-1431: - Attachment: (was: HDFS-1431.txt) Balancer should work with the logic of BlockPlacementPolicy

[jira] Updated: (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2010-09-30 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-1431: - Attachment: HDFS-1431.txt Balancer should work with the logic of BlockPlacementPolicy

[jira] Updated: (HDFS-1428) HDFS federation : add cluster ID and block pool ID into Name node web UI

2010-09-30 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1428: --- Attachment: HDFS-1428.2.patch HDFS-1428.2.patch I have made the change in the web page to have

[jira] Commented: (HDFS-503) Implement erasure coding as a layer on HDFS

2010-09-30 Thread Ramkumar Vadali (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916677#action_12916677 ] Ramkumar Vadali commented on HDFS-503: -- @shravankumar Quite a few bugs in raid have been

[jira] Updated: (HDFS-1105) Balancer improvement

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-1105: Attachment: HDFS-1105.4.patch This patch addresses all of Hairong's comments. I will also file a

[jira] Commented: (HDFS-1155) getDatanodeReport can be moved to NameNodeProtocol from ClientProtocol

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916730#action_12916730 ] Dmytro Molkov commented on HDFS-1155: - My original assumption is not entirely accurate.

[jira] Resolved: (HDFS-1155) getDatanodeReport can be moved to NameNodeProtocol from ClientProtocol

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov resolved HDFS-1155. - Resolution: Not A Problem I will deal with this in HDFS-1156 getDatanodeReport can be moved to

[jira] Commented: (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916732#action_12916732 ] Dmytro Molkov commented on HDFS-1431: - I like the idea in general. The only concern is

[jira] Resolved: (HDFS-855) namenode can save images in parallel to all directories in fs.name.dir

2010-09-30 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-855. -- Resolution: Duplicate namenode can save images in parallel to all directories in fs.name.dir

[jira] Commented: (HDFS-1431) Balancer should work with the logic of BlockPlacementPolicy

2010-09-30 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916735#action_12916735 ] Scott Chen commented on HDFS-1431: -- Dmytro: That's a good point. How about this? We can

[jira] Created: (HDFS-1435) Provide an option to store fsimage compressed

2010-09-30 Thread Hairong Kuang (JIRA)
Provide an option to store fsimage compressed - Key: HDFS-1435 URL: https://issues.apache.org/jira/browse/HDFS-1435 Project: Hadoop HDFS Issue Type: Improvement Components: name-node

[jira] Commented: (HDFS-1435) Provide an option to store fsimage compressed

2010-09-30 Thread Dmytro Molkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916737#action_12916737 ] Dmytro Molkov commented on HDFS-1435: - Do you expect the time to load the image and the

[jira] Created: (HDFS-1436) LeaseRenew RPC does not need to grab fsnamesystem write lock

2010-09-30 Thread Hairong Kuang (JIRA)
LeaseRenew RPC does not need to grab fsnamesystem write lock Key: HDFS-1436 URL: https://issues.apache.org/jira/browse/HDFS-1436 Project: Hadoop HDFS Issue Type: Improvement

[jira] Commented: (HDFS-1435) Provide an option to store fsimage compressed

2010-09-30 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12916747#action_12916747 ] Hairong Kuang commented on HDFS-1435: - This depends on the compression algorithm to be

[jira] Created: (HDFS-1437) Ability to set fs parameters from libhdfs

2010-09-30 Thread Stephen Jacob (JIRA)
Ability to set fs parameters from libhdfs - Key: HDFS-1437 URL: https://issues.apache.org/jira/browse/HDFS-1437 Project: Hadoop HDFS Issue Type: Wish Components: contrib/libhdfs