[jira] Commented: (HDFS-976) Hot Standby for NameNode

2011-02-28 Thread seahigh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000747#comment-13000747 ] seahigh commented on HDFS-976: -- I user hadoop-0.20.2, and had been trying to apply your patch,

[jira] Resolved: (HDFS-1669) Federation: Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1669. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the change. > Federation: Datano

[jira] Commented: (HDFS-1669) Federation: Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000714#comment-13000714 ] Suresh Srinivas commented on HDFS-1669: --- With patch TestHftpFileSystem and TestFiHftp

[jira] Updated: (HDFS-1666) HdfsProxy breakes HDFS trunk build

2011-02-28 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-1666: - Priority: Blocker (was: Critical) Affects Version/s: 0.22.0 Bumping it up to

[jira] Resolved: (HDFS-1668) Federation: Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1668. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. > Federation: Datanod

[jira] Commented: (HDFS-1668) Federation: Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000710#comment-13000710 ] Suresh Srinivas commented on HDFS-1668: --- testpatch results: [exec] +1 overall.

[jira] Commented: (HDFS-1625) TestDataNodeMXBean fails if disk space usage changes during test run

2011-02-28 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000708#comment-13000708 ] Konstantin Boudnik commented on HDFS-1625: -- +1 patch looks good. A not: shall {{S

[jira] Resolved: (HDFS-1654) HDFS Federation: Fix TestDFSUpgrade and TestDFSRollback failures.

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1654. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. > HDFS Federation: Fi

[jira] Commented: (HDFS-1654) HDFS Federation: Fix TestDFSUpgrade and TestDFSRollback failures.

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000698#comment-13000698 ] Suresh Srinivas commented on HDFS-1654: --- With the patch TestDFSUpgrade and TestDFSRol

[jira] Commented: (HDFS-1676) DateFormat.getDateTimeInstance() is very expensive, we can cache it to improve performance

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000689#comment-13000689 ] Tsz Wo (Nicholas), SZE commented on HDFS-1676: -- This may be negligible since o

[jira] Updated: (HDFS-1675) Transfer RBW between datanodes

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1675: - Attachment: h1675_20110228b.patch h1675_20110228b.patch: I should not removed {{Si

[jira] Updated: (HDFS-1625) TestDataNodeMXBean fails if disk space usage changes during test run

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1625: - Attachment: (was: h1625_20110228.patch) > TestDataNodeMXBean fails if disk spa

[jira] Updated: (HDFS-1625) TestDataNodeMXBean fails if disk space usage changes during test run

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1625: - Attachment: h1625_20110228.patch I also have encountered this problem. Here is a

[jira] Updated: (HDFS-1625) TestDataNodeMXBean fails if disk space usage changes during test run

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1625: - Attachment: h1625_20110228.patch h1625_20110228.patch: ignore numbers > TestDataN

[jira] Created: (HDFS-1676) DateFormat.getDateTimeInstance() is very expensive, we can cache it to improve performance

2011-02-28 Thread Xiaoming Shi (JIRA)
DateFormat.getDateTimeInstance() is very expensive, we can cache it to improve performance -- Key: HDFS-1676 URL: https://issues.apache.org/jira/browse/HDFS-1676

[jira] Updated: (HDFS-1675) Transfer RBW between datanodes

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1675: - Attachment: h1675_20110228.patch h1675_20110228.patch: - changed {{DataNode.DataTr

[jira] Commented: (HDFS-1669) Federation: Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000658#comment-13000658 ] Jitendra Nath Pandey commented on HDFS-1669: +1 > Federation: Datanode servlet

[jira] Commented: (HDFS-1668) Federation: Datanode needs to send block pool usage information in registration

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000656#comment-13000656 ] Jitendra Nath Pandey commented on HDFS-1668: +1 > Federation: Datanode needs t

[jira] Commented: (HDFS-1654) HDFS Federation: Fix TestDFSUpgrade and TestDFSRollback failures.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000653#comment-13000653 ] Jitendra Nath Pandey commented on HDFS-1654: +1 > HDFS Federation: Fix TestDFS

[jira] Resolved: (HDFS-1659) HDFS Federation: BPOfferService exits after the first iteration of the loop

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1659. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. > HDFS Federation: BP

[jira] Resolved: (HDFS-1646) HDFS Federation: MiniDFSCluster#waitActive() waits for ever in federation

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1646. --- Resolution: Fixed Hadoop Flags: [Reviewed] I committed the patch. > HDFS Federation: Mi

[jira] Commented: (HDFS-1646) HDFS Federation: MiniDFSCluster#waitActive() waits for ever in federation

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000645#comment-13000645 ] Boris Shkolnik commented on HDFS-1646: -- +1 > HDFS Federation: MiniDFSCluster#waitActi

[jira] Updated: (HDFS-1646) HDFS Federation: MiniDFSCluster#waitActive() waits for ever in federation

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1646: -- Attachment: HDFS-1646.1.patch Patch after fixing merge issues > HDFS Federation: MiniDFSCluster

[jira] Resolved: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-1649. Resolution: Fixed Hadoop Flags: [Reviewed] I have committed this. > Federatio

[jira] Commented: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000631#comment-13000631 ] Jitendra Nath Pandey commented on HDFS-1649: System test framework failure is n

[jira] Commented: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000625#comment-13000625 ] Jitendra Nath Pandey commented on HDFS-1649: -1 overall. +1 @author. The

[jira] Updated: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1649: --- Attachment: HDFS-1649.4.patch New patch removes an unused import. > Federation: Datan

[jira] Commented: (HDFS-1659) HDFS Federation: BPOfferService exits after the first iteration of the loop

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000618#comment-13000618 ] Suresh Srinivas commented on HDFS-1659: --- +1 for the change. > HDFS Federation: BPOff

[jira] Commented: (HDFS-1646) HDFS Federation: MiniDFSCluster#waitActive() waits for ever in federation

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000617#comment-13000617 ] Suresh Srinivas commented on HDFS-1646: --- test-patch results: [exec] +1 overall.

[jira] Commented: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000614#comment-13000614 ] Boris Shkolnik commented on HDFS-1649: -- +1 > Federation: Datanode command to refresh

[jira] Updated: (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1606: - Attachment: h1606_20110228.patch h1606_20110228.patch: Seems to have everything ex

[jira] Created: (HDFS-1675) Transfer RBW between datanodes

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
Transfer RBW between datanodes -- Key: HDFS-1675 URL: https://issues.apache.org/jira/browse/HDFS-1675 Project: Hadoop HDFS Issue Type: Sub-task Components: data-node Reporter: Tsz Wo (Nichola

[jira] Updated: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1189: - Resolution: Fixed Fix Version/s: 0.23.0 0.21.1 Hadoo

[jira] Updated: (HDFS-1674) HDFS Federation: Rename BlockPool class to BlockPoolSlice

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1674: --- Attachment: HDFS-1674.patch > HDFS Federation: Rename BlockPool class to BlockPoolSlice > ---

[jira] Created: (HDFS-1674) HDFS Federation: Rename BlockPool class to BlockPoolSlice

2011-02-28 Thread Tanping Wang (JIRA)
HDFS Federation: Rename BlockPool class to BlockPoolSlice -- Key: HDFS-1674 URL: https://issues.apache.org/jira/browse/HDFS-1674 Project: Hadoop HDFS Issue Type: Sub-task Com

[jira] Updated: (HDFS-1663) HDFS federation: Rename getPoolId() everywhere to getBlockPoolId()

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1663: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > HDFS federation: Rename getPoolId() every

[jira] Updated: (HDFS-1664) HDFS federation :Add new
 column
s of Block
Pool
Used 
and
 Block
Pool
Used
%
 into JSP

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1664: --- Issue Type: Sub-task (was: New Feature) Parent: HDFS-1052 > HDFS federation :Add new
 column


[jira] Updated: (HDFS-1662) HDFS federation: fix unit test case, TestCheckpoint and TestDataNodeMXBean

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1662: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > HDFS federation: fix unit test case, Test

[jira] Updated: (HDFS-1651) Tests fail due to null pointer exception in Datanode#shutdown()

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1651: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Tests fail due to null pointer exception

[jira] Updated: (HDFS-1653) Block received is sent with invalid DatanodeRegistration

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1653: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Block received is sent with invalid Data

[jira] Updated: (HDFS-1648) Federation: Only DataStorage must be locked using in_use.lock and no locks must be associated with BlockPoolStorage

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1648: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Federation: Only DataStorage must be lock

[jira] Updated: (HDFS-1650) HDFS Federation : fix unit test case, TestReplication

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1650: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > HDFS Federation : fix unit test case, Tes

[jira] Updated: (HDFS-1632) HDFS Federation: data node storage structure changes and introduce block pool storage for Federation.

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1632: --- Issue Type: Sub-task (was: New Feature) Parent: HDFS-1052 > HDFS Federation: data node storag

[jira] Commented: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000526#comment-13000526 ] John George commented on HDFS-1189: --- Ran ant test locally (both with and without the patc

[jira] Updated: (HDFS-1659) HDFS Federation: BPOfferService exits after the first iteration of the loop

2011-02-28 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated HDFS-1659: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > HDFS Federation: BPOfferService exits aft

[jira] Updated: (HDFS-1628) AccessControlException should display the full path

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1628: -- Attachment: HDFS-1628.patch > AccessControlException should display the full path >

[jira] Commented: (HDFS-1628) AccessControlException should display the full path

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000524#comment-13000524 ] John George commented on HDFS-1628: --- attached a patch with license box checked > AccessC

[jira] Updated: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1649: --- Attachment: HDFS-1649.2.patch Patch rebased against latest state of the branch. > Fed

[jira] Updated: (HDFS-1673) Federation: Datanode changes to track block token secret per namenode.

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1673: -- Attachment: HDFS-1673.patch Attached patch makes proposed changes. > Federation: Datanode chang

[jira] Created: (HDFS-1673) Datanode changes to track block token secret per namenode.

2011-02-28 Thread Suresh Srinivas (JIRA)
Datanode changes to track block token secret per namenode. --- Key: HDFS-1673 URL: https://issues.apache.org/jira/browse/HDFS-1673 Project: Hadoop HDFS Issue Type: Sub-task C

[jira] Updated: (HDFS-1673) Federation: Datanode changes to track block token secret per namenode.

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1673: -- Summary: Federation: Datanode changes to track block token secret per namenode. (was: Datanode

[jira] Commented: (HDFS-1673) Federation: Datanode changes to track block token secret per namenode.

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000494#comment-13000494 ] Suresh Srinivas commented on HDFS-1673: --- Making the following changes to address it:

[jira] Updated: (HDFS-1672) HDFS Federation: refactor stopDatanode(name) to work with multiple Block Pools

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1672: - Attachment: HDFS-1672.patch > HDFS Federation: refactor stopDatanode(name) to work with multiple B

[jira] Created: (HDFS-1672) refactor stopDatanode(name) to work with multiple Block Pools

2011-02-28 Thread Boris Shkolnik (JIRA)
refactor stopDatanode(name) to work with multiple Block Pools - Key: HDFS-1672 URL: https://issues.apache.org/jira/browse/HDFS-1672 Project: Hadoop HDFS Issue Type: Sub-task

[jira] Updated: (HDFS-1672) HDFS Federation: refactor stopDatanode(name) to work with multiple Block Pools

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1672: - Summary: HDFS Federation: refactor stopDatanode(name) to work with multiple Block Pools (was: ref

[jira] Updated: (HDFS-1671) HDFS Federation: shutdown in DataNode should be able to shutdown individual BP threads as well as the whole DN

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1671: - Attachment: HDFS-1671.patch > HDFS Federation: shutdown in DataNode should be able to shutdown ind

[jira] Created: (HDFS-1671) HDFS Federation: shutdown in DataNode should be able to shutdown individual BP threads as well as the whole DN

2011-02-28 Thread Boris Shkolnik (JIRA)
HDFS Federation: shutdown in DataNode should be able to shutdown individual BP threads as well as the whole DN -- Key: HDFS-1671 URL: https://issues.apache

[jira] Updated: (HDFS-1670) HDFS Federation: remove dnRegistration from Datanode

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1670: - Attachment: HDFS-1670.patch > HDFS Federation: remove dnRegistration from Datanode > -

[jira] Created: (HDFS-1670) HDFS Federation: remove dnRegistration from Datanode

2011-02-28 Thread Boris Shkolnik (JIRA)
HDFS Federation: remove dnRegistration from Datanode Key: HDFS-1670 URL: https://issues.apache.org/jira/browse/HDFS-1670 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Bor

[jira] Commented: (HDFS-1634) HDFS Federation: Convert single threaded DataNode into per BlockPool thread model.

2011-02-28 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000487#comment-13000487 ] Boris Shkolnik commented on HDFS-1634: -- Some of the clean-up issues are addressed in H

[jira] Updated: (HDFS-1668) Federation: Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1668: -- Summary: Federation: Datanode needs to send block pool usage information in registration (was:

[jira] Updated: (HDFS-1669) Federation: Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1669: -- Summary: Federation: Datanode servlets need information about the namenode to service the reques

[jira] Updated: (HDFS-1649) Federation: Datanode command to refresh namenode list at the datanode.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1649: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Federation: Datanode comm

[jira] Updated: (HDFS-1661) Hdfs Federation: Remove unnecessary TODO:FEDERATION comments.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1661: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Hdfs Federation: Remove u

[jira] Updated: (HDFS-1637) Federation: FSDataset in Datanode should be created after initial handshake with namenode

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1637: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Federation: FSDataset in

[jira] Updated: (HDFS-1647) Federation: Multiple namenode configuration

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1647: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-1052 > Federation: Multiple name

[jira] Assigned: (HDFS-1469) TestBlockTokenWithDFS fails on trunk

2011-02-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-1469: - Assignee: Konstantin Boudnik > TestBlockTokenWithDFS fails on trunk >

[jira] Resolved: (HDFS-1661) Hdfs Federation: Remove unnecessary TODO:FEDERATION comments.

2011-02-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-1661. Resolution: Fixed Hadoop Flags: [Reviewed] I have committed this. > Hdfs Fede

[jira] Updated: (HDFS-1626) Make BLOCK_INVALIDATE_LIMIT configurable

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1626: - Attachment: h1626_20110228.patch > Make BLOCK_INVALIDATE_LIMIT configurable >

[jira] Updated: (HDFS-1626) Make BLOCK_INVALIDATE_LIMIT configurable

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1626: - Attachment: (was: h1626_20110228.patch) > Make BLOCK_INVALIDATE_LIMIT configur

[jira] Updated: (HDFS-1626) Make BLOCK_INVALIDATE_LIMIT configurable

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1626: - Attachment: h1626_20110228.patch h1626_20110228.patch: added a new conf property {

[jira] Commented: (HDFS-1667) Consider redesign of block report processing

2011-02-28 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000437#comment-13000437 ] Matt Foley commented on HDFS-1667: -- Hi Brian, I agree that's a real risk. The hybrid solu

[jira] Updated: (HDFS-1669) Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1669: -- Attachment: HDFS-1669.patch The pattern of servlet usage is: Namenode fields the initial request

[jira] Updated: (HDFS-1668) Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1668: -- Attachment: HDFS-1668.1.patch Updated patch. > Datanode needs to send block pool usage informat

[jira] Created: (HDFS-1669) Datanode servlets need information about the namenode to service the request

2011-02-28 Thread Suresh Srinivas (JIRA)
Datanode servlets need information about the namenode to service the request Key: HDFS-1669 URL: https://issues.apache.org/jira/browse/HDFS-1669 Project: Hadoop HDFS

[jira] Updated: (HDFS-1668) Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1668: -- Attachment: HDFS-1668.patch Changes: # Datanode reports block pool used space to namenode. # Add

[jira] Created: (HDFS-1668) Datanode needs to send block pool usage information in registration

2011-02-28 Thread Suresh Srinivas (JIRA)
Datanode needs to send block pool usage information in registration Key: HDFS-1668 URL: https://issues.apache.org/jira/browse/HDFS-1668 Project: Hadoop HDFS Issue Type: Su

[jira] Commented: (HDFS-1658) A less expensive way to figure out directory size

2011-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000414#comment-13000414 ] Tsz Wo (Nicholas), SZE commented on HDFS-1658: -- > ... But still an application

[jira] Commented: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000371#comment-13000371 ] John George commented on HDFS-1189: --- ant -Dforrest.home=${FORREST_HOME} -Djava5.home=${JA

[jira] Updated: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1189: -- Status: Patch Available (was: Open) > Quota counts missed between clear quota and set quota > -

[jira] Updated: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1189: -- Status: Open (was: Patch Available) > Quota counts missed between clear quota and set quota > -

[jira] Updated: (HDFS-1189) Quota counts missed between clear quota and set quota

2011-02-28 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1189: -- Attachment: hdfs-1189-1.patch attaching the same patch with a different name > Quota counts missed betw

[jira] Commented: (HDFS-1667) Consider redesign of block report processing

2011-02-28 Thread Brian Bockelman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000262#comment-13000262 ] Brian Bockelman commented on HDFS-1667: --- Hi Matt, Just a small comment about (1). I