[jira] Commented: (HDFS-107) Data-nodes should be formatted when the name-node is formatted.

2011-01-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980220#action_12980220 ] Koji Noguchi commented on HDFS-107: --- bq. The second approach looks fine to me. Second appr

[jira] Created: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Hairong Kuang (JIRA)
First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion Key: HDFS-1578 URL: https://issues.ap

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980223#action_12980223 ] Todd Lipcon commented on HDFS-1578: --- It seems like this could hurt efficiency for random w

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980242#action_12980242 ] Hairong Kuang commented on HDFS-1578: - Our use case of this is to support across cluster

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980244#action_12980244 ] Todd Lipcon commented on HDFS-1578: --- So in that case wouldn't it be an RPC to the NN, if y

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980246#action_12980246 ] Doug Cutting commented on HDFS-1578: Todd: DataNodeProtocol is implemented by the NameNo

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980250#action_12980250 ] Todd Lipcon commented on HDFS-1578: --- oh, duh. need more coffee :) In that case, this seem

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980251#action_12980251 ] Hairong Kuang commented on HDFS-1578: - Sorry I meant ClientDatanodeProtocol. Todd, what

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980253#action_12980253 ] Todd Lipcon commented on HDFS-1578: --- Wait -- DatanodeProtocol can't be used since it's aut

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980254#action_12980254 ] Hairong Kuang commented on HDFS-1578: - Now I see your point. Yes, it seems to be a good

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980256#action_12980256 ] Todd Lipcon commented on HDFS-1578: --- ah, we are have race conditions commenting here on th

[jira] Updated: (HDFS-1497) Write pipeline sequence numbers should be sequential with no skips or duplicates

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1497: -- Attachment: hdfs-1497.txt This patch compiles against trunk > Write pipeline sequence numbers should be

[jira] Commented: (HDFS-884) DataNode makeInstance should report the directory list when failing to start up

2011-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980297#action_12980297 ] Hadoop QA commented on HDFS-884: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-1497) Write pipeline sequence numbers should be sequential with no skips or duplicates

2011-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980299#action_12980299 ] Hadoop QA commented on HDFS-1497: - -1 overall. Here are the results of testing the latest a

[jira] Resolved: (HDFS-1576) TestWriteConfigurationToDFS is timing out on trunk

2011-01-11 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HDFS-1576. --- Resolution: Not A Problem A new version of the commons jar has been pushed to Ivy. This has resolved

[jira] Created: (HDFS-1579) Browsing a block on the wrong datanode through web UI has unintuitive results

2011-01-11 Thread Todd Lipcon (JIRA)
Browsing a block on the wrong datanode through web UI has unintuitive results - Key: HDFS-1579 URL: https://issues.apache.org/jira/browse/HDFS-1579 Project: Hadoop HDFS

[jira] Commented: (HDFS-1505) saveNamespace appears to succeed even if all directories fail to save

2011-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980353#action_12980353 ] Allen Wittenauer commented on HDFS-1505: > I agree saveNamespace should throw an exc

[jira] Commented: (HDFS-1572) Checkpointer should trigger checkpoint with specified period.

2011-01-11 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980365#action_12980365 ] Boris Shkolnik commented on HDFS-1572: -- getJournalSize() is an RPC call. I think we sho

[jira] Commented: (HDFS-1125) Removing a datanode (failed or decommissioned) should not require a namenode restart

2011-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980403#action_12980403 ] Allen Wittenauer commented on HDFS-1125: That's because you aren't in ops. > Removi

[jira] Commented: (HDFS-1572) Checkpointer should trigger checkpoint with specified period.

2011-01-11 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980404#action_12980404 ] Jakob Homan commented on HDFS-1572: --- The getJournalSize() rpc is only called once every fi

[jira] Updated: (HDFS-1331) dfs -test should work like /bin/test

2011-01-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1331: --- Issue Type: Bug (was: Improvement) I'm changing this back to a bug. The way test works is no

[jira] Updated: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1547: -- Attachment: HDFS-1547.patch In addition to the proposed changes I made the following changes: >

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980440#action_12980440 ] Suresh Srinivas commented on HDFS-1547: --- I am not using review board as I could not re

[jira] Commented: (HDFS-1572) Checkpointer should trigger checkpoint with specified period.

2011-01-11 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980447#action_12980447 ] Boris Shkolnik commented on HDFS-1572: -- +1 > Checkpointer should trigger checkpoint wi

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980453#action_12980453 ] Tsz Wo (Nicholas), SZE commented on HDFS-1547: -- Patch looks good. Just one com

[jira] Updated: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1547: -- Attachment: HDFS-1547.1.patch Thanks for the suggestion. I made the change in the patch. > Impr

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980479#action_12980479 ] Hairong Kuang commented on HDFS-1578: - I am still tempting to get the version # from a d

[jira] Updated: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1547: - Hadoop Flags: [Reviewed] +1 > Improve decommission mechanism > --

[jira] Commented: (HDFS-1572) Checkpointer should trigger checkpoint with specified period.

2011-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980480#action_12980480 ] Konstantin Shvachko commented on HDFS-1572: --- Jakob, the idea of the original code

[jira] Commented: (HDFS-1547) Improve decommission mechanism

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980497#action_12980497 ] Todd Lipcon commented on HDFS-1547: --- One potential issue, not sure if it's realistically a

[jira] Commented: (HDFS-1244) Misc improvements to TestFileAppend2

2011-01-11 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980580#action_12980580 ] Konstantin Boudnik commented on HDFS-1244: -- coupla nits: - as use of log4j has be

[jira] Commented: (HDFS-1566) Test that covers full partition

2011-01-11 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980581#action_12980581 ] Konstantin Boudnik commented on HDFS-1566: -- fault injection seems to be a good cand

[jira] Commented: (HDFS-1496) TestStorageRestore is failing after HDFS-903 fix

2011-01-11 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980586#action_12980586 ] Konstantin Boudnik commented on HDFS-1496: -- I think it is either software bug or in

[jira] Commented: (HDFS-1496) TestStorageRestore is failing after HDFS-903 fix

2011-01-11 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980587#action_12980587 ] Hairong Kuang commented on HDFS-1496: - I did not say disabling the test. I meant disabli

[jira] Commented: (HDFS-1566) Test that covers full partition

2011-01-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980606#action_12980606 ] Todd Lipcon commented on HDFS-1566: --- I'm not sure - iirc the behavior we had when we saw t