[jira] [Updated] (HDFS-4212) NameNode can't differentiate between a never-created block and a block which is really missing

2012-11-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4212: -- Attachment: hdfs-4212-junit-test.patch I write a test case and run it against with the trunk code. I did

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: (was: HADOOP-4047.patch) > BPServiceActor has nested shouldRun loops > -

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-18 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: HDFS-4047.patch > BPServiceActor has nested shouldRun loops > --

[jira] [Commented] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499637#comment-13499637 ] Yanbo Liang commented on HDFS-4047: --- @Eli, I agree with Todd, just post a patch for clean

[jira] [Commented] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-14 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13497807#comment-13497807 ] Yanbo Liang commented on HDFS-4047: --- The patch looks good! > BPServiceAc

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: HDFS-4047.patch > BPServiceActor has nested shouldRun loops > --

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: (was: HDFS-4047.patch) > BPServiceActor has nested shouldRun loops > ---

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-11-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: HDFS-4047.patch Hi Eli, You comment is instructive. But if moving the sleep on IOE from the

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Status: Patch Available (was: Open) > BPServiceActor has nested shouldRun loops > -

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: HADOOP-4047.patch Just like the description, we hoist the info log from offerService() out t

[jira] [Commented] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13483134#comment-13483134 ] Yanbo Liang commented on HDFS-3704: --- Add a specific DN to deadNodes means we don't take i

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-10-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13483080#comment-13483080 ] Yanbo Liang commented on HDFS-3219: --- @karlnicholas Thank you for your comments, the expla

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: (was: HADOOP-3704.patch) > In the DFSClient, Add the node to the dead list when the

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: HADOOP-3704.patch > In the DFSClient, Add the node to the dead list when the ipc.Client

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Status: Patch Available (was: Open) > In the DFSClient, Add the node to the dead list when the ipc.

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: HADOOP-3704.patch > In the DFSClient, Add the node to the dead list when the ipc.Client

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: (was: HADOOP-3704.patch) > In the DFSClient, Add the node to the dead list when the

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: HADOOP-3704.patch > In the DFSClient, Add the node to the dead list when the ipc.Client

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: HADOOP-3704.patch > In the DFSClient, Add the node to the dead list when the ipc.Client

[jira] [Updated] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3704: -- Attachment: (was: HADOOP-3704.patch) > In the DFSClient, Add the node to the dead list when the

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-10-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13482182#comment-13482182 ] Yanbo Liang commented on HDFS-3219: --- There is a scenario: 1) Dfs client writes to a file

[jira] [Commented] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-10-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13481316#comment-13481316 ] Yanbo Liang commented on HDFS-3704: --- If the ipc.Client calls to DataNode fails, maybe it

[jira] [Commented] (HDFS-3219) Disambiguate "visible length" in the code and docs

2012-10-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476875#comment-13476875 ] Yanbo Liang commented on HDFS-3219: --- If the last block is uncompleted and is in the state

[jira] [Commented] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461793#comment-13461793 ] Yanbo Liang commented on HDFS-3878: --- The patch is available, looking forward to reviews a

[jira] [Updated] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-24 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3878: -- Attachment: HDFS-3878.patch > Add an administrative command to download finalized edit log segments

[jira] [Updated] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3878: -- Attachment: HDFS-3878.patch > Add an administrative command to download finalized edit log segments

[jira] [Updated] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3878: -- Attachment: HDFS-3878.patch Update the patch for trunk. > Add an administrative command

[jira] [Updated] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3878: -- Attachment: HDFS-3878.patch Similarly to the `hdfs dfsadmin -fetchImage' command added in HDFS-2941, thi

[jira] [Commented] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458600#comment-13458600 ] Yanbo Liang commented on HDFS-3878: --- Then we can have the completement persistent metadat

[jira] [Updated] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3878: -- Labels: patch (was: ) Release Note: Similarly to the `hdfs dfsadmin -fetchImage' command adde

[jira] [Commented] (HDFS-3878) Add an administrative command to download finalized edit log segments from the NN

2012-09-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13447191#comment-13447191 ] Yanbo Liang commented on HDFS-3878: --- The workflow of fetchEditLogs is the same as fetchIm

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434915#comment-13434915 ] Yanbo Liang commented on HDFS-3772: --- the hang in safe mode. we have the two alternative s

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13434859#comment-13434859 ] Yanbo Liang commented on HDFS-3772: --- Change semantics of the existing parameter or persis

[jira] [Commented] (HDFS-3704) In the DFSClient, Add the node to the dead list when the ipc.Client calls fails

2012-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431703#comment-13431703 ] Yanbo Liang commented on HDFS-3704: --- I think we should tackle it at the following functio

[jira] [Commented] (HDFS-3734) TestFSEditLogLoader.testReplicationAdjusted() will hang if number of blocks are more than one

2012-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431685#comment-13431685 ] Yanbo Liang commented on HDFS-3734: --- OK > TestFSEditLogLoader.testReplic

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431678#comment-13431678 ] Yanbo Liang commented on HDFS-3772: --- {quote} So, the other option would be to persist thi

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431637#comment-13431637 ] Yanbo Liang commented on HDFS-3772: --- {quote} Client's write will succeed if it meets min

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-08 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431115#comment-13431115 ] Yanbo Liang commented on HDFS-3772: --- After survey the source code, I found that after mod

[jira] [Created] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-08 Thread Yanbo Liang (JIRA)
Yanbo Liang created HDFS-3772: - Summary: HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger. Key: HDFS-3772 URL: https://issues.apache.org/jira/browse/HDFS-3772

[jira] [Commented] (HDFS-3734) TestFSEditLogLoader.testReplicationAdjusted() will hang if number of blocks are more than one

2012-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427915#comment-13427915 ] Yanbo Liang commented on HDFS-3734: --- The hang in the safeMode is because of the following

[jira] [Updated] (HDFS-3748) TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3748: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) > TestDFSUtil#testHANameNodes

[jira] [Commented] (HDFS-3748) TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427145#comment-13427145 ] Yanbo Liang commented on HDFS-3748: --- It's wildspread in the whole project, So I agree to

[jira] [Commented] (HDFS-3734) TestFSEditLogLoader.testReplicationAdjusted() will hang if number of blocks are more than one

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13426518#comment-13426518 ] Yanbo Liang commented on HDFS-3734: --- Cluster have 2 DataNodes, and file is written with r

[jira] [Updated] (HDFS-3748) TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3748: -- Labels: test (was: ) Release Note: Use InetSocketAddress.getHostName() and InetSocketAddress.

[jira] [Updated] (HDFS-3748) TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-3748: -- Attachment: HADOOP-3748.patch Use InetSocketAddress.getHostName() and InetSocketAddress.getPort() to mak

[jira] [Created] (HDFS-3748) TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port

2012-08-01 Thread Yanbo Liang (JIRA)
Yanbo Liang created HDFS-3748: - Summary: TestDFSUtil#testHANameNodesWithFederation failed because of misuse toString to generate hostname:port Key: HDFS-3748 URL: https://issues.apache.org/jira/browse/HDFS-3748

[jira] [Commented] (HDFS-3734) TestFSEditLogLoader.testReplicationAdjusted() will hang if number of blocks are more than one

2012-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13426382#comment-13426382 ] Yanbo Liang commented on HDFS-3734: --- I just run and analysis the test case. I found that

[jira] Commented: (HDFS-749) HDFS build is broken: hadoop-core snapshot can't be resolved.

2011-02-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998198#comment-12998198 ] Yanbo Liang commented on HDFS-749: -- Wish this JIRA can be fixed as soon as possible. > HDF

[jira] Commented: (HDFS-1519) HDFS build is broken, ivy-resolve-common does not find hadoop-common

2011-02-22 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998196#comment-12998196 ] Yanbo Liang commented on HDFS-1519: --- I was building hdfs checked out from svn and met the