[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Resolution: Fixed Status: Resolved (was: Patch Available) > DataNode should first receive the

[jira] Commented: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787953#action_12787953 ] Hairong Kuang commented on HDFS-793: I've just committed this. > DataNode should first r

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: separateSendRcvAck-0.20.patch a patch for 0.20. > DataNode should first receive the whole

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: separateSendRcvAck2.patch a patch for the trunk and 0.21. > DataNode should first receive

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Status: Patch Available (was: Open) > DataNode should first receive the whole packet ack message befor

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: (was: separateSendRcvAck1.patch) > DataNode should first receive the whole packet ack m

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: separateSendRcvAck1.patch > DataNode should first receive the whole packet ack message befo

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: separateSendRcvAck1.patch This patch has the following chanages: 1. Bump up the data transf

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787177#action_12787177 ] Hairong Kuang commented on HDFS-101: To be more specific, if the block receiver gets an e

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787137#action_12787137 ] Hairong Kuang commented on HDFS-101: Would this work? When DNi detects an error when comm

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787120#action_12787120 ] Hairong Kuang commented on HDFS-101: > When the first datanode closes its socket from DFS

[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery

[ https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787044#action_12787044 ] Hairong Kuang commented on HDFS-804: +1 > New unit tests for concurrent lease recovery >

[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery

[ https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787034#action_12787034 ] Hairong Kuang commented on HDFS-804: Cos, alternatively you could commit the patch upload

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787030#action_12787030 ] Hairong Kuang commented on HDFS-101: Assume that there is a pipeline consisting of DN0,

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787019#action_12787019 ] Hairong Kuang commented on HDFS-101: > Is this the same as HDFS-795? Yes, the only diffe

[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery

[ https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12787015#action_12787015 ] Hairong Kuang commented on HDFS-804: > Do you think we need this test until the code is f

[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery

[ https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786767#action_12786767 ] Hairong Kuang commented on HDFS-804: The new unit tests look good to me. Cos, could you p

[jira] Commented: (HDFS-792) TestHDFSCLI is failing

[ https://issues.apache.org/jira/browse/HDFS-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786284#action_12786284 ] Hairong Kuang commented on HDFS-792: I hit this again even with the fix. Shall we reopen

[jira] Updated: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

[ https://issues.apache.org/jira/browse/HDFS-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-793: --- Attachment: separateSendRcvAck.patch Here is a patch for review. Thank Cos for his help with fixing t

[jira] Commented: (HDFS-804) New unit tests for concurrent lease recovery

[ https://issues.apache.org/jira/browse/HDFS-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12786111#action_12786111 ] Hairong Kuang commented on HDFS-804: For testing concurrent lease recoveries, I guess we

[jira] Commented: (HDFS-797) TestHDFSCLI much slower after HDFS-265 merge

[ https://issues.apache.org/jira/browse/HDFS-797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785530#action_12785530 ] Hairong Kuang commented on HDFS-797: No need to call closeInternal(). DataStream calls cl

[jira] Updated: (HDFS-145) FSNameSystem#addStoredBlock does not handle inconsistent block length correctly

[ https://issues.apache.org/jira/browse/HDFS-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-145: --- Affects Version/s: 0.21.0 Fix Version/s: 0.22.0 0.21.0 > FSNameSystem#ad

[jira] Created: (HDFS-800) The last block of a file under construction may change to the COMPLETE state in response to getAdditionalBlock or completeFileInternal

The last block of a file under construction may change to the COMPLETE state in response to getAdditionalBlock or completeFileInternal -- Key: HDFS-

[jira] Commented: (HDFS-795) DFS Write pipeline does not detect defective datanode correctly in some cases (HADOOP-3339)

[ https://issues.apache.org/jira/browse/HDFS-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12783998#action_12783998 ] Hairong Kuang commented on HDFS-795: I will get this issue fixed in HDFS-101. > DFS Writ

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12783858#action_12783858 ] Hairong Kuang commented on HDFS-101: This is not an easy problem to solve. I created HDFS

[jira] Created: (HDFS-793) DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet

DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet Key: HDFS-793

[jira] Commented: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12782669#action_12782669 ] Hairong Kuang commented on HDFS-101: It seems to me there are two issues with this proble

[jira] Assigned: (HDFS-101) DFS write pipeline : DFSClient sometimes does not detect second datanode failure

[ https://issues.apache.org/jira/browse/HDFS-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang reassigned HDFS-101: -- Assignee: Hairong Kuang > DFS write pipeline : DFSClient sometimes does not detect second datanod

[jira] Commented: (HDFS-724) Pipeline close hangs if one of the datanode is not responsive.

[ https://issues.apache.org/jira/browse/HDFS-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12782546#action_12782546 ] Hairong Kuang commented on HDFS-724: This patch ends up implementing the heartbeat packet

[jira] Updated: (HDFS-724) Pipeline close hangs if one of the datanode is not responsive.

[ https://issues.apache.org/jira/browse/HDFS-724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-724: --- Attachment: pipelineHeartbeat.patch OK, here comes a patch that does the following: 1. when a pipeline

[jira] Commented: (HDFS-724) Pipeline close hangs if one of the datanode is not responsive.

[ https://issues.apache.org/jira/browse/HDFS-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12778542#action_12778542 ] Hairong Kuang commented on HDFS-724: The timestamp meta information could be added to reg

[jira] Commented: (HDFS-724) Pipeline close hangs if one of the datanode is not responsive.

[ https://issues.apache.org/jira/browse/HDFS-724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776777#action_12776777 ] Hairong Kuang commented on HDFS-724: I am quite torn at whether a heartbeat should be 1.

[jira] Commented: (HDFS-761) Failure to process rename operation from edits log due to quota verification

[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776226#action_12776226 ] Hairong Kuang commented on HDFS-761: +1 The patch looks good. > Failure to process renam

[jira] Commented: (HDFS-761) Failure to process rename operation from edits log due to quota verification

[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776217#action_12776217 ] Hairong Kuang commented on HDFS-761: Then does it make sense to make the "ready" check in

[jira] Commented: (HDFS-761) Failure to process rename operation from edits log due to quota verification

[ https://issues.apache.org/jira/browse/HDFS-761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776196#action_12776196 ] Hairong Kuang commented on HDFS-761: Do you want to enable count updates during fsimage &

[jira] Commented: (HDFS-521) Create new tests for pipeline

[ https://issues.apache.org/jira/browse/HDFS-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772581#action_12772581 ] Hairong Kuang commented on HDFS-521: +1 > testcase _03 is suppose to be covered by TestR

[jira] Resolved: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HDFS-731. Resolution: Fixed Hadoop Flags: [Reviewed] I've just committed this. > Support new Syncable in

[jira] Commented: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772033#action_12772033 ] Hairong Kuang commented on HDFS-731: > We should create a jira to track completing hsync

[jira] Created: (HDFS-744) Support hsync in HDFS

Support hsync in HDFS - Key: HDFS-744 URL: https://issues.apache.org/jira/browse/HDFS-744 Project: Hadoop HDFS Issue Type: New Feature Reporter: Hairong Kuang HDFS-731 implements hsync by default as hflush.

[jira] Commented: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12772025#action_12772025 ] Hairong Kuang commented on HDFS-731: BUILD SUCCESSFUL Total time: 66 minutes 37 seconds

[jira] Commented: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771716#action_12771716 ] Hairong Kuang commented on HDFS-731: Since this patch needs the changes made in HDFS-6313

[jira] Updated: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-731: --- Attachment: hdfsSyncable2.patch This patch sync with the trunk. > Support new Syncable interface in HD

[jira] Created: (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list Key: HDFS-742 URL: https://issues.apache.org/jira/browse/HDFS-742

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771218#action_12771218 ] Hairong Kuang commented on HDFS-732: +1. The patch looks good. > HDFS files are ending u

[jira] Commented: (HDFS-741) TestHFlush test doesn't seek() past previously written part of the file

[ https://issues.apache.org/jira/browse/HDFS-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771216#action_12771216 ] Hairong Kuang commented on HDFS-741: Cos, could you please try verifying the whole file i

[jira] Updated: (HDFS-222) Support for concatenating of files into a single file

[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-222: --- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] Status: Resolved

[jira] Commented: (HDFS-521) Create new tests for pipeline

[ https://issues.apache.org/jira/browse/HDFS-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771197#action_12771197 ] Hairong Kuang commented on HDFS-521: 1. miss testcase pipeline-03. 2. for pipeline-04 and

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771120#action_12771120 ] Hairong Kuang commented on HDFS-732: I do not think the change made in HADOOP-4760 was ri

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771110#action_12771110 ] Hairong Kuang commented on HDFS-222: +1 The patch looks good. > Support for concatenatin

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12771092#action_12771092 ] Hairong Kuang commented on HDFS-732: > First attempt to close the file was unsuccessful,

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770722#action_12770722 ] Hairong Kuang commented on HDFS-732: First of all, dfs supports non-blocking writes. Alth

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770697#action_12770697 ] Hairong Kuang commented on HDFS-222: Hope that this is the last comment :-) 1. FSNamesyst

[jira] Updated: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-731: --- Attachment: hdfsSyncable1.patch This patch adds more java doc and replaces all use of sync() in tests w

[jira] Updated: (HDFS-734) TestDatanodeBlockScanner times out in branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-734: --- Priority: Blocker (was: Major) > TestDatanodeBlockScanner times out in branch 0.20 > -

[jira] Resolved: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang resolved HDFS-728. Resolution: Fixed Hadoop Flags: [Reviewed] I've committed this! > Creat a comprehensive functi

[jira] Updated: (HDFS-728) Create a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-728: --- Issue Type: Improvement (was: New Feature) Summary: Create a comprehensive functional test for a

[jira] Updated: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-731: --- Fix Version/s: (was: 0.20.2) 0.21.0 > Support new Syncable interface in HDFS > -

[jira] Commented: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770221#action_12770221 ] Hairong Kuang commented on HDFS-723: I identified this bug when I ran the test in HDFS-72

[jira] Updated: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-723: --- Resolution: Fixed Fix Version/s: (was: 0.21.0) 0.20.2 Status: R

[jira] Updated: (HDFS-734) TestDatanodeBlockScanner times out in branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-734: --- Summary: TestDatanodeBlockScanner times out in branch 0.20 (was: TestDatanodeBlockScanner times out in

[jira] Updated: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-723: --- Attachment: deadlock_0.21.patch Here is the patch for 0.21. > Deadlock in DFSClient#DFSOutputStream >

[jira] Updated: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-728: --- Attachment: appendTest1.patch This patch makes the test to be a unit test and changes the class name no

[jira] Created: (HDFS-734) TestDatanodeBlockScanner times out in branch 0.21

TestDatanodeBlockScanner times out in branch 0.21 - Key: HDFS-734 URL: https://issues.apache.org/jira/browse/HDFS-734 Project: Hadoop HDFS Issue Type: Bug Components: test

[jira] Commented: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12770172#action_12770172 ] Hairong Kuang commented on HDFS-728: For this issue, I plan to take Nigel's suggestion fo

[jira] Commented: (HDFS-521) Create new tests for pipeline

[ https://issues.apache.org/jira/browse/HDFS-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769556#action_12769556 ] Hairong Kuang commented on HDFS-521: I checked all non-fi related changes. All look good.

[jira] Updated: (HDFS-731) Support new Syncable interface in HDFS

[ https://issues.apache.org/jira/browse/HDFS-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-731: --- Attachment: hdfsSyncable.patch Here is the patch for implementing Syncable in HDFS. > Support new Sync

[jira] Created: (HDFS-731) Support new Syncable interface in HDFS

Support new Syncable interface in HDFS -- Key: HDFS-731 URL: https://issues.apache.org/jira/browse/HDFS-731 Project: Hadoop HDFS Issue Type: New Feature Affects Versions: 0.21.0 Reporter: H

[jira] Commented: (HDFS-720) NPE in BlockReceiver$PacketResponder.run(BlockReceiver.java:923)

[ https://issues.apache.org/jira/browse/HDFS-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769416#action_12769416 ] Hairong Kuang commented on HDFS-720: Stack, thanks a lot for your tests and effort on res

[jira] Commented: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769410#action_12769410 ] Hairong Kuang commented on HDFS-728: This test is not intended as a junit test. Instead,

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769372#action_12769372 ] Hairong Kuang commented on HDFS-222: Borris, sorry that more comments are here. Hope that

[jira] Commented: (HDFS-512) Set block id as the key to Block

[ https://issues.apache.org/jira/browse/HDFS-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769309#action_12769309 ] Hairong Kuang commented on HDFS-512: +1. The patch looks good to me. > Set block id as t

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Resolution: Fixed Status: Resolved (was: Patch Available) I've committed this! Stack, I commi

[jira] Commented: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769007#action_12769007 ] Hairong Kuang commented on HDFS-690: Puts are already synced. There is no need for checki

[jira] Assigned: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang reassigned HDFS-728: -- Assignee: Hairong Kuang > Creat a comprehensive functional test for append >

[jira] Updated: (HDFS-728) Creat a comprehensive functional test for append

[ https://issues.apache.org/jira/browse/HDFS-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-728: --- Attachment: appendTest.patch Here is a patch that implements the above idea. > Creat a comprehensive f

[jira] Created: (HDFS-728) Creat a comprehensive functional test for append

Creat a comprehensive functional test for append Key: HDFS-728 URL: https://issues.apache.org/jira/browse/HDFS-728 Project: Hadoop HDFS Issue Type: New Feature Affects Versions: 0.21.0

[jira] Updated: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-723: --- Hadoop Flags: [Reviewed] Status: Patch Available (was: Open) > Deadlock in DFSClient#DFSOutp

[jira] Commented: (HDFS-721) ERROR Block blk_XXX_1030 already exists in state RBW and thus cannot be created

[ https://issues.apache.org/jira/browse/HDFS-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768901#action_12768901 ] Hairong Kuang commented on HDFS-721: Just in this particular case, the exception is expec

[jira] Commented: (HDFS-720) NPE in BlockReceiver$PacketResponder.run(BlockReceiver.java:923)

[ https://issues.apache.org/jira/browse/HDFS-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768872#action_12768872 ] Hairong Kuang commented on HDFS-720: Yes, I agree that this is caused by unsynced accesse

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Status: Patch Available (was: Open) > TestAppend2#testComplexAppend failed on "Too many open files" >

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Attachment: leakingThreads1.patch This patch creates a private method as Cos suggested. > TestAppend2#

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Status: Open (was: Patch Available) > TestAppend2#testComplexAppend failed on "Too many open files" >

[jira] Updated: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-723: --- Attachment: deadlock.patch Here is patch that changes LeaseChecker.close() so that it does not require

[jira] Updated: (HDFS-679) Appending to a partial chunk incorrectly assumes the first packet fills up the partial chunk

[ https://issues.apache.org/jira/browse/HDFS-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-679: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) The

[jira] Updated: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-723: --- Description: WhiIe was running some append-related tests, I hit this deadlock: {noformat} Found one Jav

[jira] Created: (HDFS-723) Deadlock in DFSClient#DFSOutputStream

Deadlock in DFSClient#DFSOutputStream - Key: HDFS-723 URL: https://issues.apache.org/jira/browse/HDFS-723 Project: Hadoop HDFS Issue Type: Bug Reporter: Hairong Kuang Assignee: Hair

[jira] Commented: (HDFS-721) ERROR Block blk_XXX_1030 already exists in state RBW and thus cannot be created

[ https://issues.apache.org/jira/browse/HDFS-721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768430#action_12768430 ] Hairong Kuang commented on HDFS-721: Thanks Stack for the detailed logs. They are very us

[jira] Commented: (HDFS-720) NPE in BlockReceiver$PacketResponder.run(BlockReceiver.java:923)

[ https://issues.apache.org/jira/browse/HDFS-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768420#action_12768420 ] Hairong Kuang commented on HDFS-720: Stack, thanks a lot for your tests. This bug is ver

[jira] Commented: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768419#action_12768419 ] Hairong Kuang commented on HDFS-690: Unit test is not included because it is supposed to

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Attachment: leakingThreads.patch This patch fixes the bug. > TestAppend2#testComplexAppend failed on "

[jira] Commented: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12768336#action_12768336 ] Hairong Kuang commented on HDFS-690: This bug seemed to be caused by HDFS-673. The change

[jira] Updated: (HDFS-690) TestAppend2#testComplexAppend failed on "Too many open files"

[ https://issues.apache.org/jira/browse/HDFS-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-690: --- Assignee: Hairong Kuang Status: Patch Available (was: Open) > TestAppend2#testComplexAppend fail

[jira] Updated: (HDFS-679) Appending to a partial chunk incorrectly assumes the first packet fills up the partial chunk

[ https://issues.apache.org/jira/browse/HDFS-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-679: --- Summary: Appending to a partial chunk incorrectly assumes the first packet fills up the partial chunk

[jira] Updated: (HDFS-679) Block receiver unexpectedly throws an IOException complaining mismatched checksum

[ https://issues.apache.org/jira/browse/HDFS-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-679: --- Status: Patch Available (was: Open) > Block receiver unexpectedly throws an IOException complaining mi

[jira] Updated: (HDFS-679) Block receiver unexpectedly throws an IOException complaining mismatched checksum

[ https://issues.apache.org/jira/browse/HDFS-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-679: --- Attachment: appendToPartialChunk1.patch This patch incorporates comments 1, 2, 4, and 5. Comment 5 is o

[jira] Commented: (HDFS-512) Set block id as the key to Block

[ https://issues.apache.org/jira/browse/HDFS-512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12767427#action_12767427 ] Hairong Kuang commented on HDFS-512: FSNamesystem.java has code that removes a blockinfo

[jira] Updated: (HDFS-668) TestFileAppend3#TC7 sometimes hangs

[ https://issues.apache.org/jira/browse/HDFS-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-668: --- Resolution: Fixed Status: Resolved (was: Patch Available) I just resolved this! > TestFileApp

[jira] Commented: (HDFS-668) TestFileAppend3#TC7 sometimes hangs

[ https://issues.apache.org/jira/browse/HDFS-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766795#action_12766795 ] Hairong Kuang commented on HDFS-668: Two failed unit tests are all known ones. > TestFil

[jira] Commented: (HDFS-668) TestFileAppend3#TC7 sometimes hangs

[ https://issues.apache.org/jira/browse/HDFS-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12766715#action_12766715 ] Hairong Kuang commented on HDFS-668: > Should we file a new jira to fix the problem in IN

[jira] Updated: (HDFS-668) TestFileAppend3#TC7 sometimes hangs

[ https://issues.apache.org/jira/browse/HDFS-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-668: --- Hadoop Flags: [Reviewed] Status: Patch Available (was: Open) > TestFileAppend3#TC7 sometimes

<    4   5   6   7   8   9   10   11   12   >