[jira] Commented: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797939#action_12797939 ] Todd Lipcon commented on HDFS-881: -- Hey Konstantin, Sorry, didn't notice HDFS-608 before -

[jira] Updated: (HDFS-880) TestNNLeaseRecovery fails on windows

2010-01-07 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-880: Attachment: HDFS-880.patch The updated version of Konstantin's patch does make sure that ther

[jira] Commented: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797916#action_12797916 ] Konstantin Boudnik commented on HDFS-881: - Oh, great! You've gone a step further and

[jira] Commented: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797912#action_12797912 ] Hadoop QA commented on HDFS-881: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797910#action_12797910 ] Hadoop QA commented on HDFS-877: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-734) TestDatanodeBlockScanner times out in branch 0.20

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797885#action_12797885 ] Todd Lipcon commented on HDFS-734: -- Patch available on HDFS-877. Once that's committed there

[jira] Updated: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-877: - Component/s: test hdfs client > Client-driven block verification not functioning > ---

[jira] Updated: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-877: - Status: Patch Available (was: Open) > Client-driven block verification not functioning > -

[jira] Updated: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-877: - Attachment: hdfs-877.txt I took the following route to fixing this: - BlockReader now knows how many bytes

[jira] Commented: (HDFS-874) TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797881#action_12797881 ] Todd Lipcon commented on HDFS-874: -- Test failures are the bizarre new "ClassDefNotFound" pro

[jira] Commented: (HDFS-874) TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts

2010-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797880#action_12797880 ] Hadoop QA commented on HDFS-874: -1 overall. Here are the results of testing the latest atta

[jira] Updated: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-881: - Status: Patch Available (was: Open) > Refactor DataNode Packet header into DataTransferProtocol >

[jira] Updated: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-881: - Attachment: hdfs-881.txt This implements the proposed refactor. Couple notes: - I had to implement read/wr

[jira] Created: (HDFS-881) Refactor DataNode Packet header into DataTransferProtocol

2010-01-07 Thread Todd Lipcon (JIRA)
Refactor DataNode Packet header into DataTransferProtocol - Key: HDFS-881 URL: https://issues.apache.org/jira/browse/HDFS-881 Project: Hadoop HDFS Issue Type: Improvement Affects Ve

[jira] Updated: (HDFS-786) Implement getContentSummary(..) in HftpFileSystem

2010-01-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-786: --- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Nic

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797848#action_12797848 ] Hairong Kuang commented on HDFS-878: For 1, as I commented on HDFS-879, I do not think HD

[jira] Commented: (HDFS-879) FileStatus should have the visible length of the file

2010-01-07 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797845#action_12797845 ] Hairong Kuang commented on HDFS-879: I am not sure what's your definition of the latest f

[jira] Commented: (HDFS-755) Read multiple checksum chunks at once in DFSInputStream

2010-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797844#action_12797844 ] Hudson commented on HDFS-755: - Integrated in Hadoop-Hdfs-trunk-Commit #161 (See [http://hudson.z

[jira] Updated: (HDFS-145) FSNameSystem#addStoredBlock does not handle inconsistent block length correctly

2010-01-07 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-145: --- Attachment: corruptionDetect.patch This patch removes all of the corrupt replica detection from addStor

[jira] Updated: (HDFS-755) Read multiple checksum chunks at once in DFSInputStream

2010-01-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HDFS-755: --- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] Updated: (HDFS-874) TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-874: - Status: Patch Available (was: Open) > TestHDFSFileContextMainOperations fails on weirdly configured DNS ho

[jira] Updated: (HDFS-874) TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-874: - Attachment: hdfs-874.txt > TestHDFSFileContextMainOperations fails on weirdly configured DNS hosts > --

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

2010-01-07 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-245: - Attachment: symlink30-hdfs.patch Attached a minor update to the last patch to address javadoc and checkstyl

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797819#action_12797819 ] Zheng Shao commented on HDFS-878: - There are 2 use cases: 1. {{DistributedFileSystem.listSta

[jira] Commented: (HDFS-880) TestNNLeaseRecovery fails on windows

2010-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797806#action_12797806 ] Konstantin Shvachko commented on HDFS-880: -- Looks like the problem is in {{TestNNLea

[jira] Updated: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-877: - Priority: Blocker (was: Critical) > Client-driven block verification not functioning > ---

[jira] Updated: (HDFS-880) TestNNLeaseRecovery fails on windows

2010-01-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-880: - Attachment: testNNLeaseRecovery.patch The attached patch is not a fix for the problem. But

[jira] Updated: (HDFS-877) Client-driven block verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-877: - Description: This is actually the reason for HDFS-734 (TestDatanodeBlockScanner timing out). The issue is

[jira] Created: (HDFS-880) TestNNLeaseRecovery fails on windows

2010-01-07 Thread Konstantin Shvachko (JIRA)
TestNNLeaseRecovery fails on windows Key: HDFS-880 URL: https://issues.apache.org/jira/browse/HDFS-880 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 0.21.0

[jira] Commented: (HDFS-877) Client-driven checksum verification not functioning

2010-01-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797796#action_12797796 ] Todd Lipcon commented on HDFS-877: -- This may turn out to be reasonably tricky to solve. The

[jira] Updated: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-878: Description: Currently DFSClient has no way to know whether a file is under construction or not, unless we o

[jira] Created: (HDFS-879) FileStatus should have the visible length of the file

2010-01-07 Thread Zheng Shao (JIRA)
FileStatus should have the visible length of the file - Key: HDFS-879 URL: https://issues.apache.org/jira/browse/HDFS-879 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] Commented: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797761#action_12797761 ] Eli Collins commented on HDFS-878: -- Why does the client need to know whether a file is under

[jira] Created: (HDFS-878) FileStatus should have a field "isUnderConstruction"

2010-01-07 Thread Zheng Shao (JIRA)
FileStatus should have a field "isUnderConstruction" Key: HDFS-878 URL: https://issues.apache.org/jira/browse/HDFS-878 Project: Hadoop HDFS Issue Type: New Feature Reporter: Zh

[jira] Resolved: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

2010-01-07 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-200. - Resolution: Duplicate This duplicates HDFS-659. > In HDFS, sync() not yet guarante

[jira] Commented: (HDFS-870) Topology is permanently cached

2010-01-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797681#action_12797681 ] Allen Wittenauer commented on HDFS-870: --- No, but there should be a way to flush it when

[jira] Commented: (HDFS-870) Topology is permanently cached

2010-01-07 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12797641#action_12797641 ] dhruba borthakur commented on HDFS-870: --- Does your network topology change so frequentl