[jira] Commented: (HDFS-548) TestFsck takes nearly 10 minutes to run - a quarter of the entire hdfs-test time

[ https://issues.apache.org/jira/browse/HDFS-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744333#action_12744333 ] Hadoop QA commented on HDFS-548: +1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-544) Add a "rbw" sub directory to DataNode data directory

[ https://issues.apache.org/jira/browse/HDFS-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744298#action_12744298 ] Hairong Kuang commented on HDFS-544: The current datanode data directory layout on each

[jira] Assigned: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

[ https://issues.apache.org/jira/browse/HDFS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik reassigned HDFS-549: --- Assignee: Konstantin Boudnik > Allow non fault-inject specific tests execution with an

[jira] Updated: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-550: --- Description: Current trunk first calls detach to unlinks a finalized replica before appending to this

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744286#action_12744286 ] Hairong Kuang commented on HDFS-550: New proposal: 1. when unlinking a block/meta file, t

[jira] Updated: (HDFS-539) Fault injeciton utlis for pipeline testing needs to be refactored for future reuse by other tests

[ https://issues.apache.org/jira/browse/HDFS-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-539: Status: Patch Available (was: Open) > Fault injeciton utlis for pipeline testing nee

[jira] Created: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas Key: HDFS-550 URL: https://issues.apache.org/jira/browse/HDFS-550

[jira] Updated: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-457: Resolution: Fixed Release Note: Do not shutdown datanode if some, but not all, v

[jira] Commented: (HDFS-448) An IOException thrown in the BlockReceiver file causes some tests to hang

[ https://issues.apache.org/jira/browse/HDFS-448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744271#action_12744271 ] Konstantin Boudnik commented on HDFS-448: - In the new design of fault injection frame

[jira] Updated: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

[ https://issues.apache.org/jira/browse/HDFS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-549: Attachment: HDFS-549.patch The same is done for {{hdfs-with-mr}} tests > Allow non fault-inj

[jira] Updated: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-457: Fix Version/s: 0.21.0 Issue Type: Improvement (was: Bug) Hadoop Flags: [R

[jira] Resolved: (HDFS-527) Refactor DFSClient constructors

[ https://issues.apache.org/jira/browse/HDFS-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-527. - Resolution: Fixed I have committed this to 0.20. > Refactor DFSClient constructors

[jira] Updated: (HDFS-527) Refactor DFSClient constructors

[ https://issues.apache.org/jira/browse/HDFS-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-527: Attachment: h527_20090804c_0.20.patch h527_20090804c_0.20.patch: for 0.20 Usually, w

[jira] Commented: (HDFS-547) TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException

[ https://issues.apache.org/jira/browse/HDFS-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744250#action_12744250 ] Hairong Kuang commented on HDFS-547: I ran the test 20 times in a row and I did not see t

[jira] Updated: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

[ https://issues.apache.org/jira/browse/HDFS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-549: Attachment: HDFS-549.patch This functionality is important for some issues verification like

[jira] Created: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting --- Key: HDFS-549 URL: https://issues.apache.org/jira/browse/HDFS-549 Project:

[jira] Updated: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-457: Attachment: HDFS-457-3.patch implemented comments by Nicholas. > better handling of volume failure

[jira] Updated: (HDFS-539) Fault injeciton utlis for pipeline testing needs to be refactored for future reuse by other tests

[ https://issues.apache.org/jira/browse/HDFS-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-539: Attachment: HDFS-539.patch Two other aspects are found to be prone to the same kind of error.

[jira] Updated: (HDFS-539) Fault injeciton utlis for pipeline testing needs to be refactored for future reuse by other tests

[ https://issues.apache.org/jira/browse/HDFS-539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-539: Attachment: HDFS-539.patch {{ClientProtocolAspects}} can throw NullPointerException when used

[jira] Commented: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744227#action_12744227 ] Mahadev konar commented on HDFS-457: sorry ignore my comment, didnt read nicholas's comme

[jira] Updated: (HDFS-527) Refactor DFSClient constructors

[ https://issues.apache.org/jira/browse/HDFS-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-527: Affects Version/s: 0.20.1 Fix Version/s: 0.20.1 > Refactor DFSClient construc

[jira] Resolved: (HDFS-167) DFSClient continues to retry indefinitely

[ https://issues.apache.org/jira/browse/HDFS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-167. - Resolution: Fixed Fix Version/s: 0.20.1 I have committed this to 0.20. Will

[jira] Reopened: (HDFS-527) Refactor DFSClient constructors

[ https://issues.apache.org/jira/browse/HDFS-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reopened HDFS-527: - Reopen for committing this to 0.20. > Refactor DFSClient constructors > --

[jira] Reopened: (HDFS-167) DFSClient continues to retry indefinitely

[ https://issues.apache.org/jira/browse/HDFS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE reopened HDFS-167: - Reopen for committing to 0.20. > DFSClient continues to retry indefinitely > -

[jira] Commented: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744214#action_12744214 ] Mahadev konar commented on HDFS-457: i would suggest fixing the spelling for shutdown as

[jira] Commented: (HDFS-548) TestFsck takes nearly 10 minutes to run - a quarter of the entire hdfs-test time

[ https://issues.apache.org/jira/browse/HDFS-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744213#action_12744213 ] Suresh Srinivas commented on HDFS-548: -- +1. Thanks Hairong for catching this. > TestFsc

[jira] Updated: (HDFS-548) TestFsck takes nearly 10 minutes to run - a quarter of the entire hdfs-test time

[ https://issues.apache.org/jira/browse/HDFS-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-548: --- Fix Version/s: 0.21.0 Affects Version/s: 0.21.0 Status: Patch Available (was: Op

[jira] Moved: (HDFS-548) TestFsck takes nearly 10 minutes to run - a quarter of the entire hdfs-test time

[ https://issues.apache.org/jira/browse/HDFS-548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang moved HADOOP-6083 to HDFS-548: Component/s: (was: test) test Key: HDFS-548

[jira] Updated: (HDFS-547) TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException

[ https://issues.apache.org/jira/browse/HDFS-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-547: --- Attachment: closeDataStream.patch This patch solves the problem by not interrupting the data stream if

[jira] Commented: (HDFS-457) better handling of volume failure in Data Node storage

[ https://issues.apache.org/jira/browse/HDFS-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744189#action_12744189 ] Tsz Wo (Nicholas), SZE commented on HDFS-457: - A few nits: - change numberOfVolum

[jira] Commented: (HDFS-456) Problems with dfs.name.edits.dirs as URI

[ https://issues.apache.org/jira/browse/HDFS-456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744188#action_12744188 ] Tsz Wo (Nicholas), SZE commented on HDFS-456: - Oops, my previous comments were no

[jira] Commented: (HDFS-456) Problems with dfs.name.edits.dirs as URI

[ https://issues.apache.org/jira/browse/HDFS-456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744185#action_12744185 ] Tsz Wo (Nicholas), SZE commented on HDFS-456: - A few nits: - change numberOfVolum

[jira] Commented: (HDFS-547) TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException

[ https://issues.apache.org/jira/browse/HDFS-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744157#action_12744157 ] Hairong Kuang commented on HDFS-547: It turns out that DFSOutputStream#flushInternal only

[jira] Created: (HDFS-547) TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException

TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException -- Key: HDFS-547 URL: https://issues.apache.org/jira/browse/

[jira] Updated: (HDFS-265) Revisit append

[ https://issues.apache.org/jira/browse/HDFS-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-265: --- Affects Version/s: Append Branch Fix Version/s: Append Branch > Revisit append > --

[jira] Assigned: (HDFS-126) Permission configuration files should use octal and symbolic

[ https://issues.apache.org/jira/browse/HDFS-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-126: Assignee: Jakob Homan > Permission configuration files should use octal and symbolic > --

[jira] Commented: (HDFS-546) DatanodeDescriptor block iterator should be BlockInfo based rather than Block.

[ https://issues.apache.org/jira/browse/HDFS-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12744053#action_12744053 ] Hudson commented on HDFS-546: - Integrated in Hadoop-Hdfs-trunk #52 (See [http://hudson.zones.apa