[jira] [Created] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4748: --- Summary: MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures Key: HDFS-4748 URL: https://issues.apache.org/jira/browse/HDFS-4748

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641142#comment-13641142 ] Tsz Wo (Nicholas), SZE commented on HDFS-4747: -- Hi Aaron, I don't think it is

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Description: To be consistent with the rest of the HDFS docs, the snapshots user guide should use

[jira] [Resolved] (HDFS-4276) HDFS tests have multiple failures on Windows due to file locking conflict

2013-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-4276. - Resolution: Not A Problem I think this issue has gone out of date, so I'm resolving it. Many of

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641149#comment-13641149 ] Aaron T. Myers commented on HDFS-4747: -- Hi Nicholas, a while back myself and others

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641155#comment-13641155 ] Aaron T. Myers commented on HDFS-4739: -- Thanks a lot for the reviews, Todd and Chris.

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641173#comment-13641173 ] Hudson commented on HDFS-4739: -- Integrated in Hadoop-trunk-Commit #3658 (See

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641179#comment-13641179 ] Tsz Wo (Nicholas), SZE commented on HDFS-4747: -- The xdoc compiled by maven

[jira] [Updated] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4748: Attachment: HDFS-4748.1.patch This patch changes {{MiniJournalCluster#restartJournalNode}} so that

[jira] [Updated] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4748: Status: Patch Available (was: Open) MiniJournalCluster#restartJournalNode leaks resources,

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641195#comment-13641195 ] Aaron T. Myers commented on HDFS-4747: -- The effort was to convert the xdocs to APT.

[jira] [Updated] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4305: -- Attachment: hdfs-4305-3.patch Here's a rebased version of the patch. Add a

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-04-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641205#comment-13641205 ] Hadoop QA commented on HDFS-4698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4688) DFSClient should not allow multiple concurrent creates for the same file

2013-04-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4688: -- Status: Open (was: Patch Available) DFSClient should not allow multiple concurrent creates for

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641207#comment-13641207 ] Tsz Wo (Nicholas), SZE commented on HDFS-4747: -- The title of HADOOP-8427 is

[jira] [Commented] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641212#comment-13641212 ] Todd Lipcon commented on HDFS-4748: --- Good catch, +1 pending Jenkins

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641215#comment-13641215 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- Could you also grep

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641217#comment-13641217 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- BTW, what is the timestamp

[jira] [Created] (HDFS-4749) Use INodeId to identify the corresponding directory node for FSImage saving/loading

2013-04-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4749: --- Summary: Use INodeId to identify the corresponding directory node for FSImage saving/loading Key: HDFS-4749 URL: https://issues.apache.org/jira/browse/HDFS-4749 Project:

[jira] [Commented] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

2013-04-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641220#comment-13641220 ] Hadoop QA commented on HDFS-4745: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641221#comment-13641221 ] Varun Sharma commented on HDFS-4721: Here are the remainder messages - looking at it

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641222#comment-13641222 ] Varun Sharma commented on HDFS-4721: One more thing, currently we do it this way: 1)

[jira] [Commented] (HDFS-4749) Use INodeId to identify the corresponding directory node for FSImage saving/loading

2013-04-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641225#comment-13641225 ] Jing Zhao commented on HDFS-4749: - Another issue of using path is that it cannot handle (or

[jira] [Updated] (HDFS-4749) Use INodeId to identify the corresponding directory node for FSImage saving/loading

2013-04-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4749: Attachment: HDFS-4749.000.patch Initial patch. Use INodeId to identify the corresponding

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641237#comment-13641237 ] Varun Sharma commented on HDFS-4721: Sorry I mean the directory containing the File is

[jira] [Created] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brandon Li (JIRA)
Brandon Li created HDFS-4750: Summary: Support NFSv3 interface to HDFS Key: HDFS-4750 URL: https://issues.apache.org/jira/browse/HDFS-4750 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641265#comment-13641265 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- Is there anything between

[jira] [Created] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-04-24 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-4751: - Summary: TestLeaseRenewer#testThreadName flakes Key: HDFS-4751 URL: https://issues.apache.org/jira/browse/HDFS-4751 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4750: - Attachment: HADOOP-NFS-Proposal.pdf Uploaded the initial design doc. Support NFSv3

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641275#comment-13641275 ] Varun Sharma commented on HDFS-4721: So there are three messages in the 1st log snippet

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-24 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641276#comment-13641276 ] Varun Sharma commented on HDFS-4721: I have already pasted every single line for the

[jira] [Commented] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641284#comment-13641284 ] Hadoop QA commented on HDFS-4748: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-04-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4751: -- Attachment: hdfs-4751-1.patch Teensy patch attached. Synchronizing on the DFSClient should make it

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641295#comment-13641295 ] Hadoop QA commented on HDFS-4305: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641309#comment-13641309 ] Brock Noland commented on HDFS-4750: Hi Brandon, Great to see this proposal! I am fine

[jira] [Resolved] (HDFS-252) Export the HDFS file system through a NFS protocol

2013-04-24 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-252. - Resolution: Duplicate Export the HDFS file system through a NFS protocol

[jira] [Commented] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641379#comment-13641379 ] Brandon Li commented on HDFS-4750: -- Hi Brock, I was about to send you the link to this

[jira] [Commented] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

2013-04-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641382#comment-13641382 ] Suresh Srinivas commented on HDFS-4745: --- +1 for the patch.

[jira] [Updated] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4750: - Description: Access HDFS is usually done through HDFS Client or webHDFS. Lack of seamless integration

[jira] [Commented] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641394#comment-13641394 ] Todd Lipcon commented on HDFS-4750: --- bq. For the second question, as long as the second

[jira] [Updated] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

2013-04-24 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4745: -- Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-4525) Provide an API for knowing that whether file is closed or not.

2013-04-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-4525: - Attachment: 4525-1.1.txt Patch for hadoop 1.1 Provide an API for knowing that whether file is

[jira] [Commented] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

2013-04-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641411#comment-13641411 ] Hudson commented on HDFS-4745: -- Integrated in Hadoop-trunk-Commit #3661 (See

<    1   2