[jira] [Commented] (HDFS-2018) Move all journal stream management code into one place

2011-06-05 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044729#comment-13044729 ] Jitendra Nath Pandey commented on HDFS-2018: I think FSImageTransactionalStor

[jira] [Commented] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044721#comment-13044721 ] Hudson commented on HDFS-1969: -- Integrated in Hadoop-Hdfs-trunk-Commit #714 (See [https://bui

[jira] [Updated] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1969: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Than

[jira] [Created] (HDFS-2037) Clean up use of Storage.setFields() within tests

2011-06-05 Thread Todd Lipcon (JIRA)
Clean up use of Storage.setFields() within tests - Key: HDFS-2037 URL: https://issues.apache.org/jira/browse/HDFS-2037 Project: Hadoop HDFS Issue Type: Improvement Components: name-n

[jira] [Commented] (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2011-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044715#comment-13044715 ] Hadoop QA commented on HDFS-941: -1 overall. Here are the results of testing the latest att

[jira] [Updated] (HDFS-1148) Convert FSDataset to ReadWriteLock

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1148: -- Status: Patch Available (was: Open) > Convert FSDataset to ReadWriteLock >

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044714#comment-13044714 ] Todd Lipcon commented on HDFS-1148: --- Uploaded another copy of the diff that ignores white

[jira] [Updated] (HDFS-1148) Convert FSDataset to ReadWriteLock

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1148: -- Attachment: hdfs-1148-trunk.txt Here's a patch against trunk. When combined with HDFS-941, this yields

[jira] [Commented] (HDFS-1148) Convert FSDataset to ReadWriteLock

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044712#comment-13044712 ] Todd Lipcon commented on HDFS-1148: --- As I was updating HDFS-941 to trunk tonight, I took

[jira] [Created] (HDFS-2036) Revise the HDFS design documentation

2011-06-05 Thread Harsh J (JIRA)
Revise the HDFS design documentation Key: HDFS-2036 URL: https://issues.apache.org/jira/browse/HDFS-2036 Project: Hadoop HDFS Issue Type: Improvement Components: documentation Affects Versio

[jira] [Updated] (HDFS-2036) Revise the HDFS design documentation

2011-06-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2036: -- Attachment: HDFS-2036.r1.diff > Revise the HDFS design documentation > > >

[jira] [Resolved] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-1454. --- Resolution: Fixed Re-resolving per Todd's suggestion. Opened: HDFS-2036 > Update the documentation to reflec

[jira] [Updated] (HDFS-1323) Pool/share file channels for HDFS read

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1323: -- Status: Open (was: Patch Available) looks like this needs some more work based on failing tests above.

[jira] [Commented] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044702#comment-13044702 ] Todd Lipcon commented on HDFS-1454: --- hrm, since we already committed this a few days ago,

[jira] [Resolved] (HDFS-380) support for persistent connections to improve random read performance.

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-380. -- Resolution: Duplicate Resolving as duplicate of HDFS-941 > support for persistent connections to improve

[jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node

2011-06-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044700#comment-13044700 ] Aaron T. Myers commented on HDFS-2004: -- bq. I'm vetoing the very concept of a client b

[jira] [Commented] (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044698#comment-13044698 ] Todd Lipcon commented on HDFS-941: -- oops, the last line of my benchmark results got truncat

[jira] [Updated] (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-941: - Attachment: hdfs-941.txt Attached patch rebased against trunk and improved in the following ways: - moved

[jira] [Updated] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-1454: -- Attachment: HDFS-1454-reop.r1.diff > Update the documentation to reflect true client caching strategy >

[jira] [Updated] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-1454: -- Attachment: HDFS-1454-reop.r1.diff Fix the default packet size. > Update the documentation to reflect true clie

[jira] [Reopened] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened HDFS-1454: --- @Eli - Failed to actually verify the entire documents. Patch was intended to only remove staging, but I should've

[jira] [Commented] (HDFS-1619) Does libhdfs really need to depend on AC_TYPE_INT16_T, AC_TYPE_INT32_T, AC_TYPE_INT64_T and AC_TYPE_UINT16_T ?

2011-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044691#comment-13044691 ] Hadoop QA commented on HDFS-1619: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1323) Pool/share file channels for HDFS read

2011-06-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044689#comment-13044689 ] Hadoop QA commented on HDFS-1323: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node

2011-06-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044688#comment-13044688 ] Allen Wittenauer commented on HDFS-2004: I'm vetoing the very concept of a client b

[jira] [Updated] (HDFS-1619) Does libhdfs really need to depend on AC_TYPE_INT16_T, AC_TYPE_INT32_T, AC_TYPE_INT64_T and AC_TYPE_UINT16_T ?

2011-06-05 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1619: -- Attachment: hdfs-1619-2.patch bq. IIRC, using // is a comment for C code is defined as a standard in C99

[jira] [Commented] (HDFS-1323) Pool/share file channels for HDFS read

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044678#comment-13044678 ] Todd Lipcon commented on HDFS-1323: --- Some thoughts on the patch while I was updating it:

[jira] [Commented] (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044677#comment-13044677 ] Todd Lipcon commented on HDFS-918: -- I rebased just the pooling part of the patch and posted

[jira] [Updated] (HDFS-1323) Pool/share file channels for HDFS read

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1323: -- Status: Patch Available (was: Open) > Pool/share file channels for HDFS read >

[jira] [Updated] (HDFS-1323) Pool/share file channels for HDFS read

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1323: -- Attachment: hdfs-1323-trunk.txt updated Jay's path to trunk. not particularly tested yet > Pool/share f

[jira] [Commented] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-06-05 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044673#comment-13044673 ] Eli Collins commented on HDFS-1969: --- Forgot to mention, 1 nit: "laytouVersions" > Runnin

[jira] [Commented] (HDFS-1969) Running rollback on new-version namenode destroys namespace

2011-06-05 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044672#comment-13044672 ] Eli Collins commented on HDFS-1969: --- +1 latest patch lgtm.Mind filing another jira f

[jira] [Commented] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044667#comment-13044667 ] Eli Collins commented on HDFS-1454: --- {quote} DataNode starts receiving the data in small

[jira] [Commented] (HDFS-1923) Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29

2011-06-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044646#comment-13044646 ] Todd Lipcon commented on HDFS-1923: --- Hey Nicholas. Those semantics are kind of surprising

[jira] [Resolved] (HDFS-639) dfs does not support -rmdir

2011-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-639. -- Resolution: Invalid This is actually change in hadoop core. Existing jira is HADOOP-6385. > dfs does no

[jira] [Assigned] (HDFS-639) dfs does not support -rmdir

2011-06-05 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-639: Assignee: Daryn Sharp > dfs does not support -rmdir > --- > >

[jira] [Commented] (HDFS-2004) Enable replicating and pinning files to a data node

2011-06-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044613#comment-13044613 ] Aaron T. Myers commented on HDFS-2004: -- @Allen, what exactly are you vetoing, and for

[jira] [Commented] (HDFS-2029) Improve TestWriteRead

2011-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044518#comment-13044518 ] Hudson commented on HDFS-2029: -- Integrated in Hadoop-Hdfs-trunk #688 (See [https://builds.apa

[jira] [Commented] (HDFS-1907) BlockMissingException upon concurrent read and write: reader was doing file position read while writer is doing write without hflush

2011-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044516#comment-13044516 ] Hudson commented on HDFS-1907: -- Integrated in Hadoop-Hdfs-trunk #688 (See [https://builds.apa

[jira] [Commented] (HDFS-2019) Fix all the places where Java method File.list is used with FileUtil.list API

2011-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044517#comment-13044517 ] Hudson commented on HDFS-2019: -- Integrated in Hadoop-Hdfs-trunk #688 (See [https://builds.apa

[jira] [Commented] (HDFS-1454) Update the documentation to reflect true client caching strategy

2011-06-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13044515#comment-13044515 ] Hudson commented on HDFS-1454: -- Integrated in Hadoop-Hdfs-trunk #688 (See [https://builds.apa