[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107148#comment-14107148 ] Doug Cutting commented on HDFS-3689: bq. Right now these file formats need to accept "t

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104536#comment-14104536 ] Doug Cutting commented on HDFS-3689: [~sureshms], variable length blocks would permit a

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-20 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104363#comment-14104363 ] Doug Cutting commented on HDFS-3689: +1 for sparse files. They could provide the same

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091434#comment-14091434 ] Doug Cutting commented on HDFS-3689: Many applications assume that blocks but the last

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-07-18 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066507#comment-14066507 ] Doug Cutting commented on HDFS-6382: bq. But the trash emptier runs inside NN as a daem

[jira] [Commented] (HDFS-4352) Encapsulate arguments to BlockReaderFactory in a class

2013-05-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13654872#comment-13654872 ] Doug Cutting commented on HDFS-4352: Best practice is to let the committer who committe

[jira] [Commented] (HDFS-4683) Per directory trash settings / trash override

2013-04-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628009#comment-13628009 ] Doug Cutting commented on HDFS-4683: With HADOOP-8689, a client that calls Trash#moveTo

[jira] [Commented] (HDFS-4605) Implement block-size independent file checksum

2013-03-15 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603669#comment-13603669 ] Doug Cutting commented on HDFS-4605: The goal here is just to make checksums independen

[jira] [Commented] (HDFS-2060) DFS client RPCs using protobufs

2011-09-08 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100466#comment-13100466 ] Doug Cutting commented on HDFS-2060: I agree that the MR2-style protocol wrappers are a

[jira] [Commented] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13099232#comment-13099232 ] Doug Cutting commented on HDFS-2298: New failure this time in a different test. I beli

[jira] [Commented] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098504#comment-13098504 ] Doug Cutting commented on HDFS-2298: The only new failure in the tests is org.apache.h

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Attachment: HDFS-2298.patch A version of the patch that's passed test-patch. > TestDfsOverAvroRpc is

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Status: Patch Available (was: Open) > TestDfsOverAvroRpc is failing on trunk > --

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Attachment: HDFS-2298.patch It turns out that adding new interfaces is a bad idea, as it requires chan

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Status: Open (was: Patch Available) > TestDfsOverAvroRpc is failing on trunk > --

[jira] [Commented] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098329#comment-13098329 ] Doug Cutting commented on HDFS-2298: For the record, Thrift doesn't support overloading

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Fix Version/s: 0.23.0 Assignee: Doug Cutting Affects Version/s: (was: 0.24.0)

[jira] [Updated] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-09-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-2298: --- Attachment: HDFS-2298.patch Even though Avro RPC is not currently used by Hadoop, checking that RPC me

[jira] [Commented] (HDFS-2298) TestDfsOverAvroRpc is failing on trunk

2011-08-30 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13094138#comment-13094138 ] Doug Cutting commented on HDFS-2298: If we hope to eventually support wire-format inter

[jira] [Commented] (HDFS-2178) Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities

2011-08-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089078#comment-13089078 ] Doug Cutting commented on HDFS-2178: I prefer we use descriptive names for modules and

[jira] [Assigned] (HDFS-2128) Support for pluggable Trash policies

2011-07-13 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting reassigned HDFS-2128: -- Assignee: Usman Masood (was: dhruba borthakur) I think the patch looks generally good and this

[jira] [Commented] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2011-04-15 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13020367#comment-13020367 ] Doug Cutting commented on HDFS-1804: Dhruba, I meant biased by available free space. R

[jira] [Commented] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2011-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13016005#comment-13016005 ] Doug Cutting commented on HDFS-1804: Maybe a biased round robin? E.g., you might track

[jira] Commented: (HDFS-1742) Provide hooks / callbacks to execute some code based on events happening in HDFS (file / directory creation, opening, closing, etc)

2011-03-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005137#comment-13005137 ] Doug Cutting commented on HDFS-1742: Ha! I now see that this is what Alejandro already

[jira] Commented: (HDFS-1742) Provide hooks / callbacks to execute some code based on events happening in HDFS (file / directory creation, opening, closing, etc)

2011-03-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005135#comment-13005135 ] Doug Cutting commented on HDFS-1742: I wonder if, rather than callbacks, this might loo

[jira] Commented: (HDFS-1583) Improve backup-node sync performance by wrapping RPC parameters

2011-01-13 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12981455#action_12981455 ] Doug Cutting commented on HDFS-1583: ObjectWritable might be used by applications and ch

[jira] Commented: (HDFS-1578) First step towards data transter protocol compatibility: support DatanodeProtocol#getDataTransferProtocolVersion

2011-01-11 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980246#action_12980246 ] Doug Cutting commented on HDFS-1578: Todd: DataNodeProtocol is implemented by the NameNo

[jira] Commented: (HDFS-1488) hadoop will terminate Web service process when a hadoop mapreduce task is finished.

2010-11-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12928619#action_12928619 ] Doug Cutting commented on HDFS-1488: System.exit(), which your program calls above, kill

[jira] Commented: (HDFS-1435) Provide an option to store fsimage compressed

2010-10-13 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920513#action_12920513 ] Doug Cutting commented on HDFS-1435: Hairong, I don' think that using Avro is critical h

[jira] Commented: (HDFS-1435) Provide an option to store fsimage compressed

2010-10-07 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12919079#action_12919079 ] Doug Cutting commented on HDFS-1435: Hairong, Avro's file format has little overhead. I

[jira] Updated: (HDFS-1367) Add alternative search-provider to HDFS site

2010-09-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-1367: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Assignee: Alex Bara

[jira] Commented: (HDFS-1367) Add alternative search-provider to HDFS site

2010-09-14 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12909498#action_12909498 ] Doug Cutting commented on HDFS-1367: If no one objects, I will commit this soon. It's a

[jira] Commented: (HDFS-1335) HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNode

2010-08-13 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12898345#action_12898345 ] Doug Cutting commented on HDFS-1335: Thanks for elaborating. This patch seems fine: it'

[jira] Commented: (HDFS-1335) HDFS side of HADOOP-6904: first step towards inter-version communications between dfs client and NameNode

2010-08-09 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896655#action_12896655 ] Doug Cutting commented on HDFS-1335: If I understand the patch correctly, it still requi

[jira] Commented: (HDFS-202) Add a bulk FIleSystem.getFileBlockLocations

2010-07-29 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893877#action_12893877 ] Doug Cutting commented on HDFS-202: --- By default I think exceptions should be thrown. This

[jira] Commented: (HDFS-202) Add a bulk FIleSystem.getFileBlockLocations

2010-07-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12891828#action_12891828 ] Doug Cutting commented on HDFS-202: --- > My question is whether this new API should handle re

[jira] Commented: (HDFS-202) Add a bulk FIleSystem.getFileBlockLocations

2010-07-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12891763#action_12891763 ] Doug Cutting commented on HDFS-202: --- > I am not sure what should we do if a child of the in

[jira] Commented: (HDFS-1253) bin/hdfs conflicts with common user shortcut

2010-06-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882723#action_12882723 ] Doug Cutting commented on HDFS-1253: Are there others who agree with Allen on this? I s

[jira] Commented: (HDFS-1266) Missing license headers in branch-20-append

2010-06-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12882231#action_12882231 ] Doug Cutting commented on HDFS-1266: Perhaps rat should be run as part of the normal pat

[jira] Commented: (HDFS-1083) Update TestHDFSCLI to not to expect exception class name in the error messages

2010-04-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12859583#action_12859583 ] Doug Cutting commented on HDFS-1083: +1 This looks good. Thanks, Suresh! > Update Test

[jira] Commented: (HDFS-1083) Update TestHDFSCLI to not to expect exception class name in the error messages

2010-04-12 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856174#action_12856174 ] Doug Cutting commented on HDFS-1083: Hmm. Shouldn't both a RemoteException or the prope

[jira] Commented: (HDFS-1083) Update TestHDFSCLI to not to expect exception class name in the error messages

2010-04-06 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854251#action_12854251 ] Doug Cutting commented on HDFS-1083: In my patch for HDFS-1076 I removed unwrapped excep

[jira] Commented: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853715#action_12853715 ] Doug Cutting commented on HDFS-1076: > While unwrapping, I propose removing the ": " fro

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853713#action_12853713 ] Doug Cutting commented on HDFS-892: --- > If you require it at compile time, why bother with m

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853630#action_12853630 ] Doug Cutting commented on HDFS-892: --- > Q. Doug, Any reason why you didn't define the @Nulla

[jira] Commented: (HDFS-1077) namenode RPC protocol method names are overloaded

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853620#action_12853620 ] Doug Cutting commented on HDFS-1077: > However, if a server implements multiple independ

[jira] Commented: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853614#action_12853614 ] Doug Cutting commented on HDFS-1076: HDFS-1079 doesn't alter this, because the unwrapped

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

2010-04-05 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853608#action_12853608 ] Doug Cutting commented on HDFS-892: --- Avro was not intended to be optional at compile time,

[jira] Created: (HDFS-1077) namenode RPC protocol method names are overloaded

2010-04-02 Thread Doug Cutting (JIRA)
namenode RPC protocol method names are overloaded - Key: HDFS-1077 URL: https://issues.apache.org/jira/browse/HDFS-1077 Project: Hadoop HDFS Issue Type: Sub-task Components: name-node

[jira] Commented: (HDFS-1077) namenode RPC protocol method names are overloaded

2010-04-02 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852991#action_12852991 ] Doug Cutting commented on HDFS-1077: These fall into two categories: - versionRequest a

[jira] Updated: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-02 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-1076: --- Fix Version/s: 0.22.0 Hadoop Flags: [Incompatible change] Status: Patch Available (was

[jira] Updated: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-02 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-1076: --- Attachment: HDFS-1076.patch The problem is that currently the exceptions declared in the interface are

[jira] Commented: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-02 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852975#action_12852975 ] Doug Cutting commented on HDFS-1076: This can be reproduced with ant test-core -Dtest.h

[jira] Created: (HDFS-1076) HFDS CLI error tests fail with Avro RPC

2010-04-02 Thread Doug Cutting (JIRA)
HFDS CLI error tests fail with Avro RPC --- Key: HDFS-1076 URL: https://issues.apache.org/jira/browse/HDFS-1076 Project: Hadoop HDFS Issue Type: Sub-task Components: test Reporter: Do

[jira] Commented: (HDFS-1052) HDFS scalability with multiple namenodes

2010-03-30 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12851499#action_12851499 ] Doug Cutting commented on HDFS-1052: If I follow the document, the initial implementatio

[jira] Commented: (HDFS-1069) Write HDFS wire protocols in AVRO IDL

2010-03-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850304#action_12850304 ] Doug Cutting commented on HDFS-1069: The above would be more readable in GenAvro format

[jira] Updated: (HDFS-1069) Write HDFS wire protocols in AVRO IDL

2010-03-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-1069: --- Attachment: ClientProtocol.avpr FYI, here's the Avro version of the current trunk's ClientProtocol, ge

[jira] Created: (HDFS-1066) Make HDFS tests pass using Avro RPC

2010-03-24 Thread Doug Cutting (JIRA)
Make HDFS tests pass using Avro RPC --- Key: HDFS-1066 URL: https://issues.apache.org/jira/browse/HDFS-1066 Project: Hadoop HDFS Issue Type: Bug Components: name-node Reporter: Doug Cutti

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thanks, Nichol

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) > optionally use Avro for namenode RPC > ---

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch > all the changes are compatible changes except renaming register(..) to > re

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Open (was: Patch Available) > optionally use Avro for namenode RPC > ---

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Open (was: Patch Available) Failure was in TestReadWhileWriting, which passes locally. > option

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) > optionally use Avro for namenode RPC > ---

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch Fixed the javac warning (something got deprecated since I first wrote the pat

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) > optionally use Avro for namenode RPC > ---

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-23 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Open (was: Patch Available) > optionally use Avro for namenode RPC > ---

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) Now that Avro 1.3.1 is available this should pass Hudson's tests. T

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-03-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch > optionally use Avro for namenode RPC >

[jira] Assigned: (HDFS-1001) DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK

2010-03-02 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting reassigned HDFS-1001: -- Assignee: bc Wong > DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK >

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-02-26 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch Here's a new, still preliminary, version that uses the @Nullable annotation f

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-02-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch Here's an updated patch. One can run tests using Avro serialization for RPC d

[jira] Commented: (HDFS-960) DistributedFileSystem#makeQualified port inconsistency

2010-02-09 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831550#action_12831550 ] Doug Cutting commented on HDFS-960: --- > It breaks programs that assumes DistributedFileSyste

[jira] Commented: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-03 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12829250#action_12829250 ] Doug Cutting commented on HDFS-946: --- This sounds reasonable. But the client would still re

[jira] Commented: (HDFS-916) Rewrite DFSOutputStream to use a single thread with NIO

2010-01-22 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803967#action_12803967 ] Doug Cutting commented on HDFS-916: --- Seems like this might be a candiate for netty (http://

[jira] Commented: (HDFS-717) Proposal for exceptions thrown by FileContext and Abstract File System

2010-01-19 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12802499#action_12802499 ] Doug Cutting commented on HDFS-717: --- To facilitate an eventual switch to Avro, protocols sh

[jira] Commented: (HDFS-842) Serialize NN edits log as avro records

2010-01-12 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12799318#action_12799318 ] Doug Cutting commented on HDFS-842: --- The primary Avro overhead would be that the edits sche

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

2010-01-11 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch Here's a first version of this. Default behaviour is unchanged. Passing Ant -

[jira] Created: (HDFS-892) optionally use Avro for namenode RPC

2010-01-11 Thread Doug Cutting (JIRA)
optionally use Avro for namenode RPC Key: HDFS-892 URL: https://issues.apache.org/jira/browse/HDFS-892 Project: Hadoop HDFS Issue Type: Improvement Components: name-node Reporter: Do

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-12-16 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791513#action_12791513 ] Doug Cutting commented on HDFS-245: --- +1 This looks right to me. Links should be resolved a

[jira] Commented: (HDFS-641) Move all of the benchmarks and tests that depend on mapreduce to mapreduce

2009-11-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12779005#action_12779005 ] Doug Cutting commented on HDFS-641: --- > Sharad/Hemant/Dhruba/Me all were either -1 or not +1

[jira] Commented: (HDFS-641) Move all of the benchmarks and tests that depend on mapreduce to mapreduce

2009-09-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759614#action_12759614 ] Doug Cutting commented on HDFS-641: --- > If not, what are the alternative suggestions? Perha

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-25 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759595#action_12759595 ] Doug Cutting commented on HDFS-245: --- > The FileContext API is not yet clearly baked as far

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759319#action_12759319 ] Doug Cutting commented on HDFS-245: --- Perhaps FileSystem#getFileStatus() of a symbolic link

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759226#action_12759226 ] Doug Cutting commented on HDFS-245: --- > But on Day Zero, are links in command arguments _alw

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-24 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759160#action_12759160 ] Doug Cutting commented on HDFS-245: --- A few comments on the common patch: - If we're reall

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758053#action_12758053 ] Doug Cutting commented on HDFS-245: --- Konstantin, will you help implement (IV) for 0.21? Dh

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12758046#action_12758046 ] Doug Cutting commented on HDFS-245: --- > we don't know which part of the path is a link. Und

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757953#action_12757953 ] Doug Cutting commented on HDFS-245: --- > a new method getLinkTarget() to resolve the link Is

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757947#action_12757947 ] Doug Cutting commented on HDFS-245: --- Sanjay> Exceptions should match the layer of abstracti

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-18 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757515#action_12757515 ] Doug Cutting commented on HDFS-245: --- My position is the same as I stated in: https://issue

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-18 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757471#action_12757471 ] Doug Cutting commented on HDFS-245: --- > Doug's counter argument to this is that the whole HD

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756874#action_12756874 ] Doug Cutting commented on HDFS-245: --- > Also, is there any performance difference between th

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

2009-09-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756829#action_12756829 ] Doug Cutting commented on HDFS-222: --- That sounds reasonable. > Support for concatenating o

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-09-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756732#action_12756732 ] Doug Cutting commented on HDFS-245: --- The most succinct test I've come up with for when it's

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

2009-09-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12756715#action_12756715 ] Doug Cutting commented on HDFS-222: --- This sounds good to me. It might be simplest if the s

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

2009-09-15 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12755619#action_12755619 ] Doug Cutting commented on HDFS-222: --- > add this to distributedFileSystem and not FileSystem

[jira] Commented: (HDFS-202) Add a bulk FIleSystem.getFileBlockLocations

2009-09-15 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12755607#action_12755607 ] Doug Cutting commented on HDFS-202: --- +1 > Add a bulk FIleSystem.getFileBlockLocations > -

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-09-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753883#action_12753883 ] Doug Cutting commented on HDFS-611: --- > Why is the heartbeat thread involved with block dele

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

2009-09-10 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753861#action_12753861 ] Doug Cutting commented on HDFS-611: --- If it's i/o bound it could make sense to have one thre

  1   2   >