[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: hadoop-blockcache-v4.1.patch Fixing the v4 patch which was corrupt. > Add in-mem

[jira] Issue Comment Edited: (HADOOP-1398) Add in-memory caching of data

2008-01-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560991#action_12560991 ] tomwhite edited comment on HADOOP-1398 at 1/21/08 3:50 AM: bq.

[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: hadoop-blockcache-v4.patch bq. In the below from HStoreFile, blockCacheEnabled method

[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-18 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: commons-collections-3.2.jar New dependency to go in src/contrib/hbase/lib/. > Add

[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-18 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: hadoop-blockcache-v3.patch This version (v3) changes the cache to a memory sensitive

[jira] Commented: (HADOOP-1398) Add in-memory caching of data

2008-01-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12560091#action_12560091 ] Tom White commented on HADOOP-1398: --- I'm trying to add a new par

Re: [VOTE] Release Hadoop 0.15.3 (candidate 0)

2008-01-17 Thread Tom White
+1 Based on running tests and checking signatures. Tom On 16/01/2008, Nigel Daley <[EMAIL PROTECTED]> wrote: > I've created a candidate build for Hadoop 0.15.3. > >http://people.apache.org/~nigel/hadoop-0.15.3-candidate-0/ > > Should we release this? > > Nigel > > -- Blog: http://problems

[jira] Commented: (HADOOP-2625) Add JMeter performance test for HBase

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559576#action_12559576 ] Tom White commented on HADOOP-2625: --- Instructions for use: 1. Install Apache JMet

[jira] Updated: (HADOOP-2625) Add JMeter performance test for HBase

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2625: -- Attachment: hbase.jmx > Add JMeter performance test for HB

[jira] Updated: (HADOOP-2625) Add JMeter performance test for HBase

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2625: -- Attachment: hbench.jar > Add JMeter performance test for HB

[jira] Created: (HADOOP-2625) Add JMeter performance test for HBase

2008-01-16 Thread Tom White (JIRA)
: Tom White Assignee: Tom White The PerformanceEvaluation test is good for running benchmarks, but is not really designed for learning about the performance of HBase for real world datasets. By using JMeter we can test HBase to discover its average response time under different loads

[jira] Commented: (HADOOP-2604) [hbase] Create an HBase-specific MapFile implementation

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559528#action_12559528 ] Tom White commented on HADOOP-2604: --- If MapFile.Reader were an interface (o

[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: hadoop-blockcache-v2.patch A second patch with minimal changes to MapFile.Reader - there

[jira] Commented: (HADOOP-1398) Add in-memory caching of data

2008-01-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559498#action_12559498 ] Tom White commented on HADOOP-1398: --- bq. You pass 'length' in the bel

[jira] Commented: (HADOOP-2604) [hbase] Create an HBase-specific MapFile implementation

2008-01-15 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559105#action_12559105 ] Tom White commented on HADOOP-2604: --- The current design of MapFile.Reader make

[jira] Updated: (HADOOP-1398) Add in-memory caching of data

2008-01-15 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1398: -- Attachment: hadoop-blockcache.patch Here is an initial implementation - feedback would be much

[jira] Updated: (HADOOP-2532) Add to MapFile a getClosest that returns key that comes just-before if key not present (Currently does just-after only).

2008-01-15 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2532: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-2494) Set +x on contrib/*/bin/* in packaged tar bundle

2008-01-15 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2494: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Created: (HADOOP-2597) [hbase] Performance - add a block cache

2008-01-14 Thread Tom White (JIRA)
Reporter: Tom White A block cache would cache fixed size blocks (default 64k) of data read from HDFS by the MapFile. It would help read performance for data close to recently read data (see Bigtable paper, section 6). It would be configurable on a per-column family basis. -- This message is

Re: [VOTE] Release Hadoop 0.15.2 (candidate 0)

2008-01-08 Thread Tom White
+1 I ran unit tests and checked the signatures. Tom On 30/12/2007, Nigel Daley <[EMAIL PROTECTED]> wrote: > I've created a candidate build for Hadoop 0.15.2. > >http://people.apache.org/~nigel/hadoop-0.15.2-candidate-0/ > > Should we release this? > > Nigel > -- Blog: http://problemsworth

[jira] Updated: (HADOOP-2522) [hbase] Separate MapFile benchmark from PerformanceEvaluation

2008-01-04 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2522: -- Status: Patch Available (was: Open) > [hbase] Separate MapFile benchmark from PerformanceEvaluat

[jira] Commented: (HADOOP-2522) [hbase] Separate MapFile benchmark from PerformanceEvaluation

2008-01-04 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12555984#action_12555984 ] Tom White commented on HADOOP-2522: --- Yes please. > [hbase] Separate MapFile be

[jira] Updated: (HADOOP-2522) [hbase] Separate MapFile benchmark from PerformanceEvaluation

2008-01-04 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2522: -- Attachment: commons-math-1.1.jar Commons Math library dependency. > [hbase] Separate MapF

[jira] Updated: (HADOOP-2522) [hbase] Separate MapFile benchmark from PerformanceEvaluation

2008-01-04 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2522: -- Attachment: HADOOP-2522.patch This patch moves the MapFile benchmarks to a new class

[jira] Created: (HADOOP-2522) [hbase] Separate MapFile benchmark from PerformanceEvaluation

2008-01-04 Thread Tom White (JIRA)
Components: contrib/hbase Reporter: Tom White Assignee: Tom White Although related to Hbase the MapFile benchmark in PerformanceEvaluation does not use Hbase to run, and sits awkwardly in the PerformanceEvaluation class. It should be broken out into its own class

[jira] Created: (HADOOP-2474) Automate EC2 DynDNS setup

2007-12-20 Thread Tom White (JIRA)
Automate EC2 DynDNS setup - Key: HADOOP-2474 URL: https://issues.apache.org/jira/browse/HADOOP-2474 Project: Hadoop Issue Type: Improvement Components: contrib/ec2 Reporter: Tom White Use the

[jira] Created: (HADOOP-2473) EC2 termination script should support termination by group

2007-12-20 Thread Tom White (JIRA)
Components: contrib/ec2 Reporter: Tom White The termination script currently terminates all hadoop instances (after user confirmation). It is therefore not suitable when running multiple, independent clusters on EC2. This change would make it possible to run independent clusters in

[jira] Commented: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12553401 ] Tom White commented on HADOOP-2342: --- I got the same error running the same distribution on Linux too. One fix

[jira] Updated: (HADOOP-2426) TestLocalFileSystemPermission fails in mac

2007-12-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2426: -- Attachment: HADOOP-2426.patch The failure I'm getting is not related to the group name l

Re: Hadoop TLP?

2007-12-13 Thread Tom White
+1 On 13/12/2007, Doug Cutting <[EMAIL PROTECTED]> wrote: > I think it is time that we make Hadoop a top level project (TLP) at > Apache, hadoop.apache.org, leaving our current home as a Lucene > subproject. HBase could become a sub-project, as could Pig (now > incubating) and perhaps others. > >

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-12-13 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12551606 ] Tom White commented on HADOOP-1986: --- > I remain convinced that the > use of templated types at all in our

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-12-13 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12551605 ] Tom White commented on HADOOP-1986: --- > I think including at least one non-Writable serializer in the init

[jira] Created: (HADOOP-2411) Add support for larger EC2 instance types

2007-12-12 Thread Tom White (JIRA)
Reporter: Tom White Need to configure Hadoop to exploit the resources available on larger instance types: 64bit, extra CPUs, larger memory. See http://docs.amazonwebservices.com/AWSEC2/2007-08-29/DeveloperGuide/instance-types.html -- This message is automatically generated by JIRA. - You can

[jira] Commented: (HADOOP-2410) Make EC2 cluster nodes more independent of each other

2007-12-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550995 ] Tom White commented on HADOOP-2410: --- Another motivation for this change is to make it more straightforward to add

[jira] Updated: (HADOOP-2410) Make EC2 cluster nodes more independent of each other

2007-12-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-2410: -- Component/s: contrib/ec2 > Make EC2 cluster nodes more independent of each ot

[jira] Created: (HADOOP-2410) Make EC2 cluster nodes more independent of each other

2007-12-12 Thread Tom White (JIRA)
: Tom White The cluster start up scripts currently wait for each node to start up before appointing a master (to run the namenode and jobtracker on), and copying private keys to all the nodes, and writing the private IP address of the master to the hadoop-site.xml file (which is then copied to

[jira] Created: (HADOOP-2409) Make EC2 image independent of Hadoop version

2007-12-12 Thread Tom White (JIRA)
Reporter: Tom White Instead of building a new image for each released version of Hadoop, install Hadoop on instance start up. Since it is a small download this would not add significantly to startup time. Hadoop releases would be mirrored on S3 for scalability (and to avoid bandwidth

[jira] Commented: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549480 ] Tom White commented on HADOOP-2342: --- I built a distribution with this patch and got the following error. It looks

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-11-28 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12546424 ] Tom White commented on HADOOP-1986: --- I've attached a second patch, serializer-v2.patch, which ha

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-11-28 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Attachment: hadoop-serializer-v2.tar.gz > Add support for a general serialization mechanism for

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-11-28 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Attachment: serializer-v2.patch > Add support for a general serialization mechanism for Map Red

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536334 ] Tom White commented on HADOOP-1986: --- >> Except there might not be enough type information to construct an

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536322 ] Tom White commented on HADOOP-1986: --- > Clients which wish to reuse objects can, the first time, pass n

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536201 ] Tom White commented on HADOOP-1986: --- Vivek, I was thinking of the first way. > Frameworks that expect

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536153 ] Tom White commented on HADOOP-1986: --- > what's the compatibility path for all applications written with &

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-19 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12536148 ] Tom White commented on HADOOP-1986: --- Doug/Owen These changes generally look good - I'll try to work them i

[jira] Updated: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1986: -- Attachment: serializer-v1.patch Here's a patch (serializer-v1.patch) for discussion. It's s

[jira] Commented: (HADOOP-2068) [hbase] RESTful interface

2007-10-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12535729 ] Tom White commented on HADOOP-2068: --- Generally looks good. A few comments: 1. 401 is "Unauthorized",

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-15 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534982 ] Tom White commented on HADOOP-1986: --- I've now run into WritableComparator which needs to be generalized t

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-11 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534132 ] Tom White commented on HADOOP-1986: --- > Do I worry too much? I don't think so - I was actually worrying a

[jira] Commented: (HADOOP-1936) WordCount unit test plus a helper class to facilitate testing Mappers and Reducers

2007-10-09 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12533496 ] Tom White commented on HADOOP-1936: --- Sorry to come to this so late, but I would vote to use a mock object library

[jira] Assigned: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-09 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White reassigned HADOOP-1986: - Assignee: Tom White > Add support for a general serialization mechanism for Map Red

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532999 ] Tom White commented on HADOOP-1986: --- Dennis, > Here is a SerializableWritable implementation that we curren

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532998 ] Tom White commented on HADOOP-1986: --- Vivek, > I'm thinking about serialization not just for key-value p

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-03 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12532243 ] Tom White commented on HADOOP-1986: --- > Do you have a proposal for how to implement this? If we follow Owe

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-02 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531930 ] Tom White commented on HADOOP-1986: --- Is the idea here to use the target class to decide which Serializer to use

[jira] Commented: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-02 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12531912 ] Tom White commented on HADOOP-1986: --- Here's an initial plan: 1. Remove the requirement for Map Reduce typ

[jira] Created: (HADOOP-1986) Add support for a general serialization mechanism for Map Reduce

2007-10-02 Thread Tom White (JIRA)
Feature Components: mapred Reporter: Tom White Fix For: 0.16.0 Currently Map Reduce programs have to use WritableComparable-Writable key-value pairs. While it's possible to write Writable wrappers for other serialization frameworks (such as Thrift), this is not

[jira] Updated: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-23 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1783: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed

[jira] Updated: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-23 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1783: -- Attachment: HADOOP-1783-branch-0.14.patch > keyToPath in Jets3tFileSystemStore needs to ret

[jira] Commented: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12528126 ] Tom White commented on HADOOP-1783: --- I've just added HADOOP-1909 for the fix for other implementa

[jira] Assigned: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White reassigned HADOOP-1783: - Assignee: Tom White > keyToPath in Jets3tFileSystemStore needs to return absolute p

[jira] Updated: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-17 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1783: -- Fix Version/s: 0.15.0 0.14.2 Affects Version/s: (was: 0.11.2

[jira] Created: (HADOOP-1909) All FileSystem implementations should return Paths fully-qualified with scheme and host

2007-09-17 Thread Tom White (JIRA)
Project: Hadoop Issue Type: Improvement Components: dfs, fs, fs/s3 Affects Versions: 0.14.1 Reporter: Tom White This change should include a change to FileSystem's javadoc, changes to all FileSystem implementations to make sure they conform, and some unit

[jira] Commented: (HADOOP-1894) Add fancy graphs for mapred task statuses

2007-09-14 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12527486 ] Tom White commented on HADOOP-1894: --- bq. do you think the sparklines would be useful? I was thinking that

[jira] Commented: (HADOOP-1894) Add fancy graphs for mapred task statuses

2007-09-14 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12527417 ] Tom White commented on HADOOP-1894: --- Nice. I wonder whether we could use sparklines to keep the display very

[jira] Updated: (HADOOP-1889) Fix path in EC2 scripts for building your own AMI

2007-09-14 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1889: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-1889) Fix path in EC2 scripts for building your own AMI

2007-09-13 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1889: -- Status: Patch Available (was: Open) > Fix path in EC2 scripts for building your own

[jira] Updated: (HADOOP-1889) Fix path in EC2 scripts for building your own AMI

2007-09-13 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1889: -- Attachment: HADOOP-1889.patch Patch also updates Hadoop and Java versions. > Fix path in EC2 scri

[jira] Created: (HADOOP-1889) Fix path in EC2 scripts for building your own AMI

2007-09-13 Thread Tom White (JIRA)
Affects Versions: 0.14.1 Reporter: Tom White Assignee: Tom White Fix For: 0.15.0 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

Re: [VOTE] Release 0.14.1 (candidate 0)

2007-09-03 Thread Tom White
+1 Based on some simple tests and sanity checks. Tom On 30/08/07, Doug Cutting <[EMAIL PROTECTED]> wrote: > I've created a candidate build for Hadoop 0.14.1. > >http://people.apache.org/~cutting/hadoop-0.14.1-candidate-0/ > > Should we release this? > > Doug >

[jira] Commented: (HADOOP-1827) Reducer.reduce method's OutputCollector is too strict, it shoudn't need the key to be WritableComparable

2007-09-03 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12524530 ] Tom White commented on HADOOP-1827: --- This also came up when retrofitting generics in HADOOP-1231 (in fact, it

[jira] Updated: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-09-01 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1783: -- Attachment: HADOOP-1783.patch Hi Ahad, bq. But, ultimately, if you look at the DistributedFileSystem

[jira] Commented: (HADOOP-1568) NameNode Schema for HttpFileSystem

2007-08-31 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12524191 ] Tom White commented on HADOOP-1568: --- Doug - thanks for the clarification. > NameNode Schema for HttpFileSys

[jira] Commented: (HADOOP-1568) NameNode Schema for HttpFileSystem

2007-08-31 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12524181 ] Tom White commented on HADOOP-1568: --- Sorry, just had a chance to look at this (been on vacation), and I had a few

[jira] Commented: (HADOOP-1783) keyToPath in Jets3tFileSystemStore needs to return absolute path

2007-08-31 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12524174 ] Tom White commented on HADOOP-1783: --- All paths in Jets3tFileSystemStore are absolute - they begin with '/&#

[jira] Updated: (HADOOP-1810) Incorrect Value type in MRBench (SmallJobs)

2007-08-31 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1810: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] Issue Comment Edited: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-10 Thread Tom White (JIRA)
URL: https://issues.apache.org/jira/browse/HADOOP-1231 > Project: Hadoop > Issue Type: Improvement > Components: mapred >Reporter: Owen O'Malley >Assignee: Tom White > Fix For: 0.15.0 > &

[jira] Commented: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-10 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12518932 ] Tom White commented on HADOOP-1231: --- >This looks good. The only thing I noticed is that in cases where you do

[jira] Updated: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-09 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1231: -- Attachment: HADOOP-1231-1.patch Synced with trunk. > Add generics to Mapper and Reducer interfa

[jira] Updated: (HADOOP-1651) Some improvements in progress reporting

2007-08-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1651: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-1610) Add metrics for failed tasks

2007-08-06 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1610: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

Re: [jira] Commented: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-06 Thread Tom White
to fail a patch build if these rules > are violated. Since the checkstyle stuff is only half implemented in > the patch process, I'll just remove it and resubmit your patch. > > > On Aug 5, 2007, at 1:33 PM, Tom White (JIRA)

[jira] Commented: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12517788 ] Tom White commented on HADOOP-1231: --- Hmm. Hudson says that patching src/test/checkstyle.xml failed, but it is OK

[jira] Created: (HADOOP-1683) Check MapReduce types for consistency

2007-08-05 Thread Tom White (JIRA)
: Tom White It is possible to configure MapReduce programs to use an inconsistent set of types. Although some runtime checks are carried out, there are more that can be done as described in HADOOP-1231. -- This message is automatically generated by JIRA. - You can reply to this email to add a

[jira] Updated: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1231: -- Fix Version/s: 0.15.0 Status: Patch Available (was: Open) > Add generics to Mapper

[jira] Updated: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-08-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1231: -- Attachment: HADOOP-1231.patch This patch (HADOOP-1231.patch) makes the Map Reduce public API generic

Re: [VOTE] Release 0.13.1 (candidate 1)

2007-07-25 Thread Tom White
+1 Based on some small scale testing on Linux and Mac OS X. Tom On 23/07/07, Doug Cutting <[EMAIL PROTECTED]> wrote: I've created another candidate build for Hadoop 0.13.1. This incorporates HADOOP-1396 , which, as Nigel noted, was missing the first time around. http://people.apache.org/~

Re: ec2 bugs & 0.13.1 release

2007-07-22 Thread Tom White
This is now done. On 21/07/07, Tom White <[EMAIL PROTECTED]> wrote: I've started looking at them and think HADOOP-1635 (Keypair Name Hardcoded) and HADOOP-1634 (EC2 launch-hadoop-cluster awk Problem) are straightforward and I'll get these committed to the 0.13 branch this weeke

[jira] Updated: (HADOOP-1638) Master node unable to bind to DNS hostname

2007-07-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1638: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-1635) Keypair Name Hardcoded

2007-07-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1635: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-1634) EC2 launch-hadoop-cluster awk Problem

2007-07-22 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1634: -- Resolution: Fixed Status: Resolved (was: Patch Available) Included in HADOOP-1635. >

[jira] Commented: (HADOOP-1638) Master node unable to bind to DNS hostname

2007-07-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12514425 ] Tom White commented on HADOOP-1638: --- This problem was caused by the changes made in Amazon EC2 addressing

Re: ec2 bugs & 0.13.1 release

2007-07-21 Thread Tom White
I've started looking at them and think HADOOP-1635 (Keypair Name Hardcoded) and HADOOP-1634 (EC2 launch-hadoop-cluster awk Problem) are straightforward and I'll get these committed to the 0.13 branch this weekend. HADOOP-1638 (Master node unable to bind to DNS hostname) looks more complex, and I'

[jira] Commented: (HADOOP-1638) Master node unable to bind to DNS hostname

2007-07-20 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12514291 ] Tom White commented on HADOOP-1638: --- The hadoop-site.xml is created on node startup using the hostname passed in

[jira] Commented: (HADOOP-1634) EC2 launch-hadoop-cluster awk Problem

2007-07-20 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12514287 ] Tom White commented on HADOOP-1634: --- I've been using ec2-api-tools-1.2-7546 (the previous release I think

[jira] Updated: (HADOOP-1231) Add generics to Mapper and Reducer interfaces

2007-07-16 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1231: -- Attachment: MapReduceTypes.html Due to the problems with erasure mentioned above I don't think w

[jira] Commented: (HADOOP-1598) Fix License headers

2007-07-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512267 ] Tom White commented on HADOOP-1598: --- We could get checkstyle to enforce this: http://checkstyle.sourceforge.net

[jira] Updated: (HADOOP-1433) Add job priority

2007-07-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1433: -- Resolution: Fixed Status: Resolved (was: Patch Available) I've just committed this. T

[jira] Updated: (HADOOP-1547) Provide examples for aggregate library

2007-07-12 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HADOOP-1547: -- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available

  1   2   3   4   5   >