Re: Using Hbase as data sink

2008-12-26 Thread stack
Jim Twensky wrote: ... I tried to look around to find a method to get the partitioner via JobConf but there is no such thing. Does http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/JobConf.html#setPartitionerClass(java.lang.Class) not work for you? St.Ack

Re: Using Hbase as data sink

2008-12-24 Thread Jim Twensky
Hi again, Pardon me but which 'run' method? Why do you not have access? Its a public class? (Sorry if I'm missing an obvious -- still on first cup of coffee). So here is how my class looks like: public class PhraseGenerator extends Configured implements Tool { ... public int

RE: Using Hbase as data sink

2008-12-22 Thread Jonathan Gray
[mailto:jim.twen...@gmail.com] Sent: Monday, December 22, 2008 12:38 PM To: hbase-user@hadoop.apache.org Subject: Using Hbase as data sink Hello, I have an application which is similar to the word count example given on the Hadoop Map/Reduce tutorial. Instead of counting the words however, I count

Re: Using Hbase as data sink

2008-12-22 Thread Jim Twensky
of the class, initialize it in the job initialization, and just reuse the same one in each reducer task. JG -Original Message- From: Jim Twensky [mailto:jim.twen...@gmail.com] Sent: Monday, December 22, 2008 12:38 PM To: hbase-user@hadoop.apache.org Subject: Using Hbase as data

Re: Using Hbase as data sink

2008-12-22 Thread Jim Twensky
Thank you, that really helped, I appreciate it. I have a final question about the following code you posted: if (partitioner != null) { job.setPartitionerClass(HRegionPartitioner.class); HTable outputTable = new HTable(new HBaseConfiguration(job), table); int regions =