Re: Map Reduce performance

Hi Eric/Tim, Thanks for your appreciable points. I have updated the Mapper implementation removing Htable instance, as follows public static class InnerMapWithTOF extends MapReduceBase implements Mapper { public void map(LongWritable key, Text value,

Re: Transactions and Map/Reduce

Thanks for the quick reply. My alternate approach is to just let the mappers do their writes, and to retrieve values based on the timestamp of the last *successful* run, which should effectively filter out the results of failed runs. It sounds like it may be my only option. I suppose it might a

Re: Biggest HBase Table ?

I think I have the largest tables, a pair of tables (dual indexes) that have over 9b rows. With LZO the compressed on disk size is about 500gb each. Obviously each row is fairly small. -ryan On Wed, Jun 24, 2009 at 8:27 AM, Murali Krishna. P wrote: > Hi, >   Apologize if this is already answere

Re: THIS WEEK: PNW Hadoop / Apache Cloud Stack Users' Meeting, Wed Jun 24th, Seattle

Hey all, Just writing a quick note of "thanks", we had another solid group of people show up! As always, we learned quite a lot about interesting use cases for Hadoop, Lucene, and the rest of the Apache 'Cloud Stack'. I couldn't get it taped, but we talked about: -Scaling Lucene with Katta and

Re: hbase 0.20.0-alpha and zookeeper

FYI, the name of the zk jar has the zk svn revision we patched and the hbase issue number whose patch it includes. St.Ack On Thu, Jun 25, 2009 at 1:29 AM, Ram Kulbak wrote: > Hi, > I've noticed that hbase 0.20.0-alpha comes with a non official zookeeper > jar > (zookeeper-r785019-hbase-1329.jar)

Re: hbase 0.20.0-alpha transactional and indexed region servers missing?

No. They are on their way. They were just not ready in time for alpha preview release. Keep an eye on the dev list so you can see when they go in. Yours, St.Ack On Thu, Jun 25, 2009 at 8:05 AM, Ram Kulbak wrote: > Hi, > I can't find the classes TrasnactionalTable, IndexedTable or any of the

hbase 0.20.0-alpha transactional and indexed region servers missing?

Hi, I can't find the classes TrasnactionalTable, IndexedTable or any of the indexed or transactional functionality in hbase 0.20.0-alpha, is this a mistake? Thanks, Ram

Re: Transactions and Map/Reduce

Unfortunately, there is no more documentation on transactions. I've never used transactions in M/Rs. You are correct that if you only start/commit a transaction in mapper then you will only get atomicity across the individual map. One thing to keep in mind is that, in the current impl, all the wr

Re: hbase 0.20.0-alpha and zookeeper

I use the existing jar and a zk 3.1.1 server. HBASE-1329 is about providing more visibility into ZK from hbase standard tools. There are no other major changes. so, yes. please leave the jar in place, but feel free to use a 3.1.1 server On Thu, Jun 25, 2009 at 1:29 AM, Ram Kulbak wrote: > Hi,

hbase 0.20.0-alpha and zookeeper

Hi, I've noticed that hbase 0.20.0-alpha comes with a non official zookeeper jar (zookeeper-r785019-hbase-1329.jar). Can I deploy hbase 0.20.0-alpha with zookeeper 3.1.1 ? Thanks, Ram