Re: using composite index for a duplicate check validation

2011-02-22 Thread eric_bdr
Thanks a lot Jean-Daniel, I will try disabling the cache to see if I get a performance improvement. I was not aware of the parallel scan. I will look into that. Thanks, -Eric From: Jean-Daniel Cryans To: user@hbase.apache.org Sent: Wed, February 23, 2011 1

using composite index for a duplicate check validation

2011-02-21 Thread eric_bdr
Hi, I am currently building a multi-tenant ERP-like application capable of handling billions of transaction lines. I a using HBase 0.90 and wrote an end-to-end initial POC to test the performance characteristics. Here is my end-to-end use case: 1. load a sizable transaction submission file (c