Fwd: batch insert performance

2012-05-26 Thread Faruk Berksöz
-- Forwarded message -- From: Faruk Berksöz Date: 2012/5/27 Subject: batch insert performance To: user@hbase.apache.org Hi, HBase users, I have 250.000 Rows in a list. I want to insert all rows in HTable as soon as possible. I have 3 different Code and 3 different elapsed time. Why

batch insert performance

2012-05-26 Thread Faruk Berksöz
Hi, HBase users, I have 250.000 Rows in a list. I want to insert all rows in HTable as soon as possible. I have 3 different Code and 3 different elapsed time. Why HTable.batch(List actions, Object[] results) and HTable.put(List puts) methods 4 times slower than 1.Code which inserts records to htab

Re: hbase insert performance test (from hbasemaster and regionservers)

2012-05-22 Thread Faruk Berksöz
> > 2) You never want a user to run their own code from the cluster itself. > Use an *edge* node. > > There's more, but you get the idea. > > On May 21, 2012, at 2:04 PM, Faruk Berksöz wrote: > > > Dear All, > > we have 4 node in our cluster (1nn+dn,3 dn). &

hbase insert performance test (from hbasemaster and regionservers)

2012-05-21 Thread Faruk Berksöz
Dear All, we have 4 node in our cluster (1nn+dn,3 dn). Hadoop dist. is cdh3u3. Every node has 2 tb disk , 8 gb memory. We are trying some insert performance test on hbase. I have tried to insert 250.000 records from hbase master (without thread), that takes 5-7 sec. But when I try ro insert from

from JMS into HBase

2012-05-14 Thread Faruk Berksöz
Dear All, our hadoop cluster has 1 nn , 3 dd.Evey nodes has 1 TB hard disk and 4 GB memory. Hadoop version is CDH3. We are trying to load some records (one record has approx. 250 bytes) from many jms queues into a hbase table. Is It possible to load records (For example 1.000.000 records in a s