Re: Compacting same table

2016-04-03 Thread Sumit Nigam
base.apache.org>; Sumit Nigam <sumit_o...@yahoo.com> Sent: Sunday, April 3, 2016 7:15 PM Subject: Re: Compacting same table bq. I have been informed Can you disclose the source of such information ? For hbase.hstore.compaction.kv.max , hbase-default.xml has: The maximum number of KeyVa

Re: Compacting same table

2016-04-03 Thread Ted Yu
bq. I have been informed Can you disclose the source of such information ? For hbase.hstore.compaction.kv.max , hbase-default.xml has: The maximum number of KeyValues to read and then write in a batch when flushing or compacting. Set this lower if you have big KeyValues and problems with

Compacting same table

2016-04-03 Thread Sumit Nigam
Hi, I have been informed that compacting (manual) the same hbase table takes same amount of time even when done in quick succession. This seems counter-intuitive because an already compacted table should not take same amount of time. Also, what is the use of hbase.hstore.compaction.kv.max