Re[2]: Hbase major compaction question

2015-07-24 Thread Ted Yu
Please change permission for other files owned by aparsh as well.  Cheers Saturday, July 25, 2015, 6:13 AM +0800 from apratim sharma : >Hi Ted, > >Please find my answers below. > >Relase of Hbase:  1.0.0-cdh5.4.1 >Configuration Change Before Restart: Changed Block Cache related configuration

Re: Hbase major compaction question

2015-07-24 Thread apratim sharma
Hi Ted, Please find my answers below. *Relase of Hbase:* 1.0.0-cdh5.4.1 *Configuration Change Before Restart:* Changed Block Cache related configuration (mainly increased off heap bucket cache size) *Compaction Gone means:* Yes Data locality became poor after restart. Please find log snippet pas

Re: Hbase major compaction question

2015-07-24 Thread Ted Yu
Can you provide us more information: Release of HBase you use Configuration change you made prior to restarting  By 'compaction is gone', do you mean that locality became poor again ? Can you pastebin region server log when compaction got stuck ? Thanks Saturday, July 25, 2015, 2:20 AM +0800 fr

Hbase major compaction question

2015-07-24 Thread apratim sharma
I have a hbase table with with a wide row almost 2K columns per row. Each KV size is approx 2.1KB I have populated this table with generated hfiles using a MR job. There are no write or mutate operations performed on this table. So Once I am done with major compaction on this table, ideally we sho