Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-17 Thread Michael Wall
--------- >> *From:* Mike Drob [mailto:md...@mdrob.com] >> *Sent:* Tuesday, 17 January 2017 09:37 >> *To:* user@accumulo.apache.org >> *Subject:* Re: Merging smaller/empty tablets [SEC=UNOFFICIAL] >> >> http://accumulo.apache.org/1.8/accumulo_user_manual.htm

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Mike Drob
t; *To:* user@accumulo.apache.org > *Subject:* Re: Merging smaller/empty tablets [SEC=UNOFFICIAL] > > http://accumulo.apache.org/1.8/accumulo_user_manual.html#_merging_tablets > > In order to merge small tablets, you can ask Accumulo to merge sections of > a table smaller than a g

RE: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Dickson, Matt MR
took days to complete. With 1.07T tablets to work on this may take some time? From: Mike Drob [mailto:md...@mdrob.com] Sent: Tuesday, 17 January 2017 09:37 To: user@accumulo.apache.org Subject: Re: Merging smaller/empty tablets [SEC=UNOFFICIAL] http

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Josh Elser
Just to clarify: compactions don't implicitly change the table "distribution". The number and/or boundaries of tablets don't change as a part of a compaction. Yamini Joshi wrote: Just a thought, will forcing a major compaction take care of this? Merging smaller tablets and deleting empty ones?

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Mike Drob
http://accumulo.apache.org/1.8/accumulo_user_manual.html#_merging_tablets In order to merge small tablets, you can ask Accumulo to merge sections of a table smaller than a given size. root@myinstance> merge -t myTable -s 100M On Mon, Jan 16, 2017 at 4:31 PM, Dickson, Matt MR < matt.dick...@def

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Yamini Joshi
Just a thought, will forcing a major compaction take care of this? Merging smaller tablets and deleting empty ones? Best regards, Yamini Joshi On Mon, Jan 16, 2017 at 4:31 PM, Dickson, Matt MR < matt.dick...@defence.gov.au> wrote: > *UNOFFICIAL* > I have a table that has evolved to have 1.07T ta

Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Dickson, Matt MR
UNOFFICIAL I have a table that has evolved to have 1.07T tablets and I fairly confident a large portion of these are now empty or very small. I'd like to merge smaller tablets and delete empty tablets, is there a smart way to do this? My thought was to query the metadata table for all tablets