Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Mike Drob
I can't find this in the docs, but IIRC the merge command can take a start/end range for what to merge. So the best option might be to try it on a smaller slice and see what happens. At a guess, queries won't block but indexing will. Mike On Mon, Jan 16, 2017 at 5:23 PM, Dickson, Matt MR < matt.d

Orphaned table in metadata table [SEC=UNOFFICIAL]

2017-01-16 Thread Dickson, Matt MR
UNOFFICIAL When I run "accumulo org.apache.accumulo.server.util.FindOfflineTablets" it finishes with a warning that "No prev-row for key extent {1de; }" then throws a nullPointerException. Looking in the metadata table there are references to 1de but when I list all tables it does not exi

RE: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Dickson, Matt MR
UNOFFICIAL That looks like a great option. Before using it, whats the cost/impact of running this on a massive table in a system with other large bulk ingests/queries running? In the past when I have used that (which was in 2013 so things may have changed) all ingests were blocked and it took

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Josh Elser
Just to clarify: compactions don't implicitly change the table "distribution". The number and/or boundaries of tablets don't change as a part of a compaction. Yamini Joshi wrote: Just a thought, will forcing a major compaction take care of this? Merging smaller tablets and deleting empty ones?

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Mike Drob
http://accumulo.apache.org/1.8/accumulo_user_manual.html#_merging_tablets In order to merge small tablets, you can ask Accumulo to merge sections of a table smaller than a given size. root@myinstance> merge -t myTable -s 100M On Mon, Jan 16, 2017 at 4:31 PM, Dickson, Matt MR < matt.dick...@def

Re: Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Yamini Joshi
Just a thought, will forcing a major compaction take care of this? Merging smaller tablets and deleting empty ones? Best regards, Yamini Joshi On Mon, Jan 16, 2017 at 4:31 PM, Dickson, Matt MR < matt.dick...@defence.gov.au> wrote: > *UNOFFICIAL* > I have a table that has evolved to have 1.07T ta

Merging smaller/empty tablets [SEC=UNOFFICIAL]

2017-01-16 Thread Dickson, Matt MR
UNOFFICIAL I have a table that has evolved to have 1.07T tablets and I fairly confident a large portion of these are now empty or very small. I'd like to merge smaller tablets and delete empty tablets, is there a smart way to do this? My thought was to query the metadata table for all tablets