Not a silly question:
>From the logs it seemed like the region servers could not handle the
workload of simultaneous compactions and insertions in the table. No, we
haven't run manual compactions on this particular table yet.
/David
On Tue, Jul 9, 2013 at 6:53 PM, Michael Segel wrote:
> Silly
Silly question...
Why are you trying to disable automated compaction?
And then the equally silly question... are you attempting to run full
compactions manually?
On Jul 9, 2013, at 11:41 AM, David Koch wrote:
> Hello,
>
> Thank you for your replies.
>
> So, as suggested, I tweaked the
Hello,
Thank you for your replies.
So, as suggested, I tweaked the following settings in Cloudera Manager:
hbase.hstore.compactionThreshold=1
hbase.hstore.compaction.max - I did not touch, I tried setting it to "0"
but the minimum is 2
I can't see any compactions being launched but the job s
Do you specify startTime and endTime parameters for the CopyTable job ?
Cheers
On Tue, Jul 9, 2013 at 4:38 AM, David Koch wrote:
> Hello,
>
> We disabled automated major compactions by setting
> hbase.hregion.majorcompaction=0.
> This was to avoid issues during buik import of data since compact
You should be able to limit what JM describes by tuning the following two
configs:
hbase.hstore.compactionThreshold
hbase.hstore.compaction.max
Beware of this property as well when tuning the above so you don't
accidentally cause blocking of flushes, though I imagine you would be
tuning down not
Hi David,
Minor compactions can be promoted to Major compactions when all the
files are selected for compaction. And the property below will not
avoid that to occur.
Section 9.7.6.5 there: http://hbase.apache.org/book/regions.arch.html
JM
2013/7/9 David Koch :
> Hello,
>
> We disabled automate
Hello,
We disabled automated major compactions by setting
hbase.hregion.majorcompaction=0.
This was to avoid issues during buik import of data since compactions
seemed to cause the running imports to crash. However, even after
disabling, region server logs still show compactions going on, as well
