Re: disable major compaction per table

2016-02-18 Thread Ted Yu
Please see the following for description on data block encoding :
http://hbase.apache.org/book.html#compression

If you have further questions on data block encoding, please start another
thread.

On Thu, Feb 18, 2016 at 3:16 AM, Shushant Arora 
wrote:

> Thanks!
>
> does hbase compress repeated values in keys and  columns :location say
> (ASIA). will that be repeated with each key or hbase snappy compression
> will handle that.
>
> same applies for repeated values of a column?
>
> Thanks!
>
> On Wed, Feb 17, 2016 at 7:14 AM, Ted Yu  wrote:
>
> > bq. hbase.hregion.majorcompaction = 0 per table/column family
> >
> > I searched code base but didn't find relevant test case for the above.
> > Mind giving me some pointer ?
> >
> > Thanks
> >
> > On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov <
> vladrodio...@gmail.com
> > >
> > wrote:
> >
> > > 1.does major compaction in hbase runs per table basis.
> > >
> > > Per Region
> > >
> > > 2.By default every 24 hours?
> > >
> > > In older versions - yes. Current  (1.x+) - 7 days
> > >
> > > 3.Can I disable automatic major compaction for few tables while keep it
> > > enable for rest of tables?
> > >
> > > yes, you can. You can set
> > >
> > > hbase.hregion.majorcompaction = 0 per table/column family
> > >
> > > 4.Does hbase put ,get and delete are blocked while major compaction and
> > are
> > > working in minor compaction?
> > >
> > > No, they are not.
> > >
> > > -Vlad
> > >
> > > On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu  wrote:
> > >
> > > > For #2, see http://hbase.apache.org/book.html#managed.compactions
> > > >
> > > > For #3, I don't think so.
> > > >
> > > > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> > > shushantaror...@gmail.com
> > > > >
> > > > wrote:
> > > >
> > > > > Hi
> > > > >
> > > > > 1.does major compaction in hbase runs per table basis.
> > > > > 2.By default every 24 hours?
> > > > > 3.Can I disable automatic major compaction for few tables while
> keep
> > it
> > > > > enable for rest of tables?
> > > > >
> > > > > 4.Does hbase put ,get and delete are blocked while major compaction
> > and
> > > > are
> > > > > working in minor compaction?
> > > > >
> > > > > Thanks
> > > > >
> > > >
> > >
> >
>


Re: disable major compaction per table

2016-02-18 Thread Shushant Arora
Thanks!

does hbase compress repeated values in keys and  columns :location say
(ASIA). will that be repeated with each key or hbase snappy compression
will handle that.

same applies for repeated values of a column?

Thanks!

On Wed, Feb 17, 2016 at 7:14 AM, Ted Yu  wrote:

> bq. hbase.hregion.majorcompaction = 0 per table/column family
>
> I searched code base but didn't find relevant test case for the above.
> Mind giving me some pointer ?
>
> Thanks
>
> On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov  >
> wrote:
>
> > 1.does major compaction in hbase runs per table basis.
> >
> > Per Region
> >
> > 2.By default every 24 hours?
> >
> > In older versions - yes. Current  (1.x+) - 7 days
> >
> > 3.Can I disable automatic major compaction for few tables while keep it
> > enable for rest of tables?
> >
> > yes, you can. You can set
> >
> > hbase.hregion.majorcompaction = 0 per table/column family
> >
> > 4.Does hbase put ,get and delete are blocked while major compaction and
> are
> > working in minor compaction?
> >
> > No, they are not.
> >
> > -Vlad
> >
> > On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu  wrote:
> >
> > > For #2, see http://hbase.apache.org/book.html#managed.compactions
> > >
> > > For #3, I don't think so.
> > >
> > > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> > shushantaror...@gmail.com
> > > >
> > > wrote:
> > >
> > > > Hi
> > > >
> > > > 1.does major compaction in hbase runs per table basis.
> > > > 2.By default every 24 hours?
> > > > 3.Can I disable automatic major compaction for few tables while keep
> it
> > > > enable for rest of tables?
> > > >
> > > > 4.Does hbase put ,get and delete are blocked while major compaction
> and
> > > are
> > > > working in minor compaction?
> > > >
> > > > Thanks
> > > >
> > >
> >
>


Re: disable major compaction per table

2016-02-16 Thread Ted Yu
bq. hbase.hregion.majorcompaction = 0 per table/column family

I searched code base but didn't find relevant test case for the above.
Mind giving me some pointer ?

Thanks

On Tue, Feb 16, 2016 at 5:38 PM, Vladimir Rodionov 
wrote:

> 1.does major compaction in hbase runs per table basis.
>
> Per Region
>
> 2.By default every 24 hours?
>
> In older versions - yes. Current  (1.x+) - 7 days
>
> 3.Can I disable automatic major compaction for few tables while keep it
> enable for rest of tables?
>
> yes, you can. You can set
>
> hbase.hregion.majorcompaction = 0 per table/column family
>
> 4.Does hbase put ,get and delete are blocked while major compaction and are
> working in minor compaction?
>
> No, they are not.
>
> -Vlad
>
> On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu  wrote:
>
> > For #2, see http://hbase.apache.org/book.html#managed.compactions
> >
> > For #3, I don't think so.
> >
> > On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora <
> shushantaror...@gmail.com
> > >
> > wrote:
> >
> > > Hi
> > >
> > > 1.does major compaction in hbase runs per table basis.
> > > 2.By default every 24 hours?
> > > 3.Can I disable automatic major compaction for few tables while keep it
> > > enable for rest of tables?
> > >
> > > 4.Does hbase put ,get and delete are blocked while major compaction and
> > are
> > > working in minor compaction?
> > >
> > > Thanks
> > >
> >
>


Re: disable major compaction per table

2016-02-16 Thread Vladimir Rodionov
1.does major compaction in hbase runs per table basis.

Per Region

2.By default every 24 hours?

In older versions - yes. Current  (1.x+) - 7 days

3.Can I disable automatic major compaction for few tables while keep it
enable for rest of tables?

yes, you can. You can set

hbase.hregion.majorcompaction = 0 per table/column family

4.Does hbase put ,get and delete are blocked while major compaction and are
working in minor compaction?

No, they are not.

-Vlad

On Tue, Feb 16, 2016 at 4:51 PM, Ted Yu  wrote:

> For #2, see http://hbase.apache.org/book.html#managed.compactions
>
> For #3, I don't think so.
>
> On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora  >
> wrote:
>
> > Hi
> >
> > 1.does major compaction in hbase runs per table basis.
> > 2.By default every 24 hours?
> > 3.Can I disable automatic major compaction for few tables while keep it
> > enable for rest of tables?
> >
> > 4.Does hbase put ,get and delete are blocked while major compaction and
> are
> > working in minor compaction?
> >
> > Thanks
> >
>


Re: disable major compaction per table

2016-02-16 Thread Ted Yu
For #2, see http://hbase.apache.org/book.html#managed.compactions

For #3, I don't think so.

On Tue, Feb 16, 2016 at 4:46 PM, Shushant Arora 
wrote:

> Hi
>
> 1.does major compaction in hbase runs per table basis.
> 2.By default every 24 hours?
> 3.Can I disable automatic major compaction for few tables while keep it
> enable for rest of tables?
>
> 4.Does hbase put ,get and delete are blocked while major compaction and are
> working in minor compaction?
>
> Thanks
>


disable major compaction per table

2016-02-16 Thread Shushant Arora
Hi

1.does major compaction in hbase runs per table basis.
2.By default every 24 hours?
3.Can I disable automatic major compaction for few tables while keep it
enable for rest of tables?

4.Does hbase put ,get and delete are blocked while major compaction and are
working in minor compaction?

Thanks