Re: Delete a CF paramter?

2018-01-01 Thread naresh Goud 
We can't delete properties of column family. Either you have to use the
default value or we can set it to particular value.

Let's say if we want to remove bloom filter property  we can set the value
to NONE. means. Bloom filter is not applied while preparing HFile.  it can
acccept values[NONE(default value), ROW, ROWCOL].

Hope my explanation make sense. Happy new year 2018.

Thank you,
Naresh

On Mon, Jan 1, 2018 at 10:49 AM Ted Yu  wrote:

> Not sure what you meant by deleting bloom filter type.
> Bloom filter type is used when constructing store file. See the following
> in HStore:
>
>   private HStoreFile createStoreFileAndReader(StoreFileInfo info) throws
> IOException {
>
> info.setRegionCoprocessorHost(this.region.getCoprocessorHost());
>
> HStoreFile storeFile = new HStoreFile(this.getFileSystem(), info, this.
> conf, this.cacheConf,
>
> this.family.getBloomFilterType(), isPrimaryReplicaStore());
>
>
> If you want to use a different bloom filter, you can issue this command:
>
>
> alter 'test', { NAME => 'cf', BLOOMFILTER => 'ROW' }
>
>
> Cheers
>
> On Mon, Jan 1, 2018 at 6:22 AM, Jean-Marc Spaggiari <
> jean-m...@spaggiari.org
> > wrote:
>
> > Hi,
> >
> > What is the magic to delete a CF parameter?
> >
> > Like in this example:
> > hbase(main):033:0> desc 'table'
> > Table dns is ENABLED
> >
> >
> >
> >
> > table
> >
> >
> >
> >
> > COLUMN FAMILIES DESCRIPTION
> >
> >
> >
> >
> > {NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
> > NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
> > CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
> > 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER =>
> > 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEM
> > ORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN
> > => 'false', COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE =>
> > '65536', METADATA => {'ENCODE_ON_DISK' => 'true'}}
> >
> >
> > 1 row(s)
> > Took 0.0368 seconds
> >
> >
> >
> >
> > I want to remove the BLOOMFILTER => 'NONE',  parameter that I have set. I
> > found how to remove the CF, table parameters and options, etc. But I have
> > not found how to delete the CF parameter. IIRC there was something with
> > :NILL or similar, but I'm not 100% sure.
> >
> > In any case, I feel this should be better documented :(
> >
> > JMS
> >
>

Re: Delete a CF paramter?

2018-01-01 Thread Ted Yu 
Currently there is no support for family_att_unset operation.

You can log a JIRA for adding such support.

Cheers

On Mon, Jan 1, 2018 at 8:55 AM, Jean-Marc Spaggiari  wrote:

> At the table create I used BLOOMFILTER => 'NONE'. Which is an overwrite of
> the default value. What I'm looking for is something like:
> alter 'test', { NAME => 'cf', METHOD => 'family_att_unset', FNAME =>
> 'BLOOMFILTER' }
>
> To restore what default value is.
>
> I agree that your option works, but what if you don't know the default
> value? What I want is just remove what has been setup.
>
> Same here:
> {NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
> NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
> CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
> 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER =>
> 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false',
> CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false',
> COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE => '65536',
> *METADATA
> => {'ENCODE_ON_DISK' => 'true'}*}
>
> If I want to remove the METADATA parameter for the '@' Column Familiy...
> How do I do?
>
> 2018-01-01 11:49 GMT-05:00 Ted Yu :
>
> > Not sure what you meant by deleting bloom filter type.
> > Bloom filter type is used when constructing store file. See the following
> > in HStore:
> >
> >   private HStoreFile createStoreFileAndReader(StoreFileInfo info) throws
> > IOException {
> >
> > info.setRegionCoprocessorHost(this.region.getCoprocessorHost());
> >
> > HStoreFile storeFile = new HStoreFile(this.getFileSystem(), info,
> > this.
> > conf, this.cacheConf,
> >
> > this.family.getBloomFilterType(), isPrimaryReplicaStore());
> >
> >
> > If you want to use a different bloom filter, you can issue this command:
> >
> >
> > alter 'test', { NAME => 'cf', BLOOMFILTER => 'ROW' }
> >
> >
> > Cheers
> >
> > On Mon, Jan 1, 2018 at 6:22 AM, Jean-Marc Spaggiari <
> > jean-m...@spaggiari.org
> > > wrote:
> >
> > > Hi,
> > >
> > > What is the magic to delete a CF parameter?
> > >
> > > Like in this example:
> > > hbase(main):033:0> desc 'table'
> > > Table dns is ENABLED
> > >
> > >
> > >
> > >
> > > table
> > >
> > >
> > >
> > >
> > > COLUMN FAMILIES DESCRIPTION
> > >
> > >
> > >
> > >
> > > {NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
> > > NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
> > > CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
> > > 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER
> =>
> > > 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEM
> > > ORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false',
> PREFETCH_BLOCKS_ON_OPEN
> > > => 'false', COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE =>
> > > '65536', METADATA => {'ENCODE_ON_DISK' => 'true'}}
> > >
> > >
> > > 1 row(s)
> > > Took 0.0368 seconds
> > >
> > >
> > >
> > >
> > > I want to remove the BLOOMFILTER => 'NONE',  parameter that I have
> set. I
> > > found how to remove the CF, table parameters and options, etc. But I
> have
> > > not found how to delete the CF parameter. IIRC there was something with
> > > :NILL or similar, but I'm not 100% sure.
> > >
> > > In any case, I feel this should be better documented :(
> > >
> > > JMS
> > >
> >
>

Re: Delete a CF paramter?

2018-01-01 Thread Jean-Marc Spaggiari 
At the table create I used BLOOMFILTER => 'NONE'. Which is an overwrite of
the default value. What I'm looking for is something like:
alter 'test', { NAME => 'cf', METHOD => 'family_att_unset', FNAME =>
'BLOOMFILTER' }

To restore what default value is.

I agree that your option works, but what if you don't know the default
value? What I want is just remove what has been setup.

Same here:
{NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER =>
'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false',
CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false',
COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE => '65536', *METADATA
=> {'ENCODE_ON_DISK' => 'true'}*}

If I want to remove the METADATA parameter for the '@' Column Familiy...
How do I do?

2018-01-01 11:49 GMT-05:00 Ted Yu :

> Not sure what you meant by deleting bloom filter type.
> Bloom filter type is used when constructing store file. See the following
> in HStore:
>
>   private HStoreFile createStoreFileAndReader(StoreFileInfo info) throws
> IOException {
>
> info.setRegionCoprocessorHost(this.region.getCoprocessorHost());
>
> HStoreFile storeFile = new HStoreFile(this.getFileSystem(), info,
> this.
> conf, this.cacheConf,
>
> this.family.getBloomFilterType(), isPrimaryReplicaStore());
>
>
> If you want to use a different bloom filter, you can issue this command:
>
>
> alter 'test', { NAME => 'cf', BLOOMFILTER => 'ROW' }
>
>
> Cheers
>
> On Mon, Jan 1, 2018 at 6:22 AM, Jean-Marc Spaggiari <
> jean-m...@spaggiari.org
> > wrote:
>
> > Hi,
> >
> > What is the magic to delete a CF parameter?
> >
> > Like in this example:
> > hbase(main):033:0> desc 'table'
> > Table dns is ENABLED
> >
> >
> >
> >
> > table
> >
> >
> >
> >
> > COLUMN FAMILIES DESCRIPTION
> >
> >
> >
> >
> > {NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
> > NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
> > CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
> > 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER =>
> > 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEM
> > ORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN
> > => 'false', COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE =>
> > '65536', METADATA => {'ENCODE_ON_DISK' => 'true'}}
> >
> >
> > 1 row(s)
> > Took 0.0368 seconds
> >
> >
> >
> >
> > I want to remove the BLOOMFILTER => 'NONE',  parameter that I have set. I
> > found how to remove the CF, table parameters and options, etc. But I have
> > not found how to delete the CF parameter. IIRC there was something with
> > :NILL or similar, but I'm not 100% sure.
> >
> > In any case, I feel this should be better documented :(
> >
> > JMS
> >
>

Re: Delete a CF paramter?

2018-01-01 Thread Ted Yu 
Not sure what you meant by deleting bloom filter type.
Bloom filter type is used when constructing store file. See the following
in HStore:

  private HStoreFile createStoreFileAndReader(StoreFileInfo info) throws
IOException {

info.setRegionCoprocessorHost(this.region.getCoprocessorHost());

HStoreFile storeFile = new HStoreFile(this.getFileSystem(), info, this.
conf, this.cacheConf,

this.family.getBloomFilterType(), isPrimaryReplicaStore());


If you want to use a different bloom filter, you can issue this command:


alter 'test', { NAME => 'cf', BLOOMFILTER => 'ROW' }


Cheers

On Mon, Jan 1, 2018 at 6:22 AM, Jean-Marc Spaggiari  wrote:

> Hi,
>
> What is the magic to delete a CF parameter?
>
> Like in this example:
> hbase(main):033:0> desc 'table'
> Table dns is ENABLED
>
>
>
>
> table
>
>
>
>
> COLUMN FAMILIES DESCRIPTION
>
>
>
>
> {NAME => '@', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false',
> NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'false',
> CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL =>
> 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER =>
> 'NONE', CACHE_INDEX_ON_WRITE => 'false', IN_MEM
> ORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN
> => 'false', COMPRESSION => 'SNAPPY', BLOCKCACHE => 'true', BLOCKSIZE =>
> '65536', METADATA => {'ENCODE_ON_DISK' => 'true'}}
>
>
> 1 row(s)
> Took 0.0368 seconds
>
>
>
>
> I want to remove the BLOOMFILTER => 'NONE',  parameter that I have set. I
> found how to remove the CF, table parameters and options, etc. But I have
> not found how to delete the CF parameter. IIRC there was something with
> :NILL or similar, but I'm not 100% sure.
>
> In any case, I feel this should be better documented :(
>
> JMS
>