Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Noorul Islam K M
Lyubo Kamenov writes: > Maybe increase the number of tables that can be compacted by minor > compactions[1], > i.e. max_threshold (default is set to 32). > > 1. >

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Lyubo Kamenov
Maybe increase the number of tables that can be compacted by minor compactions[1], i.e. max_threshold (default is set to 32). 1. https://docs.datastax.com/en/cql/3.1/cql/cql_reference/compactSubprop.html?scroll=compactSubprop__compactionSubpropertiesDTCS On Mon, Feb 29, 2016 at 9:28 PM, Noorul

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Noorul Islam Kamal Malmiyoda
Hello Marcus, I altered the table to set timestamp_resolution to 'MICROSECONDS'. I waited for sometime, but the sstable count did not come down. Do you think I should specific command to reduce the count of sstables after setting this? Thanks and Regards Noorul On Mon, Feb 29, 2016 at 7:22 PM,

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Noorul Islam K M
Alain RODRIGUEZ writes: > Might be due to this: > > Fixed in 2.1.12 (Assuming you are using C*2.1): > https://issues.apache.org/jira/browse/CASSANDRA-10422 > > Some question to have more context: > > >1. What C* version are you using? We are using DSE 4.8.3, hence Apache

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Alain RODRIGUEZ
Might be due to this: Fixed in 2.1.12 (Assuming you are using C*2.1): https://issues.apache.org/jira/browse/CASSANDRA-10422 Some question to have more context: 1. What C* version are you using? 2. Do you use vnodes? 3. How many vnodes per node? 4. How many nodes / DC do you have?

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Noorul Islam Kamal Malmiyoda
Yes, we have enabled it on OpsCenter. Is that the reason? On Feb 29, 2016 8:07 PM, "Dominik Keil" wrote: > Are you using incremental repais? > > Am 29.02.2016 um 14:36 schrieb Noorul Islam K M: > > > Hi all, > > We are using below compaction settings for a table > >

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Dominik Keil
Are you using incremental repais? Am 29.02.2016 um 14:36 schrieb Noorul Islam K M: > Hi all, > > We are using below compaction settings for a table > > compaction = {'timestamp_resolution': 'MILLISECONDS', > 'max_sstable_age_days': '365', 'base_time_seconds': '60', 'class': >

Re: Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Marcus Eriksson
why do you have 'timestamp_resolution': 'MILLISECONDS'? It should be left as default (MICROSECONDS) unless you do "USING TIMESTAMP "-inserts, see https://issues.apache.org/jira/browse/CASSANDRA-11041 On Mon, Feb 29, 2016 at 2:36 PM, Noorul Islam K M wrote: > > Hi all, > > We

Too many sstables with DateTieredCompactionStrategy

2016-02-29 Thread Noorul Islam K M
Hi all, We are using below compaction settings for a table compaction = {'timestamp_resolution': 'MILLISECONDS', 'max_sstable_age_days': '365', 'base_time_seconds': '60', 'class': 'org.apache.cassandra.db.compaction.DateTieredCompactionStrategy'} But it is creating too many sstables. Currently