Re: DTCS Question

That is probably close to the actual way it works, but not quite equal. My mental model when making this went backwards in time, towards 0, not forwards. It's something like this (using the numbers from your first example): make a bucket of the specified "timeUnit" size (1000), that contains the

Re: Compaction Filter in Cassandra

Fyi, this is the jira, https://issues.apache.org/jira/browse/CASSANDRA-11348 . We can move the discussion to the jira if want. On Thu, Mar 17, 2016 at 11:46 AM, Dikang Gu wrote: > Hi Eric, > > Thanks for sharing the information! > > We also mainly want to use it for

Re: Compaction Filter in Cassandra

On Fri, Mar 11, 2016 at 10:05 PM, Dikang Gu wrote: > RocksDB has the feature called "Compaction Filter" to allow application to > modify/delete a key-value during the background compaction. > https://github.com/facebook/rocksdb/blob/v4.1/include/rocksdb/options.h#L201-L226 >

RE: DTCS Question

Thanks for the long explanation, I looked at the link you pointed to and it does seem to concur with my mental model. Do you see any issues with that model and simplify this logic to 1. Create windows from start (min) to end (max) going from maximum possible size. 2. Scan all SS Tables and

DTCS Question

Hello, I am trying to concretely understand how DTCS makes buckets and I am looking at the DateTieredCompactionStrategyTest.testGetBuckets method and played with some of the parameters to GetBuckets method call (Cassandra 2.1.12). I don't think I fully understand something there. Let me try to

Re: Getting Issue while setting up Cassandra in Windows 8.1

You should use the u...@cassandra.apache.org list for cassandra-related questions, not this (dev@cassandra.apache.org) which is exclusive for internal Cassandra development. You can register to the user list by sending an e-mail to: user-subscr...@cassandra.apache.org Answering your question, it

Re: Compaction Filter in Cassandra

Hi Eric, Thanks for sharing the information! We also mainly want to use it for trimming data, either by the time or the number of columns in a row. We haven't started the work yet, do you mind to share some patches? We'd love to try it and test it in our environment. Thanks. On Tue, Mar 15,