Re: TWCS recommendation on number of windows

2022-09-28 Thread Grzegorz Pietrusza
Hi Jeff Thanks a lot for all these details, they are really helpful. My understanding is that the number of windows is a tradeoff between the amount of data waiting for expiration and the number of sstables required to satisfy a read request. In my case the data model does have a timestamp

Re: TWCS recommendation on number of windows

2022-09-28 Thread Jeff Jirsa
So when I wrote TWCS, I wrote it for a use case that had 24h TTLs and 30 days of retention. In that application, we had tested 12h windows, 24h windows, and 7 day windows, and eventually settled on 24h windows because that balanced factors like sstable size, sstables-per-read, and expired data

TWCS recommendation on number of windows

2022-09-28 Thread Grzegorz Pietrusza
Hi All! According to TWCS documentation ( https://cassandra.apache.org/doc/latest/cassandra/operating/compaction/twcs.html) the operator should choose compaction window parameters to select a compaction_window_unit and compaction_window_size pair that produces approximately 20-30 windows. I'm