Re: TWCS recommendation on number of windows

2022-09-28 Thread Grzegorz Pietrusza
Hi Jeff Thanks a lot for all these details, they are really helpful. My understanding is that the number of windows is a tradeoff between the amount of data waiting for expiration and the number of sstables required to satisfy a read request. In my case the data model does have a timestamp compone

Re: Table with 'compact storage' is not shown in "describe table" output in cqlsh

2022-09-28 Thread manish khandelwal
Hi All Could this be due to how "DESC" functionality changed via https://issues.apache.org/jira/browse/CASSANDRA-14825? Earlier client drivers were creating schema so in the 3.11.x version, we were able to see the schema of COMPACT tables but now in Cassandra 4.0.x we are seeing the warning. Reg

Re: Do you know about DBA Stack Exchange?

2022-09-28 Thread Stéphane Alleaume
Thank you very much Have a nice day Kind regards Stéphane Le mer. 28 sept. 2022, 20:46, Patrick McFadin a écrit : > Hi everyone, > > I wanted to make sure you know about a great community resource. DBA Stack > Exchange is a related site to Stack Overflow but strictly for DB operations > people

Re: Do you know about DBA Stack Exchange?

2022-09-28 Thread Boyong N. Lambert
Thank you Patrick On Wed, Sep 28, 2022 at 7:46 PM Patrick McFadin wrote: > Hi everyone, > > I wanted to make sure you know about a great community resource. DBA Stack > Exchange is a related site to Stack Overflow but strictly for DB operations > people. There is a dedicated tag for Cassandra

Do you know about DBA Stack Exchange?

2022-09-28 Thread Patrick McFadin
Hi everyone, I wanted to make sure you know about a great community resource. DBA Stack Exchange is a related site to Stack Overflow but strictly for DB operations people. There is a dedicated tag for Cassandra operations: https://dba.stackexchange.com/questions/tagged/cassandra I'm mentioning th

Re: TWCS recommendation on number of windows

2022-09-28 Thread Jeff Jirsa
So when I wrote TWCS, I wrote it for a use case that had 24h TTLs and 30 days of retention. In that application, we had tested 12h windows, 24h windows, and 7 day windows, and eventually settled on 24h windows because that balanced factors like sstable size, sstables-per-read, and expired data wait

TWCS recommendation on number of windows

2022-09-28 Thread Grzegorz Pietrusza
Hi All! According to TWCS documentation ( https://cassandra.apache.org/doc/latest/cassandra/operating/compaction/twcs.html) the operator should choose compaction window parameters to select a compaction_window_unit and compaction_window_size pair that produces approximately 20-30 windows. I'm cur

Re: Questions on the count and multiple index behaviour in cassandra

2022-09-28 Thread Bowen Song via user
It sounds like you are misusing/abusing Cassandra. I've noticed the following Cassandra anti-patterns in your post: 1. Large or uneven partitions All rows in a table in a single partition is definitely an anti-pattern unless you only have a very small number of rows. 2. "SELECT COUNT(*) FR

Re: Questions on the count and multiple index behaviour in cassandra

2022-09-28 Thread Stéphane Alleaume
Hi 1) how much size in Mo is your partition ? Should be less than 100 Mo (but less in fact) 2) could you plug an Elasticsearch or Solr search in front ? Kind regards Stephane Le mer. 28 sept. 2022, 13:46, Karthik K a écrit : > Hi, > > We have two doubts on cassandra 3.11 features: > > 1)

Questions on the count and multiple index behaviour in cassandra

2022-09-28 Thread Karthik K
Hi, We have two doubts on cassandra 3.11 features: 1) Need to get counts of row from a cassandra table. We have 3 node clusters with Apache Cassandra 3.11 version. We loaded a table in cassandra with 9lakh records. We have around 91 columns in this table. Most of the records have text as datatyp