I can see the amount of time from last log before counter cache loading message is very long ,and it also says so in the log. INFO [pool-5-thread-1] 2021-04-25 09:56:56,849 AutoSavingCache.java:174 - Completed loading (2602567 ms; 1277885 keys) CounterCache cache
I didn't have a chance to test with the counter cache disabled yet, we want to give the system to function properly after a few days of encountering many other issues. On Tue, Apr 27, 2021 at 4:33 AM Kane Wilson <k...@raft.so> wrote: > Sounds like you're potentially hitting a bug, maybe even one that hasn't > been hit before. How are you determining it's counters that are the > problem? Is it stalling on the Initializing counters log line or something? > > raft.so - Cassandra consulting, support, and managed services > > > On Mon, Apr 26, 2021 at 3:25 AM Gil Ganz <gilg...@gmail.com> wrote: > >> Hey >> I have a cluster, 3.11.6, startup is very slow, i3en.xlarge server with >> about 1tb of data, takes 45 minutes to startup, almost 40 minutes of that >> is loading the saved counter cache from disk (200mb), and I can see that in >> these 40 minutes the amount of data read from disk is very high, up to >> 700MB/s. Counters is a feature that is used heavily in this environment, >> including the main table in the db, which is half the data size. >> >> What can cause such a slow load of such a small cache? Is there something >> that can be done to make this quicker? >> >> Gil >> >