Re: 1.1.11: system keyspace is filling up

2013-11-26 Thread Aaron Morton
> What happens if they are not being successfully delivered ? Will they > eventually TTL-out ? They have a TTL set to the gc_grace_seconds on the CF at the time of the write. I’ve also seen hints build up in multi DC systems due to timeouts on the coordinator. i.e. the remote nodes are up, co-

Re: 1.1.11: system keyspace is filling up

2013-11-21 Thread Rahul Menon
Oleg, The system keyspace is not replicated it is local to the node. You should check your logs to see if there are Timeouts from streaming hints, i believe the default value to stream hints it 10 seconds. When i ran into this problem i truncated hints to clear out the space and then ran a repair

Re: 1.1.11: system keyspace is filling up

2013-11-05 Thread Oleg Dulin
What happens if they are not being successfully delivered ? Will they eventually TTL-out ? Also, do I need to truncate hints on every node or is it replicated ? Oleg On 2013-11-04 21:34:55 +, Robert Coli said: On Mon, Nov 4, 2013 at 11:34 AM, Oleg Dulin wrote: I have a dual DC setup, 4

Re: 1.1.11: system keyspace is filling up

2013-11-04 Thread Robert Coli
On Mon, Nov 4, 2013 at 11:34 AM, Oleg Dulin wrote: > I have a dual DC setup, 4 nodes, RF=4 in each. > > The one that is used as primary has its system keyspace fill up with 200 > gigs of data, majority of which is hints. > > Why does this happen ? > > How can I clean it up ? If you have this ma

1.1.11: system keyspace is filling up

2013-11-04 Thread Oleg Dulin
I have a dual DC setup, 4 nodes, RF=4 in each. The one that is used as primary has its system keyspace fill up with 200 gigs of data, majority of which is hints. Why does this happen ? How can I clean it up ? -- Regards, Oleg Dulin http://www.olegdulin.com