Counter Column Family Inconsistent Node
[default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943)
Re: Counter Column Family Inconsistent Node
yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943)
Re: Counter Column Family Inconsistent Node
May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ? On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote: yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com
Re: Counter Column Family Inconsistent Node
Actually I think it was more related to our servers getting their time out of sync... after finding this article: http://ria101.wordpress.com/2011/02/08/cassandra-the-importance-of-system-clocks-avoiding-oom-and-how-to-escape-oom-meltdown/ I checked our servers, and sure enough, 2 of them were out of sync with each other with more than a 2 min difference! I reconfigured ntp and I think I am back in business. Thanks though! Ryan On Tue, Aug 16, 2011 at 2:53 PM, Jonathan Ellis jbel...@gmail.com wrote: May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ? On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote: yeah, sorry about that... pushed click before I added my comments. I have a cluster of 5 nodes using 0.8.4 where I am using counters. One one of my nodes, every time I do a list command I get different results. The counters jump all over the place. Any ideas? I have run nodetool repair on all nodes. Thanks! Ryan On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote: [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=93683) = (counter=FILEUPLOAD, value=347) = (counter=MQUPLOAD, value=14961065367) = (counter=PAGES, value=183089568) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=23972) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) 1 Row Returned. [default@Race] list CounterCF; Using default limit of 100 --- RowKey: Stats = (counter=APP, value=7503) = (counter=FILEUPLOAD, value=155) = (counter=MQUPLOAD, value=4726775) = (counter=PAGES, value=131948) = (counter=REST, value=3) = (counter=SOAP, value=44) = (counter=WS, value=1943) -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of DataStax, the source for professional Cassandra support http://www.datastax.com