Counter Column Family Inconsistent Node

2011-08-16 Thread Ryan Lowe
[default@Race] list CounterCF;
Using default limit of 100
---
RowKey: Stats
= (counter=APP, value=7503)
= (counter=FILEUPLOAD, value=155)
= (counter=MQUPLOAD, value=4726775)
= (counter=PAGES, value=131948)
= (counter=REST, value=3)
= (counter=SOAP, value=44)
= (counter=WS, value=1943)

1 Row Returned.
[default@Race] list CounterCF;
Using default limit of 100
---
RowKey: Stats
= (counter=APP, value=93683)
= (counter=FILEUPLOAD, value=347)
= (counter=MQUPLOAD, value=14961065367)
= (counter=PAGES, value=183089568)
= (counter=REST, value=3)
= (counter=SOAP, value=44)
= (counter=WS, value=23972)

1 Row Returned.
[default@Race] list CounterCF;
Using default limit of 100
---
RowKey: Stats
= (counter=APP, value=7503)
= (counter=FILEUPLOAD, value=155)
= (counter=MQUPLOAD, value=4726775)
= (counter=PAGES, value=131948)
= (counter=REST, value=3)
= (counter=SOAP, value=44)
= (counter=WS, value=1943)

1 Row Returned.
[default@Race] list CounterCF;
Using default limit of 100
---
RowKey: Stats
= (counter=APP, value=7503)
= (counter=FILEUPLOAD, value=155)
= (counter=MQUPLOAD, value=4726775)
= (counter=PAGES, value=131948)
= (counter=REST, value=3)
= (counter=SOAP, value=44)
= (counter=WS, value=1943)


Re: Counter Column Family Inconsistent Node

2011-08-16 Thread Ryan Lowe
yeah, sorry about that... pushed click before I added my comments.

I have a cluster of 5 nodes using 0.8.4 where I am using counters.  One one
of my nodes, every time I do a list command I get different results.  The
counters jump all over the place.

Any ideas?  I have run nodetool repair on all nodes.

Thanks!
Ryan

On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote:

 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)

 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=93683)
 = (counter=FILEUPLOAD, value=347)
 = (counter=MQUPLOAD, value=14961065367)
 = (counter=PAGES, value=183089568)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=23972)

 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)

 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)



Re: Counter Column Family Inconsistent Node

2011-08-16 Thread Jonathan Ellis
May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ?

On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote:
 yeah, sorry about that... pushed click before I added my comments.
 I have a cluster of 5 nodes using 0.8.4 where I am using counters.  One one
 of my nodes, every time I do a list command I get different results.  The
 counters jump all over the place.
 Any ideas?  I have run nodetool repair on all nodes.
 Thanks!
 Ryan

 On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote:

 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)
 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=93683)
 = (counter=FILEUPLOAD, value=347)
 = (counter=MQUPLOAD, value=14961065367)
 = (counter=PAGES, value=183089568)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=23972)
 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)
 1 Row Returned.
 [default@Race] list CounterCF;
 Using default limit of 100
 ---
 RowKey: Stats
 = (counter=APP, value=7503)
 = (counter=FILEUPLOAD, value=155)
 = (counter=MQUPLOAD, value=4726775)
 = (counter=PAGES, value=131948)
 = (counter=REST, value=3)
 = (counter=SOAP, value=44)
 = (counter=WS, value=1943)




-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of DataStax, the source for professional Cassandra support
http://www.datastax.com


Re: Counter Column Family Inconsistent Node

2011-08-16 Thread Ryan Lowe
Actually I think it was more related to our servers getting their time out
of sync... after finding this article:
http://ria101.wordpress.com/2011/02/08/cassandra-the-importance-of-system-clocks-avoiding-oom-and-how-to-escape-oom-meltdown/

I checked our servers, and sure enough, 2 of them were out of sync with each
other with more than a 2 min difference!  I reconfigured ntp and I think I
am back in business.

Thanks though!
Ryan

On Tue, Aug 16, 2011 at 2:53 PM, Jonathan Ellis jbel...@gmail.com wrote:

 May be the same as https://issues.apache.org/jira/browse/CASSANDRA-3006 ?

 On Tue, Aug 16, 2011 at 12:20 PM, Ryan Lowe ryanjl...@gmail.com wrote:
  yeah, sorry about that... pushed click before I added my comments.
  I have a cluster of 5 nodes using 0.8.4 where I am using counters.  One
 one
  of my nodes, every time I do a list command I get different results.  The
  counters jump all over the place.
  Any ideas?  I have run nodetool repair on all nodes.
  Thanks!
  Ryan
 
  On Tue, Aug 16, 2011 at 1:18 PM, Ryan Lowe ryanjl...@gmail.com wrote:
 
  [default@Race] list CounterCF;
  Using default limit of 100
  ---
  RowKey: Stats
  = (counter=APP, value=7503)
  = (counter=FILEUPLOAD, value=155)
  = (counter=MQUPLOAD, value=4726775)
  = (counter=PAGES, value=131948)
  = (counter=REST, value=3)
  = (counter=SOAP, value=44)
  = (counter=WS, value=1943)
  1 Row Returned.
  [default@Race] list CounterCF;
  Using default limit of 100
  ---
  RowKey: Stats
  = (counter=APP, value=93683)
  = (counter=FILEUPLOAD, value=347)
  = (counter=MQUPLOAD, value=14961065367)
  = (counter=PAGES, value=183089568)
  = (counter=REST, value=3)
  = (counter=SOAP, value=44)
  = (counter=WS, value=23972)
  1 Row Returned.
  [default@Race] list CounterCF;
  Using default limit of 100
  ---
  RowKey: Stats
  = (counter=APP, value=7503)
  = (counter=FILEUPLOAD, value=155)
  = (counter=MQUPLOAD, value=4726775)
  = (counter=PAGES, value=131948)
  = (counter=REST, value=3)
  = (counter=SOAP, value=44)
  = (counter=WS, value=1943)
  1 Row Returned.
  [default@Race] list CounterCF;
  Using default limit of 100
  ---
  RowKey: Stats
  = (counter=APP, value=7503)
  = (counter=FILEUPLOAD, value=155)
  = (counter=MQUPLOAD, value=4726775)
  = (counter=PAGES, value=131948)
  = (counter=REST, value=3)
  = (counter=SOAP, value=44)
  = (counter=WS, value=1943)
 



 --
 Jonathan Ellis
 Project Chair, Apache Cassandra
 co-founder of DataStax, the source for professional Cassandra support
 http://www.datastax.com